arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

David Talbot

52 papers · 1979–2026

1979: 11980: 01981: 11982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 11991: 01992: 01993: 01994: 01995: 01996: 01997: 01998: 01999: 02000: 02001: 02002: 12003: 192004: 12005: 42006: 22007: 32008: 22009: 12010: 02011: 42012: 12013: 02014: 02015: 02016: 02017: 02018: 02019: 12020: 02021: 52022: 02023: 12024: 12025: 12026: 2
1979peak 19 in 20032026

Frequent co-authors

Papers

showing 1–25 of 52 RSS

Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned

Elena Voita, David Talbot, Fedor Moiseev +2 more

cs.CL · · cited 1,643× · arXiv ↗ · more like this ·

Multi-head self-attention is a key component of the Transformer, a state-of-the-art architecture for neural machine translation. In this work we evaluate the contribution made by individual attention heads in the encoder to the overall performance of the model and analyze the roles played by them. We find that the most important and confident heads play consistent and often linguistically-interpretable roles. When pruning heads using a method based on stochastic gates and a differentiable relaxation of the L0 penalty, we observe that specialized heads are last to be pruned. Our novel pruning method removes the vast majority of heads without seriously affecting performance. For example, on the English-Russian WMT dataset, pruning 38 out of 48 encoder heads results in a drop of only 0.15 BLEU.

Edinburgh System Description for the 2005 IWSLT Speech Translation Evaluation

Philipp Koehn, Amittai Axelrod, Alexandra Birch +3 more

Artificial Intelligence · Edinburgh Research Explorer · · cited 366× · OpenAlex ↗ · more like this ·

Our participation in the IWSLT 2005 speech translation task is our first effort to work on limited domain speech data. We adapted our statistical machine translation system that performed successfully in previous DARPA competitions on open domain text translations. We participated in the supplied corpora transcription track. We achieved the highest BLEU score in 2 out of 5 language pairs and had competitive results for the other language pairs.

Statistical machine translation with word- and sentence-aligned parallel corpora

Chris Callison-Burch, David Talbot, Miles Osborne

Artificial Intelligence · · cited 92× · DOI ↗ · more like this ·

The parameters of statistical translation models are typically estimated from sentence-aligned parallel corpora. We show that significant improvements in the alignment and translation quality of such models can be achieved by additionally including word-aligned data during training. Incorporating word-level alignments into the parameter estimation of the IBM models reduces alignment error rate and increases the Bleu score when compared to training the same models only on sentence-aligned data. On the Verbmobil data set, we attain a 38% reduction in the alignment error rate and a higher Bleu score with half as many training examples. We discuss how varying the ratio of word-aligned to sentence-aligned data affects the expected performance gain.

Randomised Language Modelling for Statistical Machine Translation

David Talbot, Miles Osborne

Artificial Intelligence · Meeting of the Association for Computational Linguistics · · cited 73× · OpenAlex ↗ · more like this ·

A Bloom filter (BF) is a randomised data structure for set membership queries. Its space requirements are significantly below lossless information-theoretic lower bounds but it produces false positives with some quantifiable probability. Here we explore the use of BFs for language modelling in statis-tical machine translation. We show how a BF containing n-grams can enable us to use much larger corpora and higher-order models complementing a con-ventional n-gram LM within an SMT sys-tem. We also consider (i) how to include ap-proximate frequency information efficiently within a BF and (ii) how to reduce the er-ror rate of these models by first checking for lower-order sub-sequences in candidate n-grams. Our solutions in both cases retain the one-sided error guarantees of the BF while taking advantage of the Zipf-like distribution of word frequencies to reduce the space re-quirements. 1

Randomized Language Models via Perfect Hash Functions

David Talbot, Thorsten Brants

Artificial Intelligence · Meeting of the Association for Computational Linguistics · · cited 69× · OpenAlex ↗ · more like this ·

We propose a succinct randomized language model which employs a perfect hash function to encode fingerprints of n-grams and their associated probabilities, backoff weights, or other parameters. The scheme can represent any standard n-gram model and is easily combined with existing model reduction techniques such as entropy-pruning. We demonstrate the space-savings of the scheme via machine translation experiments within a distributed language modeling framework. 1

Smoothed Bloom Filter Language Models: Tera-Scale LMs on the Cheap

David Talbot, Miles Osborne

Computer Networks and Communications · Empirical Methods in Natural Language Processing · · cited 60× · OpenAlex ↗ · more like this ·

A Bloom filter (BF) is a randomised data structure for set membership queries. Its space requirements fall significantly below lossless information-theoretic lower bounds but it produces false positives with some quantifiable probability. Here we present a general framework for deriving smoothed language model probabilities from BFs. We investigate how a BF containing n-gram statistics can be used as a direct replacement for a conventional n-gram model. Recent work has demonstrated that corpus statistics can be stored efficiently within a BF, here we consider how smoothed language model probabilities can be derived efficiently from this randomised representation. Our proposal takes advantage of the one-sided error guarantees of the BF and simple inequalities that hold between related n-gram statistics in order to further reduce the BF storage requirements and the error rate of the…

Training a Parser for Machine Translation Reordering

Jason Katz-Brown, Slav Petrov, Ryan McDonald +5 more

Artificial Intelligence · Empirical Methods in Natural Language Processing · · cited 49× · OpenAlex ↗ · more like this ·

We propose a simple training regime that can improve the extrinsic performance of a parser, given only a corpus of sentences and a way to automatically evaluate the extrinsic quality of a candidate parse. We apply our method to train parsers that excel when used as part of a reordering component in a statistical machine translation system. We use a corpus of weakly-labeled reference reorderings to guide parser training. Our best parsers contribute significant improvements in subjective translation quality while their intrinsic attachment scores typically regress. 1

Language-independent compound splitting with morphological operations

Klaus Macherey, Andrew M. Dai, David Talbot +2 more

Artificial Intelligence · Meeting of the Association for Computational Linguistics · · cited 46× · OpenAlex ↗ · more like this ·

Translating compounds is an important problem in machine translation. Since many compounds have not been observed during training, they pose a challenge for translation systems. Previous decompounding methods have often been restricted to a small set of languages as they cannot deal with more complex compound forming processes. We present a novel and unsupervised method to learn the compound parts and morphological operations needed to split compounds into their compound parts. The method uses a bilingual corpus to learn the morphological operations required to split a compound into its parts. Furthermore, monolingual corpora are used to learn and filter the set of compound part candidates. We evaluate our method within a machine translation task and show significant improvements for various languages to show the versatility of the approach. 1

A Lightweight Evaluation Framework for Machine Translation Reordering

David Talbot, Hideto Kazawa, Hiroshi Ichikawa +3 more

Artificial Intelligence · Workshop on Statistical Machine Translation · · cited 40× · OpenAlex ↗ · more like this ·

Reordering is a major challenge for machine translation between distant languages. Recent work has shown that evaluation metrics that explicitly account for target language word order correlate better with human judgments of translation quality. Here we present a simple framework for evaluating word order independently of lexical choice by comparing the system’s reordering of a source sentence to reference reordering data generated from manually word-aligned translations. When used to evaluate a system that performs reordering as a preprocessing step our framework allows the parser and reordering rules to be evaluated extremely quickly without time-consuming endto-end machine translation experiments. A novelty of our approach is that the translations used to generate the reordering reference data are generated in an alignment-oriented fashion. We show that how the alignments are…

Modelling lexical redundancy for machine translation

David Talbot, Miles Osborne

Artificial Intelligence · · cited 31× · DOI ↗ · more like this ·

Certain distinctions made in the lexicon of one language may be redundant when translating into another language. We quantify redundancy among source types by the similarity of their distributions over target types. We propose a language-independent framework for minimising lexical redundancy that can be optimised directly from parallel text. Optimisation of the source lexicon for a given target language is viewed as model selection over a set of cluster-based translation models.Redundant distinctions between types may exhibit monolingual regularities, for example, inflexion patterns. We define a prior over model structure using a Markov random field and learn features over sets of monolingual types that are predictive of bilingual redundancy. The prior makes model selection more robust without the need for language-specific assumptions regarding redundancy. Using these models in a…

Watermarking the Outputs of Structured Prediction with an application in Statistical Machine Translation.

Ashish Venugopal, Jakob Uszkoreit, David Talbot +2 more

Artificial Intelligence · Empirical Methods in Natural Language Processing · · cited 23× · OpenAlex ↗ · more like this ·

We propose a general method to watermark and probabilistically identify the structured outputs of machine learning algorithms. Our method is robust to local editing operations and provides well defined trade-offs between the ability to identify algorithm outputs and the quality of the watermarked output. Unlike previous work in the field, our approach does not rely on controlling the inputs to the algorithm and provides probabilistic guarantees on the ability to identify collections of results from one’s own algorithm. We present an application in statistical machine translation, where machine translated output is watermarked at minimal loss in translation quality and detected with high recall. and human generated translations are currently both found extensively on the web, with no automatic way of distinguishing between them. Algorithms that mine data from the web (Uszkoreit et al.…

Edinburgh System Descriptionfor the 2005 NIST MT Evaluation

Philipp Koehn, Amittai Axelrod, Alexandra Birch +4 more

Artificial Intelligence · · cited 19× · DOI ↗ · more like this ·

The objective was to study the effect of whole-body vibration (WBV) on strength, balance and pain in patients with peripheral neuropathies and to consider its significance for the rehabilitation of patients suffering from chemotherapy-induced peripheral neuropathy (CIPN). Using a broad search strategy, PubMed was searched for clinical trials on WBV interventions aimed at improving strength, balance or pain in patients with peripheral neuropathies, which were published in English until 5th June 2014. The search was performed by the first author and generated a total of 505 results, which yielded 5 articles that met the inclusion criteria, being studies: i) published in English; ii) involving adult human subjects’ peripheral neuropathies; iii) evaluating the effect of WBV as a therapeutic intervention; and iv) reporting findings for at least one of the following outcomes: strength…

Succinct approximate counting of skewed data

David Talbot

Artificial Intelligence · International Joint Conference on Artificial Intelligence · · cited 14× · OpenAlex ↗ · more like this ·

Practical data analysis relies on the ability to count observations of objects succinctly and efficiently. Unfortunately the space usage of an exact estimator grows with the size of the a priori set from which objects are drawn while the time required to maintain such an estimator grows with the size of the data set. We present static and on-line approximation schemes that avoid these limitations when approximate frequency estimates are acceptable. Our Log-Frequency Sketch extends the approximate counting algorithm of Morris [1978] to estimate frequencies with bounded relative error via a single pass over a data set. It uses constant space per object when the frequencies follow a power law and can be maintained in constant time per observation. We give an (ɛ, δ)-approximation scheme which we verify empirically on a large natural language data set where, for instance, 95 percent of…

Bloom maps

David Talbot, John Talbot

cs.DS · · cited 8× · arXiv ↗ · more like this ·

We consider the problem of succinctly encoding a static map to support approximate queries. We derive upper and lower bounds on the space requirements in terms of the error rate and the entropy of the distribution of values over keys: our bounds differ by a factor log e. For the upper bound we introduce a novel data structure, the Bloom map, generalising the Bloom filter to this problem. The lower bound follows from an information theoretic argument.

Constrained EM for parallel text alignment

David Talbot

Artificial Intelligence · Natural Language Engineering · · cited 8× · DOI ↗ · more like this ·

Standard parameter estimation schemes for statistical translation models can struggle to find reasonable settings on some parallel corpora. We show how auxiliary information can be used to constrain the procedure directly by restricting the set of alignments explored during parameter estimation. This enables the integration of bilingual and monolingual knowledge sources while retaining the flexibility of the underlying models. We demonstrate the effectiveness of this approach for incorporating linguistic and domain-specific constraints on various parallel corpora, and consider the importance of using the context of the parallel text to guide the application of such constraints.

Integrating recommendations from sustainability performance audits: moving from words to action

David Talbot, Olivier Boiral

Public Administration · Public Management Review · · cited 6× · DOI ↗ · more like this ·

This study explores how government organizations integrate audit recommendations and justify decoupling auditees’ commitments from organizational realities. Moreover, it examines the analysis of recommendations from 31 sustainability performance audits conducted in 20 Canadian public organizations over 12 years. The longitudinal approach adopted in this study revealed decoupling strategies in most audited organizations and a tendency to perpetuate and reproduce these practices over time. Several factors, such as political interference and problems in the dimensions considered in the audit, contribute to the emergence and maintenance of decoupling over time.

Edinburgh System Description for the 2006 TC-STAR Spoken Language Translation Evaluation

Abhishek Arun, Amittai Axelrod, Alexandra Birch Mayne +5 more

Artificial Intelligence · Integrative and Comparative Biology · · cited 5× · DOI ↗ · more like this ·

In this paper we describe the Edinburgh University statisti cal machine translation system, as used for the TC-STAR 2006 evaluation campaign. We participated in the primary Final Text Edition track for the Spanish to English and English to Spanish translation tasks, using only the provided datasets for training our translati on and language models. We obtained the highest WNM/Recall score in both language pairs and had competitive results for all other evaluation metrics.

The Quest for Coherence in Climate Actions: The Case for Québec's Climate Strategy

Alain Fopa Tchinda, David Talbot

Urban Studies · Environmental Policy and Governance · · cited 3× · DOI ↗ · more like this ·

ABSTRACT Studies on climate policy coherence often focus on policy components as the essential element of success by examining their objectives, instruments, and implementation practices. However, while some studies have demonstrated that it is essential to evaluate the programs or actions that translate policies into success, few have focused specifically on program coherence. This research uses monitoring sheets for programs ( N = 177) funded under the Québec Climate Change Action Plan (CCAP) 2013–2020 to perform a comprehensive analysis of program coherence, combining relational content analysis and social network analysis. Findings suggest a failure to achieve the action plan and provide pertinent shortcomings and gaps related to the program's objectives and indicators, including challenges with collaboration and coordination. Given the complexity and cross‐cutting nature of climate…

Exploring the effects of international experiences on cultural intelligence

Geneviève Morin, David Talbot

Communication · Journal of International Development · · cited 3× · DOI ↗ · more like this ·

Abstract This study aims to assess the effects of pre‐adult international experiences on expatriate workers' cultural intelligence (CQ). Two data sources were used to achieve this goal; a quantitative survey administered online to expatriates ( n = 1713) and the culture database of Hofstede. The analyses identified six deep antecedents of CQ. This study contributes to the scientific literature on the antecedents of CQ by examining non‐work‐related international experiences before adulthood in two cultural contexts. It is also one of the first studies to use the third culture kids concept to explain expatriate CQ.

Cultural Intelligence of Expatriate Health Workers in an Inuit Context: An Exploration of Managerial Competency Profiles

Geneviève Morin, David Talbot

Sociology and Political Science · Businesses · · cited 3× · DOI ↗ · more like this ·

Developing cultural diversity skills is a major ethical challenge for organizations operating within marginalized communities. This study defines cultural intelligence profiles us a two-step approach. In the first step, managers (n = 31) are invited to complete a Cultural Intelligence Quotient Assessment Test to identify and describe different managerial profiles. In the second step, semi-structured interviews are conducted (n = 17) to better understand the characteristics of the managerial profiles developed in phase one. The findings indicate that there are three typical managerial profiles: (1) The opportunist, (2) the modern missionary, and (3) the seasoned sage. These managerial profiles highlight the emerging dynamics of the cultural intelligence model and provide a better understanding of the career trajectories of managers in the healthcare sector. The results also have…

Data Components in Visual Studio .NET

Mahesh Chand, David Talbot

Computer Networks and Communications · Apress eBooks · · cited 1× · DOI ↗ · more like this ·

In the previous chapter, you saw the basics of the ADO.NET model and its components and how they are connected to each other in the ADO.NET architecture. The Visual Studio .NET (VS .NET) Integrated Development Environment (IDE) provides design-time support to work with data components. In this chapter, you'll learn how to use these data components in the VS .NET IDE at design-time to create database applications. Using ADO.NET components (also referred to as data components) is similar to using any Windows control. You just drag the component from the Toolbox to a form, set its properties and methods, and you're up and running.KeywordsData ProviderVisual StudioData ComponentDatabase ObjectDatabase ApplicationThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Power and light: political strategies for the solar transition

David Talbot, Robert Morgan

Sociology and Political Science · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · · cited 1× · OpenAlex ↗ · more like this ·

By taking crucial energy decisions into their own hands, concerned Americans can turn around our nation's irrational energy policy. The authors feel that, while energy companies may have a stranglehold on federal policy, they can't stop local citizens and public officials from pursuing renewable energy alternatives in their own communities. They cite examples where citizens have overcome institutional barriers to the development of decentralized energy resources. Even more important, these diverse local activities together comprise a potent political force capable of offering a rational alternative to increased dependence on nuclear energy and fossil fuels. The authors offer useful advice to proponents of the solar transition: (1) begin with local institutions that have the power to make energy decisions, but are relatively free from the influence of multinational energy firms, and (2)…

Connecting across borders: the role of social media influencers in expatriate experiences

Geneviève Morin, Nataly Levesque, David Talbot

Sociology and Political Science · Journal of Product & Brand Management · · cited 0× · DOI ↗ · more like this ·

Purpose This study aims to investigate expatriates’ engagement with social media influencers from a human brand perspective. Expatriate consumer profiles were identified based on their engagement behaviors and the contextual and psychosocial factors driving their interactions with influencer content were explored. This research extends the brand engagement framework to the expatriation context, emphasizing the role of influencers as relational human brands and cultural intermediaries in supporting expatriate identity transition. Design/methodology/approach A three-stage, sequential, mixed-methods approach was used to explore expatriates’ engagement with influencers. The expatriate profiles were categorized using quantitative analysis. Qualitative methods were used to examine the motivations and contextual factors underlying these relationships. Data were collected through surveys of…

Contextual Ethical Leadership as a Lever for Integrating and Engaging Expatriates

Geneviève Morin, David Talbot

Communication · Thunderbird International Business Review · · cited 0× · DOI ↗ · more like this ·

ABSTRACT In a globalized world marked by ethical controversies across sectors, understanding how leaders navigate complex contexts has become crucial to ensuring responsible and legitimate governance. These controversies highlight the need for ethical leadership that is responsive to cultural and contextual complexities. This study aims to identify the characteristics of ethical leadership in multicultural settings involving expatriate workers. A total of 611 expatriates provided insights through a combination of open‐ and closed‐ended survey questions. Using an inductive qualitative approach, the analyses revealed six traits associated with ethically perceived leadership: role‐model behavior, openness to cultural diversity, transparency, supportive management practices, encouragement of autonomy, and team‐based ethics. The findings suggest that ethics cannot be separated from the…

Maidenhood to Marriage

David Talbot

Sociology and Political Science · · cited 0× · DOI ↗ · more like this ·

The first great event in the life of an Ibibio girl is her entrance into the “Fatting-house,” on the occasion of Mbobi—i.e. “The Coming of Small Breasts.” There is a beautiful appropriateness in a choice of the spirits of streams and pools as the special guardians of maidenhood. Among most Ibibio tribes all such rites are undergone in order to draw down the blessing of Eka Mbopo, the “Mother of the Fatting-house.” By native law the whole question turned upon the point as to whether the deceased was free born, or a “member” of the first claimant’s family. The excellent parti with whom the new alliance had been all but arranged, at a higher rate than ever before, had to be abandoned, and the pair disappeared in the direction of Mbukpo, where they were lost sight of, but are still in all probability, pursuing their profitable career amid “fresh woods and pastures new.”.