arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Andy Way

381 papers · 1990–2025

1990: 11991: 11992: 01993: 01994: 01995: 01996: 01997: 11998: 01999: 02000: 32001: 42002: 52003: 72004: 112005: 102006: 142007: 162008: 122009: 282010: 312011: 242012: 132013: 42014: 142015: 122016: 232017: 342018: 262019: 202020: 332021: 92022: 52023: 62024: 132025: 1
1990peak 34 in 20172025

Frequent co-authors

Papers

showing 1–25 of 381 RSS

Getting Gender Right in Neural Machine Translation

Eva Vanmassenhove, Christian Hardmeier, Andy Way

cs.CL · · cited 224× · arXiv ↗ · more like this ·

Speakers of different languages must attend to and encode strikingly different aspects of the world in order to use their language correctly (Sapir, 1921; Slobin, 1996). One such difference is related to the way gender is expressed in a language. Saying "I am happy" in English, does not encode any additional knowledge of the speaker that uttered the sentence. However, many other languages do have grammatical gender systems and so such knowledge would be encoded. In order to correctly translate such a sentence into, say, French, the inherent gender information needs to be retained/recovered. The same sentence would become either "Je suis heureux", for a male speaker or "Je suis heureuse" for a female one. Apart from morphological agreement, demographic factors (gender, age, etc.) also influence our use of language in terms of word choices or even on the level of syntactic constructions…

Exploiting Cross-Sentence Context for Neural Machine Translation

Longyue Wang, Zhaopeng Tu, Andy Way +1 more

cs.CL · · cited 209× · arXiv ↗ · more like this ·

In translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a cross-sentence context-aware approach and investigate the influence of historical contextual information on the performance of neural machine translation (NMT). First, this history is summarized in a hierarchical way. We then integrate the historical representation into NMT in two strategies: 1) a warm-start of encoder and decoder states, and 2) an auxiliary context source for updating decoder states. Experimental results on a large Chinese-English translation task show that our approach significantly improves upon a strong attention-based NMT system by up to +2.1 BLEU points.

Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translation

Antonio Toral, Sheila Castilho, Ke Hu +1 more

cs.CL · · cited 205× · arXiv ↗ · more like this ·

We reassess a recent study (Hassan et al., 2018) that claimed that machine translation (MT) has reached human parity for the translation of news from Chinese into English, using pairwise ranking and considering three variables that were not taken into account in that previous study: the language in which the source side of the test set was originally written, the translation proficiency of the evaluators, and the provision of inter-sentential context. If we consider only original source text (i.e. not translated from another language, or translationese), then we find evidence showing that human parity has not been achieved. We compare the judgments of professional translators against those of non-experts and discover that those of the experts result in higher inter-annotator agreement and better discrimination between human and machine translations. In addition, we analyse the human…

Is Neural Machine Translation the New State of the Art?

Sheila Castilho, Joss Moorkens, Federico Gaspari +3 more

Artificial Intelligence · ˜The œPrague Bulletin of Mathematical Linguistics · · cited 199× · DOI ↗ · more like this ·

Abstract This paper discusses neural machine translation (NMT), a new paradigm in the MT field, comparing the quality of NMT systems with statistical MT by describing three studies using automatic and human evaluation methods. Automatic evaluation results presented for NMT are very promising, however human evaluations show mixed results. We report increases in fluency but inconsistent results for adequacy and post-editing effort. NMT undoubtedly represents a step forward for the MT field, but one that the community should be careful not to oversell.

Investigating Backtranslation in Neural Machine Translation

Alberto Poncelas, Dimitar Shterionov, Andy Way +2 more

cs.CL · · cited 157× · arXiv ↗ · more like this ·

A prerequisite for training corpus-based machine translation (MT) systems -- either Statistical MT (SMT) or Neural MT (NMT) -- is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT has been shown in many studies to outperform SMT, but mostly when large parallel corpora are available; in cases where data is limited, SMT can still outperform NMT. Recently researchers have shown that back-translating monolingual data can be used to create synthetic parallel corpora, which in turn can be used in combination with authentic parallel data to train a high-quality NMT system. Given that large collections of new parallel text become available only quite rarely, backtranslation has become the norm when building state-of-the-art NMT systems, especially in resource-poor scenarios. However, we assert that there are many unknown factors…

Adaptive Machine Translation with Large Language Models

Yasmin Moslem, Rejwanul Haque, John D. Kelleher +1 more

cs.CL · · cited 138× · arXiv ↗ · more like this ·

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved significant progress in the area of domain adaptation. However, real-time adaptation remains challenging. Large-scale language models (LLMs) have recently shown interesting capabilities of in-context learning, where they learn to replicate certain input-output text generation patterns, without further fine-tuning. By feeding an LLM at inference time with a prompt that consists of a list of translation pairs, it can then simulate the domain and style characteristics. This work aims to investigate how we can utilize in-context learning to improve real-time adaptive MT. Our extensive experiments show promising results at translation time. For example, LLMs can…

Lost in Translation: Loss and Decay of Linguistic Richness in Machine Translation

Eva Vanmassenhove, Dimitar Shterionov, Andy Way

cs.CL · · cited 129× · arXiv ↗ · more like this ·

This work presents an empirical approach to quantifying the loss of lexical richness in Machine Translation (MT) systems compared to Human Translation (HT). Our experiments show how current MT systems indeed fail to render the lexical diversity of human generated or translated text. The inability of MT systems to generate diverse outputs and its tendency to exacerbate already frequent patterns while ignoring less frequent ones, might be the underlying cause for, among others, the currently heavily debated issues related to gender biased output. Can we indeed, aside from biased data, talk about an algorithm that exacerbates seen biases?

Recent Advances in Example-Based Machine Translation

Michaël Carl, Andy Way, Walter Daelemans

Artificial Intelligence · Computational Linguistics · · cited 126× · DOI ↗ · more like this ·

example, where the machine side requires some standard expressions in order to execute certain machine actions.Language translation is one of the most complicated tasks of the human brain, which utilizes not only linguistic knowledge but also knowledge of the world, and varieties of our sophisticated human senses.EBMT is one of the possible approaches to the mechanism of human translation, and this book represents a considerable contribution to the field.But we have to investigate many other possibilities to approach the level of the complex functions of the human brain.

Long-distance dependency resolution in automatically acquired wide-coverage PCFG-based LFG approximations

Aoife Cahill, Michael Burke, Ruth O'Donovan +2 more

Artificial Intelligence · Dublin City University Open Access Institutional Repository (Dublin City University) · · cited 112× · DOI ↗ · more like this ·

This paper shows how finite approximations of long distance dependency (LDD) resolution can be obtained automatically for wide-coverage, robust, probabilistic Lexical-Functional Grammar (LFG) resources acquired from treebanks. We extract LFG subcategorisation frames and paths linking LDD reentrancies from f-structures generated automatically for the Penn-II treebank trees and use them in an LDD resolution algorithm to parse new text. Unlike (Collins, 1999; Johnson, 2000), in our approach resolution of LDDs is done at f-structure (attribute-value structure representations of basic predicate-argument or dependency structure) without empty productions, traces and coindexation in CFG parse trees. Currently our best automatically induced grammars achieve 80.97% f-score for f-structures parsing section 23 of the WSJ part of the Penn-II treebank and evaluating against the DCU 1051 and 80.24%…

Translators’ perceptions of literary post-editing using statistical and neural machine translation

Joss Moorkens, Antonio Toral, Sheila Castilho +1 more

Artificial Intelligence · Translation Spaces · · cited 94× · DOI ↗ · more like this ·

Abstract In the context of recent improvements in the quality of machine translation (MT) output and new use cases being found for that output, this article reports on an experiment using statistical and neural MT systems to translate literature. Six professional translators with experience of literary translation produced English-to-Catalan translations under three conditions: translation from scratch, neural MT post-editing, and statistical MT post-editing. They provided feedback before and after the translation via questionnaires and interviews. While all participants prefer to translate from scratch, mostly due to the freedom to be creative without the constraints of segment-level segmentation, those with less experience find the MT suggestions useful.

Post-editing Effort of a Novel With Statistical and Neural Machine Translation

Antonio Toral, Martijn Wieling, Andy Way

Artificial Intelligence · Frontiers in Digital Humanities · · cited 85× · DOI ↗ · more like this ·

We conduct the first experiment in the literature in which a novel is translated automatically and then post-edited by professional literary translators. Our case study is Warbreaker, a popular fantasy novel originally written in English, which we translate into Catalan. We translated one chapter of the novel (over 3,700 words, 330 sentences) with two data-driven approaches to Machine Translation (MT): phrase-based statistical MT (PBMT) and neural MT (NMT). Both systems are tailored to novels; they are trained on over 100 million words of fiction. In the post- editing experiment, six professional translators with previous experience in literary translation translate subsets of this chapter under three alternating conditions: from scratch (the norm in the novel translation industry), post-editing PBMT, and post-editing NMT. We record all the keystrokes, the time taken to translate each…

Wide-Coverage Deep Statistical Parsing Using Automatic Dependency Structure Annotation

Aoife Cahill, Michael Burke, Ruth O'Donovan +3 more

Artificial Intelligence · Computational Linguistics · · cited 84× · DOI ↗ · more like this ·

A number of researchers have recently conducted experiments comparing “deep” hand-crafted wide-coverage with “shallow” treebank- and machine-learning-based parsers at the level of dependencies, using simple and automatic methods to convert tree output generated by the shallow parsers into dependencies. In this article, we revisit such experiments, this time using sophisticated automatic LFG f-structure annotation methodologies with surprising results. We compare various PCFG and history-based parsers to find a baseline parsing system that fits best into our automatic dependency structure annotation technique. This combined system of syntactic parser and dependency structure annotation is compared to two hand-crafted, deep constraint-based parsers, RASP and XLE. We evaluate using dependency-based gold standards and use the Approximate Randomization Test to test the statistical…

Seeing the wood for the trees: data-oriented translation

Mary Hearne, Andy Way

Artificial Intelligence · Arrow@dit (Dublin Institute of Technology) · · cited 78× · OpenAlex ↗ · more like this ·

Data-Oriented Translation (DOT), which is based on Data-Oriented Parsing (DOP), comprises an experience-based approach to translation, where new translations are derived with reference to grammatical analyses of previous translations. Previous DOT experiments [Poutsma, 1998, Poutsma, 2000a, Poutsma, 2000b] were small in scale because important advances in DOP technology were not incorporated
\ninto the translation model. Despite this, related work [Way, 1999, Way, 2003a, Way, 2003b] reports that DOT models are viable in that solutions to ‘hard’ translation cases are readily available. However, it has not been shown to date that DOT models scale to larger datasets. In this work, we describe a novel DOT system, inspired by recent advances in DOP parsing technology. We test our system on larger, more complex corpora than have been used heretofore, and present both automatic and human…

Bridging SMT and TM with Translation Recommendation

Yifan He, Yanjun Ma, Josef van Genabith +1 more

Artificial Intelligence · Arrow@dit (Dublin Institute of Technology) · · cited 76× · OpenAlex ↗ · more like this ·

We propose a translation recommendation framework to integrate Statistical Machine Translation (SMT) output with Translation Memory (TM) systems. The framework recommends SMT outputs to a TM user when it predicts that SMT outputs are more suitable for post-editing than the hits provided by the TM. We describe an implementation of this framework using an SVM binary classifier. We exploit methods to fine-tune the classifier and investigate a variety of features of different types. We rely on automatic MT evaluation
\nmetrics to approximate human judgements in our experiments. Experimental results show that our system can achieve 0.85 precision at 0.89 recall, excluding exact matches. futhermore, it is possible for the end-user to achieve a desired balance between precision and recall by adjusting
\nconfidence levels.

Large-Scale Induction and Evaluation of Lexical Resources from the Penn-II and Penn-III Treebanks

Ruth O'Donovan, Michael Burke, Aoife Cahill +2 more

Artificial Intelligence · Computational Linguistics · · cited 76× · DOI ↗ · more like this ·

We present a methodology for extracting subcategorization frames based on an automatic lexical-functional grammar (LFG) f-structure annotation algorithm for the Penn-II and Penn-III Treebanks. We extract syntactic-function-based subcategorization frames (LFG semantic forms) and traditional CFG category-based subcategorization frames as well as mixed function/category-based frames, with or without preposition information for obliques and particle information for particle verbs. Our approach associates probabilities with frames conditional on the lemma, distinguishes between active and passive frames, and fully reflects the effects of long-distance dependencies in the source data structures. In contrast to many other approaches, ours does not predefine the subcategorization frame types extracted, learning them instead from the source data. Including particles and prepositions, we extract…

Multi-Level Structured Self-Attentions for Distantly Supervised Relation Extraction

Jinhua Du, Jingguang Han, Andy Way +1 more

cs.CL · · cited 75× · arXiv ↗ · more like this ·

Attention mechanisms are often used in deep neural networks for distantly supervised relation extraction (DS-RE) to distinguish valid from noisy instances. However, traditional 1-D vector attention models are insufficient for the learning of different contexts in the selection of valid instances to predict the relationship for an entity pair. To alleviate this issue, we propose a novel multi-level structured (2-D matrix) self-attention mechanism for DS-RE in a multi-instance learning (MIL) framework using bidirectional recurrent neural networks. In the proposed method, a structured word-level self-attention mechanism learns a 2-D matrix where each row vector represents a weight distribution for different aspects of an instance regarding two entities. Targeting the MIL issue, the structured sentence-level attention learns a 2-D matrix where each row vector represents a weight…

Supertagged Phrase-Based Statistical Machine Translation

Hany Hassan, Khalil Sima’an, Andy Way

Artificial Intelligence · UvA-DARE (University of Amsterdam) · · cited 70× · OpenAlex ↗ · more like this ·

Phrase-based Statistical Machine Translation (PBSMT) systems represent the dominant approach in MT today. However, unlike systems in other paradigms, it has proven difficult to date to incorporate syntactic knowledge in order to improve translation quality. This paper improves on recent research which uses ‘syntactified ’ target language phrases, by incorporating supertags as constraints to better resolve parse tree fragments. In addition, we do not impose any sentence-length limit, and using a log-linear decoder, we outperform a stateof-the-art PBSMT system by over 1.3 BLEU points (or 3.51% relative) on the NIST 2003 Arabic–English test corpus. 1.

Exploiting source similarity for SMT using context-informed features

Nicolas Stroppa, Antal van den Bosch, Andy Way

Artificial Intelligence · Arrow@dit (Dublin Institute of Technology) · · cited 63× · OpenAlex ↗ · more like this ·

In this paper, we introduce context informed features in a log-linear phrase-based SMT framework; these features enable us to exploit source similarity in addition to target similarity modeled by the language model. We
\npresent a memory-based classification framework that enables the estimation of these features while avoiding
\nsparseness problems. We evaluate the performance of our approach on Italian-to-English and Chinese-to-English translation tasks using a state-of-the-art phrase-based SMT
\nsystem, and report significant improvements for both BLEU and NIST scores when adding the context-informed features.

Machine-assisted translation of literary text

Antonio Toral, Andy Way

Artificial Intelligence · Translation Spaces · · cited 61× · DOI ↗ · more like this ·

Contrary to perceived wisdom, we explore the role of machine translation (MT) in assisting with the translation of literary texts, considering both its limitations and its potential. Our motivations to explore this subject are twofold, arising from: (1) recent research advances in MT, and (2) the recent emergence of the ebook, which together allow us for the first time to build literature-specific MT systems by training statistical MT models on novels and their professional translations. A key challenge in literary translation is that one needs to preserve not only the meaning (as in other domains such as technical translation) but also the reading experience, so a literary translator needs to carefully select from the possible translation options. We explore the role of translation options in literary translation, especially in the context of the relatedness of the languages involved.…

Statistical Machine Translation: A Guide for Linguists and Translators

Mary Hearne, Andy Way

Artificial Intelligence · Language and Linguistics Compass · · cited 61× · DOI ↗ · more like this ·

Abstract This paper presents an overview of Statistical Machine Translation (SMT), which is currently the dominant approach in Machine Translation (MT) research. In , we describe how central linguists and translators are to the MT process, so that SMT developers and researchers may better understand how to include these groups in continuing to advance the state‐of‐the‐art. If these constituencies are to make an impact in the field of MT, they need to know how their input is used by SMT systems. Accordingly, our objective in this paper is to present the basic principles underpinning SMT in a way that linguists and translators will find accessible and useful.

MaTrEx: the DCU Machine Translation System for IWSLT 2007

Hany Hassan, Yanjun Ma, Andy Way

Artificial Intelligence · Arrow@dit (Dublin Institute of Technology) · · cited 60× · OpenAlex ↗ · more like this ·

In this paper, we give a description of the machine translation system devel-oped at DCU that was used for our sec-ond participation in the evaluation cam-paign of the International Workshop on Spoken Language Translation (IWSLT 2007). In this participation, we focus on some new methods to improve sys-tem quality. Specifically, we try our word packing technique for different language pairs, we smooth our translation tables with out-of-domain word translations for the Arabic–English and Chinese–English tasks in order to solve the high number of out of vocabulary items, and finally we deploy a translation-based model for case and punctuation restoration. We participated in both the classical and challenge tasks for the following translation directions: Chinese–English, Japanese–English and Arabic–English. For the last two tasks, we translated both the single-best ASR hypotheses and the…

Dependency-based automatic evaluation for machine translation

Karolina Owczarzak, Josef van Genabith, Andy Way

Artificial Intelligence · Dublin City University Open Access Institutional Repository (Dublin City University) · · cited 59× · DOI ↗ · more like this ·

We present a novel method for evaluating the output of Machine Translation (MT), based on comparing the dependency structures of the translation and reference rather than their surface string forms. Our method uses a treebank-based, widecoverage, probabilistic Lexical-Functional Grammar (LFG) parser to produce a set of structural dependencies for each translation-reference sentence pair, and then calculates the precision and recall for these dependencies. Our dependency-based evaluation, in contrast to most popular string-based evaluation metrics, will not unfairly penalize perfectly valid syntactic variations in the translation. In addition to allowing for legitimate syntactic differences, we use paraphrases in the evaluation process to account for lexical variation. In comparison with other metrics on 16,800 sentences of Chinese-English newswire text, our method reaches high…

adaptMLLM: Fine-Tuning Multilingual Language Models on Low-Resource Languages with Integrated LLM Playgrounds

Séamus Lankford, Haithem Afli, Andy Way

cs.CL · · cited 55× · arXiv ↗ · more like this ·

The advent of Multilingual Language Models (MLLMs) and Large Language Models has spawned innovation in many areas of natural language processing. Despite the exciting potential of this technology, its impact on developing high-quality Machine Translation (MT) outputs for low-resource languages remains relatively under-explored. Furthermore, an open-source application, dedicated to both fine-tuning MLLMs and managing the complete MT workflow for low-resources languages, remains unavailable. We aim to address these imbalances through the development of adaptMLLM, which streamlines all processes involved in the fine-tuning of MLLMs for MT. This open-source application is tailored for developers, translators, and users who are engaged in MT. An intuitive interface allows for easy customisation of hyperparameters, and the application offers a range of metrics for model evaluation and the…

A Comparative Quality Evaluation of PBSMT and NMT using Professional Translators

Sheila Castilho, Joss Moorkens, Federico Gaspari +7 more

Artificial Intelligence · Edinburgh Research Explorer (University of Edinburgh) · · cited 55× · OpenAlex ↗ · more like this ·

This paper reports on a comparative evaluation of phrase-based statistical machine translation (PBSMT) and neural machine translation (NMT) for four language pairs, using the PET interface to compare educational domain output from both systems using a variety of metrics, including automatic evaluation as well as human rankings of adequacy and fluency, error-type markup, and post-editing (technical and temporal) effort, performed by professional translators.<br/>Our results show a preference for NMT in side-by-side ranking for all language pairs, texts, and segment lengths. In addition, perceived fluency is improved and annotated errors are fewer in the NMT output. Results are mixed for perceived adequacy and for errors of omission, addition, and mistranslation. Despite far fewer segments requiring post-editing, document-level post-editing performance was not found to have significantly…

Labelled dependencies in machine translation evaluation

Karolina Owczarzak, Josef van Genabith, Andy Way

Artificial Intelligence · Dublin City University Open Access Institutional Repository (Dublin City University) · · cited 55× · DOI ↗ · more like this ·

We present a method for evaluating the quality of Machine Translation (MT) output, using labelled dependencies produced by a Lexical-Functional Grammar (LFG) parser. Our dependencybased method, in contrast to most popular string-based evaluation metrics, does not unfairly penalize perfectly valid syntactic variations in the translation, and the addition of WordNet provides a way to accommodate lexical variation. In comparison with other metrics on 16,800 sentences of Chinese-English newswire text, our method reaches high correlation with human scores.