arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Shankar Kumar

151 papers · 1978–2026

1978: 11979: 01980: 01981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 11997: 01998: 01999: 12000: 12001: 22002: 22003: 12004: 42005: 32006: 12007: 42008: 32009: 22010: 52011: 62012: 22013: 22014: 42015: 52016: 32017: 82018: 72019: 72020: 92021: 102022: 142023: 182024: 102025: 122026: 3
1978peak 18 in 20232026

Frequent co-authors

Papers

showing 1–25 of 151 RSS

Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss

Qian Zhang, Han Lu, Hasim Sak +4 more

eess.AS · · cited 544× · arXiv ↗ · more like this ·

In this paper we present an end-to-end speech recognition model with Transformer encoders that can be used in a streaming speech recognition system. Transformer computation blocks based on self-attention are used to encode both audio and label sequences independently. The activations from both audio and label encoders are combined with a feed-forward layer to compute a probability distribution over the label space for every combination of acoustic frame position and label history. This is similar to the Recurrent Neural Network Transducer (RNN-T) model, which uses RNNs for information encoding instead of Transformer encoders. The model is trained with the RNN-T loss well-suited to streaming decoding. We present results on the LibriSpeech dataset showing that limiting the left context for self-attention in the Transformer layers makes decoding computationally tractable for streaming…

Video suggestion and discovery for youtube

Shumeet Baluja, Rohan Seth, D. Sivakumar +5 more

Computer Vision and Pattern Recognition · · cited 451× · DOI ↗ · more like this ·

The rapid growth of the number of videos in YouTube provides enormous potential for users to find content of interest to them. Unfortunately, given the difficulty of searching videos, the size of the video repository also makes the discovery of new content a daunting task. In this paper, we present a novel method based upon the analysis of the entire user-video graph to provide personalized video suggestions for users. The resulting algorithm, termed Adsorption, provides a simple method to efficiently propagate preference information through a variety of graphs. We extensively test the results of the recommendations on a three month snapshot of live data from YouTube.

Minimum Bayes-risk decoding for statistical machine translation

Shankar Kumar, Bill Byrne

Artificial Intelligence · Defense Technical Information Center (DTIC) · · cited 331× · OpenAlex ↗ · more like this ·

We present Minimum Bayes-Risk (MBR) de-coding for statistical machine translation. This statistical approach aims to minimize expected loss of translation errors under loss functions that measure translation performance. We de-scribe a hierarchy of loss functions that incor-porate different levels of linguistic information from word strings, word-to-word alignments from an MT system, and syntactic structure from parse-trees of source and target language sentences. We report the performance of the MBR decoders on a Chinese-to-English trans-lation task. Our results show that MBR decod-ing can be used to tune statistical MT perfor-mance for specific loss functions. 1

A Smorgasbord of Features for Statistical Machine Translation

Franz Josef Och, Daniel Gildea, Sanjeev Khudanpur +9 more

Artificial Intelligence · North American Chapter of the Association for Computational Linguistics · · cited 261× · DOI ↗ · more like this ·

We conducted a case-control study to investigate whether vascular endothelial growth factor (VEGF -2578, -1154, -634, and 936) and kinase insert domain containing receptor (KDR -604, 1192, and 1719) polymorphisms are associated with moyamoya disease. Korean patients with moyamoya disease (n = 107, mean age, 20.9±15.9 years; 66.4% female) and 243 healthy control subjects (mean age, 23.0±16.1 years; 56.8% female) were included. The subjects were divided into pediatric and adult groups. Among the 64 surgical patients, we evaluated collateral vessel formation after 2 years and divided patients into good (collateral grade A) or poor (collateral grade B and C) groups. The frequencies and distributions of four VEGF (-2578, -1154, -634, and 936) and KDR (-604, 1192, and 1719) polymorphisms were assessed from patients with moyamoya disease and compared to the control group. No differences were…

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling

Jonathan Shen, Patrick Nguyen, Yonghui Wu +88 more

cs.LG · · cited 215× · arXiv ↗ · more like this ·

Lingvo is a Tensorflow framework offering a complete solution for collaborative deep learning research, with a particular focus towards sequence-to-sequence models. Lingvo models are composed of modular building blocks that are flexible and easily extensible, and experiment configurations are centralized and highly customizable. Distributed training and quantized inference are supported directly within the framework, and it contains existing implementations of a large number of utilities, helper functions, and the newest research ideas. Lingvo has been used in collaboration by dozens of researchers in more than 20 papers over the last two years. This document outlines the underlying design of Lingvo and serves as an introduction to the various pieces of the framework, while also offering examples of advanced features that showcase the capabilities of the framework.

Corpora Generation for Grammatical Error Correction

Jared Lichtarge, Chris Alberti, Shankar Kumar +3 more

cs.CL · · cited 147× · arXiv ↗ · more like this ·

Grammatical Error Correction (GEC) has been recently modeled using the sequence-to-sequence framework. However, unlike sequence transduction problems such as machine translation, GEC suffers from the lack of plentiful parallel data. We describe two approaches for generating large parallel datasets for GEC using publicly available Wikipedia data. The first method extracts source-target pairs from Wikipedia edit histories with minimal filtration heuristics, while the second method introduces noise into Wikipedia sentences via round-trip translation through bridge languages. Both strategies yield similar sized parallel corpora containing around 4B tokens. We employ an iterative decoding strategy that is tailored to the loosely supervised nature of our constructed corpora. We demonstrate that neural GEC models trained using either type of corpora give similar performance. Fine-tuning these…

Lattice Minimum Bayes-Risk decoding for statistical machine translation

Roy W. Tromble, Shankar Kumar, Franz Josef Och +1 more

Artificial Intelligence · · cited 127× · DOI ↗ · more like this ·

We present Minimum Bayes-Risk (MBR) decoding over translation lattices that compactly encode a huge number of translation hypotheses. We describe conditions on the loss function that will enable efficient implementation of MBR decoders on lattices. We introduce an approximation to the BLEU score (Papineni et al., 2001) that satisfies these conditions. The MBR decoding under this approximate BLEU is realized using Weighted Finite State Automata. Our experiments show that the Lattice MBR decoder yields moderate, consistent gains in translation performance over N-best MBR decoding on Arabic-to-English, Chinese-to-English and English-to-Chinese translation tasks. We conduct a range of experiments to understand why Lattice MBR improves upon N-best MBR and study the impact of various parameters on MBR performance.

Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Models

Felix Stahlberg, Shankar Kumar

cs.CL · · cited 116× · arXiv ↗ · more like this ·

Synthetic data generation is widely known to boost the accuracy of neural grammatical error correction (GEC) systems, but existing methods often lack diversity or are too simplistic to generate the broad range of grammatical errors made by human writers. In this work, we use error type tags from automatic annotation tools such as ERRANT to guide synthetic data generation. We compare several models that can produce an ungrammatical sentence given a clean sentence and an error type tag. We use these models to build a new, large synthetic pre-training data set with error tag frequency distributions matching a given development set. Our synthetic data set yields large and consistent gains, improving the state-of-the-art on the BEA-19 and CoNLL-14 test sets. We also show that our approach is particularly effective in adapting a GEC system, trained on mixed native and non-native English, to a…

Local phrase reordering models for statistical machine translation

Shankar Kumar, William Byrne

Artificial Intelligence · Cambridge University Engineering Department Publications Database · · cited 102× · DOI ↗ · more like this ·

We describe stochastic models of local phrase movement that can be incorporated into a Statistical Machine Translation (SMT) system. These models provide properly formulated, non-deficient, probability distributions over reordered phrase sequences. They are implemented by Weighted Finite State Transducers. We describe EM-style parameter re-estimation procedures based on phrase alignment under the complete translation model incorporating reordering. Our experiments show that the reordering model yields substantial improvements in translation performance on Arabic-to-English and Chinese-to-English MT tasks. We also show that the procedure scales as the bitext size is increased.

Multilingual Open Relation Extraction Using Cross-lingual Projection

Manaal Faruqui, Shankar Kumar

cs.CL · · cited 88× · arXiv ↗ · more like this ·

Open domain relation extraction systems identify relation and argument phrases in a sentence without relying on any underlying schema. However, current state-of-the-art relation extraction systems are available only for English because of their heavy reliance on linguistic tools such as part-of-speech taggers and dependency parsers. We present a cross-lingual annotation projection method for language independent relation extraction. We evaluate our method on a manually annotated test set and present results on three typologically different languages. We release these manual annotations and extracted relations in 61 languages from Wikipedia.

A weighted finite state transducer implementation of the alignment template model for statistical machine translation

Shankar Kumar, William Byrne

Artificial Intelligence · Cambridge University Engineering Department Publications Database · · cited 82× · DOI ↗ · more like this ·

We present a derivation of the alignment template model for statistical machine translation and an implementation of the model using weighted finite state transducers. The approach we describe allows us to implement each constituent distribution of the model as a weighted finite state transducer or acceptor. We show that bitext word alignment and translation under the model can be performed with standard FSM operations involving these transducers. One of the benefits of using this framework is that it obviates the need to develop specialized search procedures, even for the generation of lattices or N-Best lists of bitext word alignments and translation hypotheses. We evaluate the implementation of the model on the French-to-English Hansards task and report alignment and translation performance.

Efficient Minimum Error Rate Training and Minimum Bayes-Risk decoding for translation hypergraphs and lattices

Shankar Kumar, Wolfgang Macherey, Chris Dyer +1 more

Artificial Intelligence · · cited 81× · DOI ↗ · more like this ·

Minimum Error Rate Training (MERT) and Minimum Bayes-Risk (MBR) decoding are used in most current state-of-the-art Statistical Machine Translation (SMT) systems. The algorithms were originally developed to work with N-best lists of translations, and recently extended to lattices that encode many more hypotheses than typical N-best lists. We here extend lattice-based MERT and MBR algorithms to work with hypergraphs that encode a vast number of translations produced by MT systems based on Synchronous Context Free Grammars. These algorithms are more efficient than the lattice-based versions presented earlier. We show how MERT can be employed to optimize parameters for MBR decoding. Our experiments show speedups from MERT and MBR as well as performance improvements from MBR decoding on several language pairs.

A weighted finite state transducer translation template model for statistical machine translation

Shankar Kumar, Yonggang Deng, WILLIAM BYRNE

Artificial Intelligence · Natural Language Engineering · · cited 71× · DOI ↗ · more like this ·

We present a Weighted Finite State Transducer Translation Template Model for statistical machine translation. This is a source-channel model of translation inspired by the Alignment Template translation model. The model attempts to overcome the deficiencies of word-to-word translation models by considering phrases rather than words as units of translation. The approach we describe allows us to implement each constituent distribution of the model as a weighted finite state transducer or acceptor. We show that bitext word alignment and translation under the model can be performed with standard finite state machine operations involving these transducers. One of the benefits of using this framework is that it avoids the need to develop specialized search procedures, even for the generation of lattices or N-Best lists of bitext word alignments and translation hypotheses. We report and…

Large Scale Language Modeling in Automatic Speech Recognition

Ciprian Chelba, Dan Bikel, Maria Shugrina +2 more

cs.CL · · cited 67× · arXiv ↗ · more like this ·

Large language models have been proven quite beneficial for a variety of automatic speech recognition tasks in Google. We summarize results on Voice Search and a few YouTube speech transcription tasks to highlight the impact that one can expect from increasing both the amount of training data, and the size of the language model estimated from such data. Depending on the task, availability and amount of training data used, language model size and amount of work and care put into integrating them in the lattice rescoring step we observe reductions in word error rate between 6% and 10% relative, for systems on a wide range of operating points between 17% and 52% word error rate.

Improving Word Alignment with Bridge Languages

Shankar Kumar, Franz Josef Och, Wolfgang Macherey

Artificial Intelligence · Empirical Methods in Natural Language Processing · · cited 53× · OpenAlex ↗ · more like this ·

We describe an approach to improve Statistical Machine Translation (SMT) performance using multi-lingual, parallel, sentence-aligned corpora in several bridge languages. Our approach consists of a sim-ple method for utilizing a bridge language to create a word alignment system and a proce-dure for combining word alignment systems from multiple bridge languages. The final translation is obtained by consensus de-coding that combines hypotheses obtained using all bridge language word alignments. We present experiments showing that mul-tilingual, parallel text in Spanish, French, Russian, and Chinese can be utilized in this framework to improve translation performance on an Arabic-to-English task. 1

Minimum Bayes-Risk word alignments of bilingual texts

Shankar Kumar, William Byrne

Artificial Intelligence · Cambridge University Engineering Department Publications Database · · cited 49× · DOI ↗ · more like this ·

We present Minimum Bayes-Risk word alignment for machine translation. This statistical, model-based approach attempts to minimize the expected risk of alignment errors under loss functions that measure alignment quality. We describe various loss functions, including some that incorporate linguistic analysis as can be obtained from parse trees, and show that these approaches can improve alignments of the English-French Hansards.

Segmentation and alignment of parallel text for statistical machine translation

Yonggang Deng, Shankar Kumar, WILLIAM BYRNE

Artificial Intelligence · Natural Language Engineering · · cited 44× · DOI ↗ · more like this ·

We address the problem of extracting bilingual chunk pairs from parallel text to create training sets for statistical machine translation. We formulate the problem in terms of a stochastic generative process over text translation pairs, and derive two different alignment procedures based on the underlying alignment model. The first procedure is a now-standard dynamic programming alignment model which we use to generate an initial coarse alignment of the parallel text. The second procedure is a divisive clustering parallel text alignment procedure which we use to refine the first-pass alignments. This latter procedure is novel in that it permits the segmentation of the parallel text into sub-sentence units which are allowed to be reordered to improve the chunk alignment. The quality of chunk pairs are measured by the performance of machine translation systems trained from them. We show…

A Novel Malware Analysis Framework for Malware Detection and Classification using Machine Learning Approach

Kamalakanta Sethi, Shankar Kumar Chaudhary, Bata Krishan Tripathy +1 more

Signal Processing · · cited 41× · DOI ↗ · more like this ·

Nowadays, the digitization of the world is under a serious threat due to the emergence of various new and complex malware every day. Due to this, the traditional signature-based methods for detection of malware effectively become an obsolete method. The efficiency of the machine learning techniques in context to the detection of malwares has been proved by state-of-the-art research works. In this paper, we have proposed a framework to detect and classify different files (e.g., exe, pdf, php, etc.) as benign and malicious using two level classifier namely, Macro (for detection of malware) and Micro (for classification of malware files as a Trojan, Spyware, Ad-ware, etc.). Our solution uses Cuckoo Sandbox for generating static and dynamic analysis report by executing the sample files in the virtual environment. In addition, a novel feature extraction module has been developed which…

Lattice Rescoring Strategies for Long Short Term Memory Language Models in Speech Recognition

Shankar Kumar, Michael Nirschl, Daniel Holtmann-Rice +3 more

stat.ML · · cited 41× · arXiv ↗ · more like this ·

Recurrent neural network (RNN) language models (LMs) and Long Short Term Memory (LSTM) LMs, a variant of RNN LMs, have been shown to outperform traditional N-gram LMs on speech recognition tasks. However, these models are computationally more expensive than N-gram LMs for decoding, and thus, challenging to integrate into speech recognizers. Recent research has proposed the use of lattice-rescoring algorithms using RNNLMs and LSTMLMs as an efficient strategy to integrate these models into a speech recognition system. In this paper, we evaluate existing lattice rescoring algorithms along with new variants on a YouTube speech recognition task. Lattice rescoring using LSTMLMs reduces the word error rate (WER) for this task by 8\% relative to the WER obtained using an N-gram LM.

Scaling Language Model Size in Cross-Device Federated Learning

Jae Hun Ro, Theresa Breiner, Lara McConnaughey +4 more

cs.CL · · cited 39× · arXiv ↗ · more like this ·

Most studies in cross-device federated learning focus on small models, due to the server-client communication and on-device computation bottlenecks. In this work, we leverage various techniques for mitigating these bottlenecks to train larger language models in cross-device federated learning. With systematic applications of partial model training, quantization, efficient transfer learning, and communication-efficient optimizers, we are able to train a $21$M parameter Transformer and $20.2$M parameter Conformer that achieve the same or better perplexity as that of a similarly sized LSTM with $\sim10\times$ smaller client-to-server communication cost and $11\%$ lower perplexity than smaller LSTMs commonly studied in literature.

Model Combination for Machine Translation

John DeNero, Shankar Kumar, Ciprian Chelba +1 more

Artificial Intelligence · North American Chapter of the Association for Computational Linguistics · · cited 34× · OpenAlex ↗ · more like this ·

Machine translation benefits from two types of decoding techniques: consensus decoding over multiple hypotheses under a single model and system combination over hypotheses from different models. We present model combination, a method that integrates consensus decoding and system combination into a unified, forest-based technique. Our approach makes few assumptions about the underlying component models, enabling us to combine systems with heterogenous structure. Unlike most system combination techniques, we reuse the search space of component models, which entirely avoids the need to align translation hypotheses. Despite its relative simplicity, model combination improves translation quality over a pipelined approach of first applying consensus decoding to individual systems, and then applying system combination to their output. We demonstrate BLEU improvements across data sets and…

Text Generation with Text-Editing Models

Eric Malmi, Yue Dong, Jonathan Mallinson +7 more

cs.CL · · cited 29× · arXiv ↗ · more like this ·

Text-editing models have recently become a prominent alternative to seq2seq models for monolingual text-generation tasks such as grammatical error correction, simplification, and style transfer. These tasks share a common trait - they exhibit a large amount of textual overlap between the source and target texts. Text-editing models take advantage of this observation and learn to generate the output by predicting edit operations applied to the source sequence. In contrast, seq2seq models generate outputs word-by-word from scratch thus making them slow at inference time. Text-editing models provide several benefits over seq2seq models including faster inference speed, higher sample efficiency, and better control and interpretability of the outputs. This tutorial provides a comprehensive overview of text-editing models and current state-of-the-art approaches, and analyzes their pros and…

Neural Language Modeling with Visual Features

Antonios Anastasopoulos, Shankar Kumar, Hank Liao

cs.CL · · cited 28× · arXiv ↗ · more like this ·

Multimodal language models attempt to incorporate non-linguistic features for the language modeling task. In this work, we extend a standard recurrent neural network (RNN) language model with features derived from videos. We train our models on data that is two orders-of-magnitude bigger than datasets used in prior work. We perform a thorough exploration of model architectures for combining visual and text features. Our experiments on two corpora (YouCookII and 20bn-something-something-v2) show that the best performing architecture consists of middle fusion of visual and text features, yielding over 25% relative improvement in perplexity. We report analysis that provides insights into why our multimodal language model improves upon a standard RNN language model.

Segmental minimum Bayes-risk ASR voting strategies

Vaibhava Goel, Shankar Kumar, William Byrne

Signal Processing · Cambridge University Engineering Department Publications Database · · cited 27× · DOI ↗ · more like this ·

ROVER [1] and its successor voting procedures have been shown to be quite effective in reducing the recognition word error rate (WER). The success of these methods has been attributed to their minimum Bayes-risk (MBR) nature: they produce the hypothesis with the least expected word error. In this paper we develop a general procedure within the MBR framework, called segmental MBR recognition, that encompasses current voting techniques and allows further extensions that yield lower expected WER. It also allows incorporation of loss functions other than the WER. We present a derivation of voting procedure of N-best ROVER as an instance of segmental MBR recognition. We then present an extension, called e-ROVER, that alleviates some of the restrictions of N-best ROVER by better approximating the WER. e-ROVER is compared with N-best ROVER on multi-lingual acoustic modeling task and is shown…

A novel malware analysis for malware detection and classification using machine learning algorithms

Kamalakanta Sethi, Shankar Kumar Chaudhary, Bata Krishan Tripathy +1 more

Signal Processing · · cited 26× · DOI ↗ · more like this ·

Nowadays, Malware has become a serious threat to the digitization of the world due to the emergence of various new and complex malware every day. Due to this, the traditional signature-based methods for detection of malware effectively becomes an obsolete method. The efficiency of the machine learning model in context to the detection of malware files has been proved by different researches and studies. In this paper, a framework has been developed to detect and classify different files (e.g exe, pdf, php, etc.) as benign and malicious using two level classifier namely, Macro (for detection of malware) and Micro (for classification of malware files as a Trojan, Spyware, Adware, etc.). Cuckoo Sandbox is used for generating static and dynamic analysis report by executing files in the virtual environment. In addition, a novel model is developed for extracting features based on static…