arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Dmitriy Genzel

21 papers · 2001–2026

2001: 12002: 12003: 22004: 12005: 12006: 12007: 02008: 02009: 12010: 22011: 12012: 02013: 12014: 02015: 22016: 02017: 02018: 02019: 02020: 22021: 32022: 02023: 02024: 02025: 12026: 1
2001peak 3 in 20212026

Frequent co-authors

Papers

showing 1–21 of 21 RSS

TorchAudio: Building Blocks for Audio and Speech Processing

Yao-Yuan Yang, Moto Hira, Zhaoheng Ni +20 more

eess.AS · · cited 225× · arXiv ↗ · more like this ·

This document describes version 0.10 of TorchAudio: building blocks for machine learning applications in the audio and speech processing domain. The objective of TorchAudio is to accelerate the development and deployment of machine learning applications for researchers and engineers by providing off-the-shelf building blocks. The building blocks are designed to be GPU-compatible, automatically differentiable, and production-ready. TorchAudio can be easily installed from Python Package Index repository and the source code is publicly available under a BSD-2-Clause License (as of September 2021) at https://github.com/pytorch/audio. In this document, we provide an overview of the design principles, functionalities, and benchmarks of TorchAudio. We also benchmark our implementation of several audio and speech operations and models. We verify through the benchmarks that our implementations…

Entropy rate constancy in text

Dmitriy Genzel, Eugene Charniak

Artificial Intelligence · · cited 175× · DOI ↗ · more like this ·

We present a constancy rate principle governing language generation. We show that this principle implies that local measures of entropy (ignoring context) should increase with the sentence number. We demonstrate that this is indeed the case by measuring entropy in three different ways. We also show that this effect has both lexical (which words are used) and non-lexical (how the words are used) causes.

TICO-19: the Translation Initiative for Covid-19

Antonios Anastasopoulos, Alessandro Cattelan, Zi-Yi Dou +15 more

cs.CL · · cited 120× · arXiv ↗ · more like this ·

The COVID-19 pandemic is the worst pandemic to strike the world in over a century. Crucial to stemming the tide of the SARS-CoV-2 virus is communicating to vulnerable populations the means by which they can protect themselves. To this end, the collaborators forming the Translation Initiative for COvid-19 (TICO-19) have made test and development data available to AI and MT researchers in 35 different languages in order to foster the development of tools and resources for improving access to information about COVID-19 in these languages. In addition to 9 high-resourced, "pivot" languages, the team is targeting 26 lesser resourced languages, in particular languages of Africa, South Asia and South-East Asia, whose populations may be the most vulnerable to the spread of the virus. The same data is translated into all of the languages represented, meaning that testing or development can be…

Automatically Learning Source-side Reordering Rules for Large Scale Machine Translation

Dmitriy Genzel

Artificial Intelligence · International Conference on Computational Linguistics · · cited 103× · OpenAlex ↗ · more like this ·

We describe an approach to automatically learn reordering rules to be applied as a preprocessing step in phrase-based machine translation. We learn rules for 8 different language pairs, showing BLEU improvements for all of them, and demonstrate that many important order transformations (SVO to SOV or VSO, headmodifier, verb movement) can be captured by this approach. 1

Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task

Yun Tang, Juan Pino, Xian Li +2 more

cs.CL · · cited 97× · arXiv ↗ · more like this ·

Pretraining and multitask learning are widely used to improve the speech to text translation performance. In this study, we are interested in training a speech to text translation model along with an auxiliary text to text translation task. We conduct a detailed analysis to understand the impact of the auxiliary task on the primary task within the multitask learning framework. Our analysis confirms that multitask learning tends to generate similar decoder representations from different modalities and preserve more information from the pretrained text translation modules. We observe minimal negative transfer effect between the two tasks and sharing more parameters is helpful to transfer knowledge from the text task to the speech task. The analysis also reveals that the modality representation difference at the top decoder layers is still not negligible, and those layers are critical for…

A General Multi-Task Learning Framework to Leverage Text Data for Speech to Text Tasks

Yun Tang, Juan Pino, Changhan Wang +2 more

cs.CL · · cited 82× · arXiv ↗ · more like this ·

Attention-based sequence-to-sequence modeling provides a powerful and elegant solution for applications that need to map one sequence to a different sequence. Its success heavily relies on the availability of large amounts of training data. This presents a challenge for speech applications where labelled speech data is very expensive to obtain, such as automatic speech recognition (ASR) and speech translation (ST). In this study, we propose a general multi-task learning framework to leverage text data for ASR and ST tasks. Two auxiliary tasks, a denoising autoencoder task and machine translation task, are proposed to be co-trained with ASR and ST tasks respectively. We demonstrate that representing text input as phoneme sequences can reduce the difference between speech and text inputs, and enhance the knowledge transfer from text corpora to the speech to text tasks. Our experiments…

Variation of entropy and parse trees of sentences as a function of the sentence number

Dmitriy Genzel, Eugene Charniak

Artificial Intelligence · · cited 60× · DOI ↗ · more like this ·

In this paper we explore the variation of sentences as a function of the sentence number. We demonstrate that while the entropy of the sentence increases with the sentence number, it decreases at the paragraph boundaries in accordance with the Entropy Rate Constancy principle (introduced in related work). We also demonstrate that the principle holds for different genres and languages and explore the role of genre informativeness. We investigate potential causes of entropy variation by looking at the tree depth, the branching factor, the size of constituents, and the occurrence of gapping.

"Poetic" Statistical Machine Translation: Rhyme and Meter

Dmitriy Genzel, Jakob Uszkoreit, Franz Josef Och

Artificial Intelligence · Empirical Methods in Natural Language Processing · · cited 59× · OpenAlex ↗ · more like this ·

As a prerequisite to translation of poetry, we implement the ability to produce translations with meter and rhyme for phrase-based MT, examine whether the hypothesis space of such a system is flexible enough to accomodate such constraints, and investigate the impact of such constraints on translation quality. 1

Publication Date Estimation for Printed Historical Documents using Convolutional Neural Networks

Yuanpeng Li, Dmitriy Genzel, Yasuhisa Fujii +1 more

Computer Vision and Pattern Recognition · · cited 26× · DOI ↗ · more like this ·

This paper describes an approach to estimating the unknown publication date for printed historical documents from their scanned page images, using Convolutional Neural Networks (CNN). The method primarily harnesses visual features from small image patches. Optionally, we augment the feature set with textual Optical Character Recognition (OCR) result features to improve accuracy, though at greater preprocessing cost. To be applied in various tasks, we develop both classification and regression models. As an example application, we show that OCR can be improved if we use estimated publication date to select the appropriate OCR model. Moreover, the resulting improvement in OCR accuracy is close to what could be achieved knowing the true publication date. We are not aware of previous work in estimating publication dates for printed historical documents with visual features.

Adaptive Sparse Transformer for Multilingual Translation

Hongyu Gong, Xian Li, Dmitriy Genzel

cs.CL · · cited 15× · arXiv ↗ · more like this ·

Multilingual machine translation has attracted much attention recently due to its support of knowledge transfer among languages and the low cost of training and deployment compared with numerous bilingual models. A known challenge of multilingual models is the negative language interference. In order to enhance the translation quality, deeper and wider architectures are applied to multilingual modeling for larger model capacity, which suffers from the increased inference cost at the same time. It has been pointed out in recent studies that parameters shared among languages are the cause of interference while they may also enable positive transfer. Based on these insights, we propose an adaptive and sparse architecture for multilingual modeling, and train the model to learn shared and language-specific parameters to improve the positive transfer and mitigate the interference. The sparse…

HMM-based script identification for OCR

Dmitriy Genzel, Ashok C. Popat, Remco Teunen +1 more

Computer Vision and Pattern Recognition · · cited 9× · DOI ↗ · more like this ·

While current OCR systems are able to recognize text in an increasing number of scripts and languages, typically they still need to be told in advance what those scripts and languages are. We propose an approach that repurposes the same HMM-based system used for OCR to the task of script/language ID, by replacing character labels with script class labels. We apply it in a multi-pass overall OCR process which achieves "universal" OCR over 54 tested languages in 18 distinct scripts, over a wide variety of typefaces in each. For comparison we also consider a brute-force approach, wherein a singe HMM-based OCR system is trained to recognize all considered scripts. Results are presented on a large and diverse evaluation set extracted from book images, both for script identification accuracy and for overall OCR accuracy. On this evaluation data, the script ID system provided a script ID error…

Inducing a multilingual dictionary from a parallel multitext in related languages

Dmitriy Genzel

Artificial Intelligence · · cited 9× · DOI ↗ · more like this ·

Dictionaries and word translation models are used by a variety of systems, especially in machine translation. We build a multilingual dictionary induction system for a family of related resource-poor languages. We assume only the presence of a single medium-length multitext (the Bible). The techniques rely upon lexical and syntactic similarity of languages as well as on the fact that building dictionaries for several pairs of languages provides information about other pairs.

Label transition and selection pruning and automatic decoding parameter optimization for time-synchronous Viterbi decoding

Yasuhisa Fujii, Dmitriy Genzel, Ashok C. Popat +1 more

Artificial Intelligence · · cited 7× · DOI ↗ · more like this ·

Hidden Markov Model (HMM)-based classifiers have been successfully used for sequential labeling problems such as speech recognition and optical character recognition for decades. They have been especially successful in the domains where the segmentation is not known or difficult to obtain, since, in principle, all possible segmentation points can be taken into account. However, the benefit comes with a non-negligible computational cost. In this paper, we propose simple yet effective new pruning algorithms to speed up decoding with HMM-based classifiers of up to 95% relative over a baseline. As the number of tunable decoding parameters increases, it becomes more difficult to optimize the parameters for each configuration. We also propose a novel technique to estimate the parameters based on a loss value without relying on a grid search.

Translation-Inspired OCR

Dmitriy Genzel, Ashok C. Popat, Nemanja Spasojevic +4 more

Computer Vision and Pattern Recognition · · cited 4× · DOI ↗ · more like this ·

Optical character recognition is carried out using techniques borrowed from statistical machine translation. In particular, the use of multiple simple feature functions in linear combination, along with minimum-error-rate training, integrated decoding, and N-gram language modeling is found to be remarkably effective, across several scripts and languages. Results are presented using both synthetic and real data in five languages.

Creating algorithms for parsers and taggers for resource-poor languages using a related resource-rich language

Eugene Charniak, Dmitriy Genzel

Artificial Intelligence · · cited 3× · OpenAlex ↗ · more like this ·

Modern statistical natural language processing techniques require large amounts of human-annotated data to work well. For practical reasons, the required amount of data exists only for a few languages of major interest. In my work I show how a resource-rich language can be leveraged to produce the necessary resources and tools for related resource-poor languages. The work consists of two parts. The first part focuses on building a word-to-word translation model from parallel corpora. This involved a variety of methods, some well-known and some new. The new methods focus on exploiting lexical and syntactic similarities of the languages. The second part utilized the word-to-word model created in the first part, to first assign parts of speech and then parse the text in several related resource-poor languages.

The Amazon Nova Family of Models: Technical Report and Model Card

Amazon AGI, Aaron Langford, Aayush Shah +783 more

cs.AI · · cited 2× · arXiv ↗ · more like this ·

We present Amazon Nova, a new generation of state-of-the-art foundation models that deliver frontier intelligence and industry-leading price performance. Amazon Nova Pro is a highly-capable multimodal model with the best combination of accuracy, speed, and cost for a wide range of tasks. Amazon Nova Lite is a low-cost multimodal model that is lightning fast for processing images, video, documents and text. Amazon Nova Micro is a text-only model that delivers our lowest-latency responses at very low cost. Amazon Nova Canvas is an image generation model that creates professional grade images with rich customization controls. Amazon Nova Reel is a video generation model offering high-quality outputs, customization, and motion control. Our models were built responsibly and with a commitment to customer trust, security, and reliability. We report benchmarking results for core capabilities…

OSynth: A Longitudinal, Context-Sensitive Evaluation of Meeting Understanding

Ian Porada, Suraj Tripathi, Chaitanya Animesh +8 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Meeting notetakers are increasingly deployed in settings where longitudinal context is available including calendar metadata, prior meetings, emails, slides, and speaker enrollments; however, meeting corpora remain limited in terms of size, domain coverage, and available context. We present OSynth, a large-scale synthetic dataset of simulated organizations comprising 570 hours of meeting audio together with associated artifacts and a latent ground-truth state. In a pairwise comparison, human raters distinguish OSynth meetings from real meeting transcripts with only 56% accuracy based on excerpts of 150-300 words. Across state-of-the-art LLMs, additional context yields significant gains on several entity-sensitive dimensions, demonstrating limitations of contemporary approaches and the potential usefulness of OSynth in developing better-contextualized meeting-understanding systems.

Variation of Entropy and Parse Trees of Sentences as a Function of the

Sentence Number Dmitriy, Dmitriy Genzel, Eugene Charniak

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

In this paper we explore the variation of sentences as a function of the sentence number. We demonstrate that while the entropy of the sentence increases with the sentence number, it decreases at the paragraph boundaries in accordance with the Entropy Rate Constancy principle (introduced in related work). We also demonstrate that the principle holds for different genres and languages and explore the role of genre informativeness. We investigate potential causes of entropy variation by looking at the tree depth, the branching factor, the size of constituents, and the occurrence of gapping.

Entropy Rate Constancy in Text

Dmitriy Genzel And, Dmitriy Genzel, Eugene Charniak

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

We present a constancy rate principle governing language generation. We show that this principle implies that local measures of entropy (ignoring context) should increase with the sentence number. We demonstrate that this is indeed the case by measuring entropy in three di#erent ways. We also show that this e#ect has both lexical (which words are used) and non-lexical (how the words are used) causes.