arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Christopher Cieri

60 papers · 1998–2025

1998: 11999: 02000: 42001: 12002: 42003: 22004: 62005: 22006: 82007: 22008: 52009: 12010: 42011: 02012: 12013: 22014: 52015: 42016: 02017: 02018: 02019: 12020: 32021: 22022: 02023: 02024: 02025: 2
1998peak 8 in 20062025

Frequent co-authors

Papers

showing 1–25 of 60 RSS

Towards an integrated understanding of speaking rate in conversation

Jiahong Yuan, Mark Liberman, Christopher Cieri

Artificial Intelligence · · cited 217× · DOI ↗ · more like this ·

We investigate factors that affect speaking rate in conversation, using large corpora of conversational telephone speech in English and Chinese. We find that speaking rate as a function of "turn" length rises rapidly for turns from one to seven words; remains level (when final words are included) or falls gradually (if final words are excluded) for turns of medium length; and rises slowly for longer turns. When talking with strangers or discussing certain topics, people tend to use longer turns but slower speech rates. In general older people have a slower speech, and males tend to speak slightly faster than females. Finally, we find that the effect of L1 (native language) on L2 (second language) speaking rate is L1 dependent.

The Second DIHARD Diarization Challenge: Dataset, task, and baselines

Neville Ryant, Kenneth Church, Christopher Cieri +4 more

eess.AS · · cited 208× · arXiv ↗ · more like this ·

This paper introduces the second DIHARD challenge, the second in a series of speaker diarization challenges intended to improve the robustness of diarization systems to variation in recording equipment, noise conditions, and conversational domain. The challenge comprises four tracks evaluating diarization performance under two input conditions (single channel vs. multi-channel) and two segmentation conditions (diarization from a reference speech segmentation vs. diarization from scratch). In order to prevent participants from overtuning to a particular combination of recording conditions and conversational domain, recordings are drawn from a variety of sources ranging from read audiobooks to meeting speech, to child language acquisition recordings, to dinner parties, to web video. We describe the task and metrics, challenge design, datasets, and baseline systems for speech enhancement…

The Third DIHARD Diarization Challenge

Neville Ryant, Prachi Singh, Venkat Krishnamohan +6 more

eess.AS · · cited 168× · arXiv ↗ · more like this ·

DIHARD III was the third in a series of speaker diarization challenges intended to improve the robustness of diarization systems to variability in recording equipment, noise conditions, and conversational domain. Speaker diarization was evaluated under two speech activity conditions (diarization from a reference speech activity vs. diarization from scratch) and 11 diverse domains. The domains span a range of recording conditions and interaction types, including read audio-books, meeting speech, clinical interviews, web videos, and, for the first time, conversational telephone speech. A total of 30 organizations (forming 21teams) from industry and academia submitted 499 valid system outputs. The evaluation results indicate that speaker diarization has improved markedly since DIHARD I, particularly for two-party interactions, but that for many domains (e.g., web video) the problem remains…

Third DIHARD Challenge Evaluation Plan

Neville Ryant, Kenneth Church, Christopher Cieri +3 more

eess.AS · · cited 57× · arXiv ↗ · more like this ·

This paper introduces the third DIHARD challenge, the third in a series of speaker diarization challenges intended to improve the robustness of diarization systems to variation in recording equipment, noise conditions, and conversational domain. The challenge comprises two tracks evaluating diarization performance when starting from a reference speech segmentation (track 1) and diarization from raw audio scratch (track 2). We describe the task, metrics, datasets, and evaluation protocol.

The Language Application Grid

Nancy Ide, James Pustejovsky, Christopher Cieri +5 more

Computer Networks and Communications · Lecture notes in computer science · · cited 52× · DOI ↗ · more like this ·

The Language Application (LAPPS) Grid project is establishing a framework that enables language service discovery, composition, and reuse and promotes sustainability, manageability, usability, and interoperability of natural language Processing (NLP) components. It is based on the service-oriented architecture (SOA), a more recent, web-oriented version of the “pipeline” architecture that has long been used in NLP for sequencing loosely-coupled linguistic analyses. The LAPPS Grid provides access to basic NLP processing tools and resources and enables pipelining such tools to create custom NLP applications, as well as composite services such as question answering and machine translation together with language resources such as mono- and multi-lingual corpora and lexicons that support NLP. The transformative aspect of the LAPPS Grid is that it orchestrates access to and deployment of…

Resources for new research directions in speaker recognition: the mixer 3, 4 and 5 corpora

Christopher Cieri, Linda Corson, David Graff +1 more

Artificial Intelligence · · cited 43× · DOI ↗ · more like this ·

This paper describes new language resources designed to support research in speaker recognition. It begins with a brief overview of collections protocols, motivates the shift from the Switchboard protocol to the Mixer protocol, summarizes yields from the earliest phase of Mixer collection and then describes more recent phases, yields and expected yields and lessons learned. Index Terms: linguistic resources, speaker recognition, multilingual, cross-channel, intrinsic variation

The MMSR Bilingual and Crosschannel Corpora for Speaker Recognition Research and Evaluation

Joseph P. Campbell, Hirotaka Nakasone, Christopher Cieri +4 more

Artificial Intelligence · · cited 27× · OpenAlex ↗ · more like this ·

We describe efforts to create corpora to support and evaluate systems that meet the challenge of speaker recognition in the face of both channel and language variation. In addition to addressing ongoing evaluation of speaker recognition systems, these corpora are aimed at the bilingual and crosschannel dimensions. We report on specific data collection efforts at the Linguistic Data Consortium, the 2004 speaker recognition evaluation program organized by the

The Mixer and Transcript Reading Corpora: Resources for Multilingual, Crosschannel Speaker Recognition Research

Christopher Cieri, W.D. Andrews, Joseph P. Campbell +8 more

Artificial Intelligence · · cited 23× · DOI ↗ · more like this ·

This paper describes the planning and creation of the Mixer and Transcript Reading corpora, their properties and yields, and reports on the lessons learned during their development. Recent speaker identification (SuperSID 2002) research has made significant progress in meeting classic challenges, has created interest in new problems and has

Corpus Support for Machine Translation at LDC

Xiaoyi Ma, Christopher Cieri

Artificial Intelligence · Language Resources and Evaluation · · cited 22× · DOI ↗ · more like this ·

This paper describes LDC's efforts in collecting, creating and processing different types of linguistic data, including lexicons, parallel text, multiple translation corpora, and human assessment of translation quality, to support the research and development in Machine Translation. Through a combination of different procedures and core technologies, the LDC was able to create very large, high quality, and cost-efficient corpora, which have contributed significantly to recent advances in Machine Translation. Multiple translation corpora and human assessment together facilitate, validate and improve automatic evaluation metrics, which are vital to the development of MT systems. The Bilingual Internet Text Search (BITS) and Champollion sentence aligner enable the finding and processing of large quantities of parallel text. All specifications and tools used by LDC and described in…

Large, Multilingual, Broadcast News Corpora for Cooperative Research in Topic Detection and Tracking: The TDT-2 and TDT-3 Corpus Efforts

Christopher Cieri, David Graff, Mark Liberman +2 more

Communication · Language Resources and Evaluation · · cited 21× · DOI ↗ · more like this ·

This paper describes the creation and content two corpora, TDT-2 and TDT-3, created for the DARPA sponsored Topic Detection and Tracking project. The research goal in the TDT program is to create the core technology of a news understanding system that can process multilingual news content categorizing individual stories according to the topic(s) they describe. The research tasks include segmentation of the news streams into individual stories, detection of new topics, identification of the first story to discuss any topic, tracking of all stories on selected topics and detection of links among stories discussing the same topics. The corpora contain English and Chinese broadcast television and radio, newswires, and text from web sites devoted to news. For each source there are texts or text intermediaries; for the broadcast stories the audio is also available. Each broadcast is also…

Human Assisted Speaker Recognition In NIST SRE10

Craig S. Greenberg, Alvin F. Martín, Linda Brandschain +4 more

Artificial Intelligence · · cited 20× · OpenAlex ↗ · more like this ·

The NIST series of Speaker Recognition Evaluations (SRE’s) have, since 1996, evaluated automatic systems for speaker recognition. The 2010 evaluation (SRE10) also included a test of Human Assisted Speaker Recognition (HASR), in which systems based, in whole or in part, on human expertise were evaluated. Participants were invited to complete the trials in one of two small subsets of the full set of trials included in the core test of the main automatic system evaluation. The performance of these human dependent systems is currently being scored and analyzed. Their performance will be compared with the best automatic system results on the same trial subsets.

Quality Control in Large Annotation Projects Involving Multiple Judges: The Case of the TDT Corpora

Stephanie Strassel, David Graff, Nii Martey +1 more

Artificial Intelligence · Language Resources and Evaluation · · cited 17× · DOI ↗ · more like this ·

The Linguistic Data Consortium at the University of Pennsylvania has recently been engaged in the creation of large-scale annotated corpora of broadcast news materials in support of the ongoing Topic Detection and Tracking (TDT) research project. The TDT corpora were designed to support three basic research tasks: segmentation, topic detection, and topic tracking in newswire, television and radio sources from English and Mandarin Chinese. The most recent TDT corpus, TDT3, added two tasks, story link and first story detection. Annotation of the TDT corpora involved a large staff of annotators who produced millions of human judgements. As with any large corpus creation effort, quality assurance and inter-annotator consistency were a major concern. This paper reports the quality control measures adopted by the LDC during the creation of the TDT corpora, presents techniques that were…

Talkbank: Building an Open Unified Multimodal Database of Communicative Interaction

Brian MacWhinney, Steven Bird, Christopher Cieri +1 more

Artificial Intelligence · Language Resources and Evaluation · · cited 16× · DOI ↗ · more like this ·

The goal of the TalkBank project (http://talkbank.org) is to support data-sharing and direct, community-wide access to naturalistic recordings and transcripts of human and animal communication. Toward this end, we have constructed a web accessible database of transcripts linked to audio and video media within fields such as conversation analysis, classroom discourse, animal communication, gesture, meetings, second language acquisition, first language acquisition, bilingualism, tutoring, and legal oral argumentation. We discuss how we have taken discrepant databases from dozens of individual projects and merged them together into a well-structured uniform database in which transcripts can be opened online through browsers, allowing direct multimedia playback. To achieve translation across corpora, we have defined a general XML schema. The validity of this schema is checked by…

Research methodologies, observations and outcomes in (conversational) speech data collection

Christopher Cieri, David Miller, Kevin Walker

Artificial Intelligence · · cited 16× · DOI ↗ · more like this ·

This paper presents research methodologies for collecting speech data and gives observations from a recent set of conversational speech collections before describing their outcomes. The presentation begins with a comparison of the relative challenges offered by broadcast news, telephone conversation and meeting recordings. The remainder of the discussion focuses on methods for collection of conversational data with special focus on two recent Switchboard collections. We identify method that have allowed for very cost-efficient collection of Switchboard data. We conclude with a summary of generally available resources that result from the efforts described herein.

Integrated Linguistic Resources for Language Exploitation Technologies

Stephanie Strassel, Christopher Cieri, Andrew W. Cole +5 more

Artificial Intelligence · Language Resources and Evaluation · · cited 14× · DOI ↗ · more like this ·

Linguistic Data Consortium has recently embarked on an effort to create integrated linguistic resources and related infrastructure for language exploitation technologies within the DARPA GALE (Global Autonomous Language Exploitation) Program. GALE targets an end-to-end system consisting of three major engines: Transcription, Translation and Distillation. Multilingual speech or text from a variety of genres is taken as input and English text is given as output, with information of interest presented in an integrated and consolidated fashion to the end user. GALE's goals requires a quantum leap in the performance of human language technology, while also demanding solutions that are more intelligent, more robust, more adaptable, more efficient and more integrated. LDC has responded to this challenge with a comprehensive approach to linguistic resource development designed to…

Shared resources for robust speech-to-text technology

Stephanie Strassel, David Miller, Kevin Walker +1 more

Artificial Intelligence · · cited 13× · DOI ↗ · more like this ·

This paper describes ongoing efforts at Linguistic Data Consortium to create shared resources for improved speech-totext technology. Under the DARPA EARS program, technology providers are charged with creating STT systems whose outputs are substantially richer and much more accurate than is currently possible. These aggressive program goals motivate new approaches to corpus creation and distribution. EARS

The creation, distribution and use of linguistic data: the case of the linguistic data consortium.

Mark Liberman, Christopher Cieri

Artificial Intelligence · Language Resources and Evaluation · · cited 13× · DOI ↗ · more like this ·

The Linguistic Data Consortium (LDC) is an open consortium of universities, companies and government research laboratories. It creates and distributes speech and text databases, lexicons and other resources. The University of Pennsylvania is the LDC's host institution. The LDC was founded in 1992 with a grant from the Defense Advanced Research Projects Agency (DARPA). Currently, all LDC publication and distribution activities are self-supporting, while new data creation is partly supported by grant IRI 9528587 from the Information, Robotics and Intelligent Systems division of the National Science Foundation (NSF). The LDC's core mission remains the support of pre-competitive research and development in speech and language technology, but support of other language-related research is also an important focus. INTRODUCTION In order to build realistic models of human…

Linguistic resource creation for research and technology development

Stephanie Strassel, Mike Maxwell, Christopher Cieri

Artificial Intelligence · ACM Transactions on Asian Language Information Processing · · cited 10× · DOI ↗ · more like this ·

Advances in statistical machine learning encourage language-independent approaches to linguistic technology development. Experiments in "porting" technologies to handle new natural languages have revealed a great potential for multilingual computing, but also a frustrating lack of linguistic resources for most languages. Recent efforts to address the lack of available resources have focused either on intensive resource development for a small number of languages or development of technologies for rapid porting. The Linguistic Data Consortium recently participated in an experiment falling primarily under the first approach, the surprise language exercise . This article describes linguistic resource creation within this context, including the overall methodology for surveying and collecting language resources, as well as details of the resources developed during the exercise. The article…

Construction of a phonotactic dialect corpus using semiautomatic annotation

Reva Schwartz, Wade Shen, Joseph P. Campbell +4 more

Artificial Intelligence · · cited 9× · DOI ↗ · more like this ·

Abstract : In this paper, we discuss rapid, semiautomatic annotation techniques of detailed phonological phenomena for large corpora. We describe the use of these techniques for the development of a corpus of American English dialects. The resulting annotations and corpora will support both large scale linguistic dialect analysis and automatic dialect identification. We delineate the semiautomatic annotation process that we are currently employing and, a set of experiments we ran to validate this process. From these experiments, we learned that the use of ASR techniques could significantly increase the throughput and consistency of human annotators.

Automated Analysis of Digitized Letter Fluency Data

Sunghye Cho, Naomi Nevler, Natalia Parjane +4 more

Artificial Intelligence · Frontiers in Psychology · · cited 8× · DOI ↗ · more like this ·

The letter-guided naming fluency task is a measure of an individual's executive function and working memory. This study employed a novel, automated, quantifiable, and reproducible method to investigate how language characteristics of words produced during a fluency task are related to fluency performance, inter-word response time (RT), and over task duration using digitized F-letter-guided fluency recordings produced by 76 young healthy participants. Our automated algorithm counted the number of correct responses from the transcripts of the F-letter fluency data, and individual words were rated for concreteness, ambiguity, frequency, familiarity, and age of acquisition (AoA). Using a forced aligner, the transcripts were automatically aligned with the corresponding audio recordings. We measured inter-word RT, word duration, and word start time from the forced alignments. Articulation…

Challenges and Opportunities in Sociolinguistic Data and Metadata Sharing

Christopher Cieri

Linguistics and Language · Language and Linguistics Compass · · cited 8× · DOI ↗ · more like this ·

Abstract Advances in computing technology coupled with recent focus on big data in the social sciences have provided the motivation and some of the infrastructure necessary for sociolinguists to share data among themselves and with researchers in related fields such as human language technologies (HLT). Collaboration among sociolinguists offers the promise to extend current knowledge beyond the community studies that have dominated the field for the past 50 years and focus more on regional and national patterns of variation and change and what they indicate about linguistic theory. Collaboration with HLT developers while relatively new and still uncommon has led to advances both in sociolinguistic methodology and in technologies suited to sociolinguistic research. Before the field can make full use of these advances, however, sociolinguists must confront a number of challenges. Studies…

A Road Map for Interoperable Language Resource Metadata

Christopher Cieri, Khalid Choukri, Nicoletta Calzolari +5 more

Artificial Intelligence · Arrow@dit (Dublin Institute of Technology) · · cited 8× · DOI ↗ · more like this ·

LRs remain expensive to create and thus rare relative to demand across languages and technology types. The accidental re-creation of an LR that already exists is a nearly unforgiveable waste of scarce resources that is unfortunately not so easy to avoid. The number of catalogs the HLT researcher must search, with their different formats, make it possible to overlook an existing resource. This paper sketches the sources of this problem and outlines a proposal to rectify along with a new vision of LR cataloging that will to facilitates the documentation and exploitation of a much wider range of LRs than previously considered.

TIDES Language Resources: A Resource Map for Translingual Information Access

Christopher Cieri, Mark Liberman

Artificial Intelligence · Language Resources and Evaluation · · cited 8× · DOI ↗ · more like this ·

Continuing improvements in human language algorithms, coupled with improvements in digital storage and processing, inspire growing confidence in multilingual information access systems. Systems exist to transcribe broadcast news, segment broadcasts into individual stories and sort them by topic. These technologies, useful in isolation, are now being combined to produce intelligent multilingual systems. DARPA TIDES combines technologies in detection, extraction, summarization and translation to create systems capable of searching a wide range of streaming multilingual text and speech sources, in real time, to provide effective access for English-speaking users. The broad scope of tasks and languages in programs like TIDES demands close coordination of research and shared resources. These resources includes large collections of raw text and speech; translations and summaries; annotations…

Issues in Corpus Creation and Distribution: The Evolution of the Linguistic Data Consortium

Christopher Cieri, Mark Liberman

Artificial Intelligence · Language Resources and Evaluation · · cited 8× · DOI ↗ · more like this ·

The Linguistic Data Consortium (LDC) is a non-profit consortium of universities, companies and government research laboratories that supports education, research and technology development in language related disciplines by collecting or creating, distributing and archiving language resources including data and accompanying tools, standards and formats. LDC was founded in 1992 with a grant from the Defense Advanced Research Projects Agency (DARPA) to the University of Pennsylvania as host organization. LDC publication and distribution activities self-support from membership fees and data sales while new data creation is supported primarily by grants from DARPA and the National Science Foundation. Recent developments in the creation and use of language resources demand new roles for international data centers. Since our report at the last Language Resource and Evaluation Conference in…

More Data and Tools for More Languages and Research Areas: A Progress Report on LDC Activities

Christopher Cieri, Mark Liberman

Artificial Intelligence · Language Resources and Evaluation · · cited 7× · DOI ↗ · more like this ·

This presentation reports on recent progress the Linguistic Data Consortium has made in addressing the needs of multiple research communities by collecting, annotating and distributing, simplifying access and developing standards and tools. Specifically, it describes new trends in publication, a sample of recent projects and significant improvements to LDC Online that improve access to LDC data especially for those with limited computing support. 1.