arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Nancy Ide

118 papers · 1981–2022

1981: 11982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 21991: 21992: 31993: 01994: 31995: 31996: 01997: 11998: 81999: 62000: 112001: 22002: 42003: 42004: 82005: 22006: 42007: 52008: 112009: 112010: 92011: 02012: 32013: 42014: 52015: 12016: 02017: 12018: 12019: 12020: 12021: 02022: 1
1981peak 11 in 20002022

Frequent co-authors

Papers

showing 1–25 of 118 RSS

Introduction to the special issue on word sense disambiguation: the state of the art

Nancy Ide, Jean Véronis

Artificial Intelligence · The COCOON platform (University of Paris) · · cited 668× · OpenAlex ↗ · more like this ·

Compte tenu du progres effectue recemment dans le domaine de la desambiguisation du sens des mots, les As. font ici le point sur l'etat de la recherche dans ce domaine depuis ces 50 dernieres annees et considerent les prochaines etapes a franchir. Dans un 1 e r temps, ils passent en revue les principales approches de la desambiguisation du sens des mots : des premieres tentatives effectuees dans le cadre de la traduction automatique aux methodes actuelles basees sur les corpus, en passant par les methodes basees sur l'intelligence artificielle et les methodes utilisant des bases de connaissance. Dans un 2 n d temps, ils examinent les problemes laisses en suspens (le role du contexte, la division des sens, l'evaluation des resultats) et proposent quelques orientations pour la recherche future

Word Sense Disambiguation: The State of the Art

Nancy Ide, Jean Véronis

Artificial Intelligence · · cited 294× · OpenAlex ↗ · more like this ·

, ANIMATE, HUMAN, etc. and encode type restrictions on nouns and adjectives and on the arguments of verbs. Subject codes use another set of primitives to classify senses of words by subject (ECONOMICS, ENGINEERING, etc.). Guthrie et al. (1991) demonstrate a typical use of this information: in addition to using the Lesk-based method of counting overlaps between definitions and contexts, they impose a correspondence of subject codes in an iterative process. No quantitative evaluation of this method is available, but Cowie et al. (1992) improve the method using simulated annealing and report results of 47% for sense distinctions and 72% for homographs. The use of LDOCE box codes, however, is problematic: the codes are not systematic (see, for example, Fontenelle, 1990); in later work, Braden-Harder (1993) showed that simply matching box or subject codes is not sufficient for…

Word sense disambiguation with very large neural networks extracted from machine readable dictionaries

Jean Véronis, Nancy Ide

Artificial Intelligence · · cited 159× · DOI ↗ · more like this ·

In this paper, we describe a means for automatically building very large neural networks (VLNNs) from definition texts in machine-readable dictionaries, and demonstrate the use of these networks for word sense disambiguation. Our method brings together two earlier, independent approaches to word sense disambiguation: the use of machine-readable dictionaries and spreading and activation models. The automatic construction of VLNNs enables real-size experiments with neural networks for natural language processing, which in turn provides insight into their behaviour and design and can lead to possible improvements.

GrAF

Nancy Ide, Keith Suderman

Artificial Intelligence · · cited 156× · DOI ↗ · more like this ·

In this paper we describe the Graph Annotation Format (GrAF) and show how it is used represent not only independent linguistic annotations, but also sets of merged annotations as a single graph. To demonstrate this, we have automatically transduced several different annotations of the Wall Street Journal corpus into GrAF and show how the annotations can then be merged, analyzed, and visualized using standard graph algorithms and tools. We also discuss how, as a standard graph representation, it allows for the application of well-established graph traversal and analysis algorithms to produce information about interactions and commonalities among merged annotations. GrAF is an extension of the Linguistic Annotation Framework (LAF) (Ide and Romary, 2004, 2006) developed within ISO TC37 SC4 and as such, implements state-of-the-art best practice guidelines for representing linguistic…

Towards Best Practice for Multiword Expressions in Computational Lexicons

Nicoletta Calzolari, Charles J. Fillmore, Ralph Grishman +4 more

Artificial Intelligence · Language Resources and Evaluation · · cited 150× · DOI ↗ · more like this ·

The importance and role of multi-word expressions (MWE) in the description and processing of natural language has been long recognized. However, multi-word information has often been relegated to the marginal role of idiosyncratic lexical information. The need for MWE lexicons grows even more acute for multi-lingual applications, for which (sometimes complex) correspondences must be identified, classified, and recorded. Within the XMELLT and ISLE projects we have started to investigate the potential to develop multi-lingual, multi-word expression lexicons incorporating both syntactic and semantic information. We aim at specifying means to acquire and represent multi-word lexical entries for multiple languages, and establishing uniform (or inter-translatable) standards for describing multi-word lexical entries. We explored theoretical approaches used in large lexicon-building projects…

XCES: An XML-based Encoding Standard for Linguistic Corpora

Nancy Ide, Patrice Bonhomme, Laurent Romary

Artificial Intelligence · Language Resources and Evaluation · · cited 131× · DOI ↗ · more like this ·

The Corpus Encoding Standard (CES) is a part of the EAGLES Guidelines developed by the Expert Advisory Group on Language Engineering Standards (EAGLES) that provides a set of encoding standards for corpus-based work in natural language processing applications. We have instantiated the CES as an XML application called XCES, based on the same data architecture comprised of a primary encoded text and "standoff" annotation in separate documents. Conversion to XML enables use of some of the more powerful mechanisms provided in the XML framework, including the XSLT Transformation Language, XML Schemas, and support for interrescue reference together with an extensive path syntax for pointers. In this paper, we describe the differences between the CES and XCES DTDs and demonstrate how XML mechanisms can be used to select from and manipulate annotated corpora encoded according…

Sense discrimination with parallel corpora

Nancy Ide, Tomaž Erjavec, Dan Tufiş

Artificial Intelligence · · cited 102× · DOI ↗ · more like this ·

This paper describes an experiment that uses translation equivalents derived from parallel corpora to determine sense distinctions that can be used for automatic sense-tagging and other disambiguation tasks. Our results show that sense distinctions derived from cross-lingual information are at least as reliable as those made by human annotators. Because our approach is fully automated through all its steps, it could provide means to obtain large samples of "sense-tagged" data without the high cost of human annotation.

Fine-Grained Word Sense Disambiguation Based on Parallel Corpora, Word Alignment, Word Clustering and Aligned Wordnets

Dan Tufis, Radu Ion, Nancy Ide

cs.AI · · cited 90× · arXiv ↗ · more like this ·

The paper presents a method for word sense disambiguation based on parallel corpora. The method exploits recent advances in word alignment and word clustering based on automatic extraction of translation equivalents and being supported by available aligned wordnets for the languages in the corpus. The wordnets are aligned to the Princeton Wordnet, according to the principles established by EuroWordNet. The evaluation of the WSD system, implementing the method described herein showed very encouraging results. The same system used in a validation mode, can be used to check and spot alignment errors in multilingually aligned wordnets as BalkaNet and EuroWordNet.

MULTEXT

Nancy Ide, Jean Véronis

Artificial Intelligence · · cited 89× · DOI ↗ · more like this ·

MULTEXT (Multilingual Text Tools and Corpora) is the largest project funded in the Commission of European Communities Linguistic Research and Engineering Program. The project will contribute to the development of generally usable software tools to manipulate and analyse text corpora and to create multilingual text corpora with structural and linguistic markup. It will attempt to establish conventions for the encoding of such corpora, building on and contributing to the preliminary recommendations of the relevant international and European standardization initiatives. MULTEXT will also work towards establishing a set of guidelines for text software development, which will be widely published in order to enable future development by others. All tools and data developed within the project will be made freely and publicly available.

The Manually Annotated Sub-Corpus: A Community Resource for and by the People

Nancy Ide, Collin F. Baker, Christiane Fellbaum +1 more

Artificial Intelligence · Meeting of the Association for Computational Linguistics · · cited 88× · OpenAlex ↗ · more like this ·

The Manually Annotated Sub-Corpus (MASC) project provides data and annotations to serve as the base for a communitywide annotation effort of a subset of the American National Corpus. The MASC infrastructure enables the incorporation of contributed annotations into a single, usable format that can then be analyzed as it is or ported to any of a variety of other formats. MASC includes data from a much wider variety of genres than existing multiply-annotated corpora of English, and the project is committed to a fully open model of distribution, without restriction,

Veins Theory

Dan Cristea, Nancy Ide, Laurent Romary

Artificial Intelligence · · cited 87× · DOI ↗ · more like this ·

In this paper, we propose a generalization of Centering Theory (CT) (Grosz, Joshi, Weinstein (1995)) called Veins Theory (VT), which extends the applicability of centering rules from local to global discourse. A key facet of the theory involves the identification of «veins» over discourse structure trees such as those defined in RST, which delimit domains of referential accessibility for each unit in a discourse. Once identified, reference chains can be extended across segment boundaries, thus enabling the application of CT over the entire discourse. We describe the processes by which veins are defined over discourse structure trees and how CT can be applied to global discourse by using these chains. We also define a discourse «smoothness» index which can be used to compare different discourse structures and interpretations, and show how VT can be used to abstract a span of text in the…

The American National Corpus First Release

Nancy Ide, Keith Suderman

Artificial Intelligence · Language Resources and Evaluation · · cited 80× · DOI ↗ · more like this ·

The First Release of the American National Corpus (ANC) was made available in mid-fall, 2003. The data includes approximately 11 million words of American English, including written and spoken data and a variety of text types annotated for part of speech and lemma. The corpus is provided in XML format conformant to the XML Corpus Encoding Standard (XCES) (http://www.xml-ces.org), and is distributed in both a stand-off version (where annotation is in an XML document separate from the primary texts) and a merged version (where annotation is included in-line in the texts). The merged version includes annotation for part of speech and lemma produced by the Biber tagger; in stand-off annotation, in addition to the Biber tagging, morpho-syntactic annotations of the data are provided using the CLAWS 5 and 7 tagsets as well as several other tagsets.

MASC: the Manually Annotated Sub-Corpus of American English

Nancy Ide, Collin F. Baker, Christiane Fellbaum +2 more

Artificial Intelligence · Language Resources and Evaluation · · cited 77× · DOI ↗ · more like this ·

To answer the critical need for sharable, reusable annotated resources with rich linguistic annotations, we are developing a Manually Annotated Sub-Corpus (MASC) including texts from diverse genres and manual annotations or manually-validated annotations for multiple levels, including WordNet senses and FrameNet frames and frame elements, both of which have become significant resources in the international computational linguistics community. To derive maximal benefit from the semantic information provided by these resources, the MASC will also include manually-validated shallow parses and named entities, which will enable linking WordNet senses and FrameNet frames within the same sentences into more complex semantic structures and, because named entities will often be the role fillers of FrameNet frames, enrich the semantic and pragmatic information derivable from the sub-corpus. All…

Multext-East

Ludmiła Dimitrova, Nancy Ide, Vladimír Petkevič +3 more

Artificial Intelligence · · cited 65× · DOI ↗ · more like this ·

The EU Copernicus project Multext-East has created a multi-lingual corpus of text and speech data, covering the six languages of the project: Bulgarian, Czech, Estonian, Hungarian, Romanian, and Slovene. In addition, wordform lexicons for each of the languages were developed. The corpus includes a parallel component consisting of Orwell's Nineteen Eighty-Four, with versions in all six languages tagged for part-of-speech and aligned to English (also tagged for POS). We describe the encoding format and data architecture designed especially for this corpus, which is generally usable for encoding linguistic corpora. We also describe the methodology for the development of a harmonized set of morphosyntactic descriptions (MSDs), which builds upon the scheme for western European languages developed within the EAGLES project. We discuss the special concerns for handling the six project…

EXTRACTING KNOWLEDGE BASES FROM MACHINE- READABLE DICTIONARIES : HAVE WE WASTED OUR TIME?

Nancy Ide, Jean Véronis

Artificial Intelligence · · cited 53× · OpenAlex ↗ · more like this ·

Machine-readable versions of everyday dictionaries have been seen as a likely source of information for use in natural language processing because they contain an enormous amount of lexical and semantic knowledge. However, after 15 years of research, the results appear to be disappointing. No comprehensive evaluation of machine-readable dictionaries (MRDs) as a knowledge source has been made to date, although this is necessary to determine what, if anything, can be gained from MRD research. To this end, this paper will first consider the postulates upon which MRD research has been based over the past fifteen years, discuss the validity of these postulates, and evaluate the results of this work. We will then propose possible future directions and applications that may exploit these years of effort, in the light of current directions in not only NLP research, but also fields such as…

The Language Application Grid

Nancy Ide, James Pustejovsky, Christopher Cieri +5 more

Computer Networks and Communications · Lecture notes in computer science · · cited 52× · DOI ↗ · more like this ·

The Language Application (LAPPS) Grid project is establishing a framework that enables language service discovery, composition, and reuse and promotes sustainability, manageability, usability, and interoperability of natural language Processing (NLP) components. It is based on the service-oriented architecture (SOA), a more recent, web-oriented version of the “pipeline” architecture that has long been used in NLP for sequencing loosely-coupled linguistic analyses. The LAPPS Grid provides access to basic NLP processing tools and resources and enables pipelining such tools to create custom NLP applications, as well as composite services such as question answering and machine translation together with language resources such as mono- and multi-lingual corpora and lexicons that support NLP. The transformative aspect of the LAPPS Grid is that it orchestrates access to and deployment of…

The American National Corpus: A Standardized Resource for American English

Catherine Macleod, Nancy Ide, Ralph Grishman

Artificial Intelligence · Language Resources and Evaluation · · cited 50× · DOI ↗ · more like this ·

At the first conference on Language Resources and Evaluation, Granada 1998, Charles Fillmore, Nancy Ide, Daniel Jurafsky, and Catherine Macleod proposed creating an American National Corpus (ANC) that would compare with the British National Corpus (BNC) both in balance and in size (one hundred million words). This paper reports on the progress made over the past two years in launching the project. At present, the ANC project is well underway, with commitments for support and contribution of texts from a number of publishers world-wide.

The American National Corpus

Randi Reppen, Nancy Ide

Artificial Intelligence · Journal of English Linguistics · · cited 46× · DOI ↗ · more like this ·

The American National Corpus (ANC) will be a carefully designed corpus of 100 million words of American written and spoken language that generally follows the framework of the British National Corpus. The ANC project will provide both a standard format for text encoding and a format for different types of corpus annotation (e.g., parts of speech, rhetorical features, etc.), as well as different versions of the same type of annotation (e.g. multiple part of speech taggings). As the only widely available large corpus of spoken and written American English containing a variety of registers, the ANC will represent a synchronic slice of American English across many registers. The First Release of the ANC, described in this article, is a preview of the corpus and a chance for researchers to contribute feedback on format and related issues, while allowing them access to data rather than…

The MULTEXT East corpus

Tomaž Erjavec, Nancy Ide

Artificial Intelligence · Language Resources and Evaluation · · cited 42× · DOI ↗ · more like this ·

The EU MULTEXT-East project has produced harmonised language resources for Bulgarian, Czech, Estonian, Hungarian, Roma-nian, and Slovene. In this paper we introduce the MULTEXT-East multilingual corpus, which comprises marked-up texts in the six languages totaling approximately 2 million words and a small speech corpus. The corpus is encoded in SGML, in the TEI-like Corpus Encoding Specification and is divided into a parallel and a comparable (fiction, news) part. The parallel corpus consists of the novel "1984 " by George Orwell in the English original and translations. The translations are sentence aligned with the original and tagged for word-level linguistic information, i.e. for morphosyntactic descriptions and lemmas. Detailed information on the corpus is available on the WWW and the corpus itself has been released for research purposes on a CD-ROM in the scope…

The American National Corpus: More Than the Web Can Provide

Nancy Ide, Randi Reppen, Keith Suderman

Artificial Intelligence · Language Resources and Evaluation · · cited 37× · DOI ↗ · more like this ·

The American National Corpus (ANC) project is developing a corpus comparable to the British National Corpus (BNC), covering American English. Recent interest in the web as a source of corpus materials has caused some in the language processing community to suggest that the development of a corpus of American English is unnecessary. However, we argue that far from being rendered superfluous by the availability of web materials, the ANC is likely to provide a resource for developing web acquisition techniques to support tasks such as genre and language detection and automatic annotation. This paper presents a comparison of the ANC in terms of both content and format with a test corpus compiled from web data, and a discussion of points of intersection and divergence.

Anveshan: A Framework for Analysis of Multiple Annotators' Labeling Behavior

Vikas Bhardwaj, Rebecca J. Passonneau, Ansaf Salleb-Aouissi +1 more

Artificial Intelligence · Linguistic Annotation Workshop · · cited 32× · OpenAlex ↗ · more like this ·

Manual annotation of natural language to capture linguistic information is essential for NLP tasks involving supervised machine learning of semantic knowledge. Judgements of meaning can be more or less subjective, in which case instead of a single correct label, the labels assigned might vary among annotators based on the annotators ’ knowledge, age, gender, intuitions, background, and so on. We introduce a framework ”Anveshan, ” where we investigate annotator behavior to find outliers, cluster annotators by behavior, and identify confusable labels. We also investigate the effectiveness of using trained annotators versus a larger number of untrained annotators on a word sense annotation task. The annotation data comes from a word sense disambiguation task for polysemous words, annotated by both trained annotators and untrained annotators from Amazon’s Mechanical turk. Our results show…

Outline of the international standard linguistic annotation framework

Nancy Ide, Laurent Romary

Artificial Intelligence · · cited 30× · DOI ↗ · more like this ·

This paper describes the outline of a linguistic annotation framework under development by ISO TC37 SC WG1-1. This international standard provides an architecture for the creation, annotation, and manipulation of linguistic resources and processing software. The goal is to provide maximum flexibility for encoders and annotators, while at the same time enabling interchange and re-use of annotated linguistic resources. We describe here the outline of the standard for the purposes of enabling annotators to begin to explore how their schemes may map into the framework.

Very large neural networks for word sense disambiguation

Nancy Ide, Jean Véronis

Artificial Intelligence · European Conference on Artificial Intelligence · · cited 30× · OpenAlex ↗ · more like this ·

The use of neural networks for word sense disambiguation has been suggested, but previous approaches did not provide any practical means to build the proposed networks. Therefore, it has not been clear that the proposed models scale up to realistic dimensions. We demonstrate how textual sources such as machine readable dictionaries can be used to automatically create Very Large Neural Networks which embody a simple local model and contain several thousands of nodes. Our results show that such networks are able to disambiguate words at a rate three times higher than chance, and thus provide real-size validation for connectionnist approaches to word sense disambiguation.

TOWARDS INTERNATIONAL STANDARDS FOR LANGUAGE RESOURCES

Nancy Ide, Laurent Romary

Artificial Intelligence · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 28× · OpenAlex ↗ · more like this ·

This paper describes the Linguistic Annotation Framework (LAF) developed by the International Standards Organization TC32 SC4, which is to serve as a basis for harmonizing existing language resources as well as developing new ones. We then describe the use of the LAF to represent the American National Corpus and its linguistic annotations.