arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Adam Kilgarriff

103 papers · 1989–2016

1989: 11990: 01991: 01992: 01993: 11994: 01995: 21996: 01997: 41998: 41999: 22000: 92001: 82002: 22003: 72004: 32005: 52006: 52007: 72008: 42009: 42010: 82011: 42012: 42013: 32014: 52015: 102016: 1
1989peak 10 in 20152016

Frequent co-authors

Papers

showing 1–25 of 103 RSS

<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.

Adam Kilgarriff

Artificial Intelligence · Language · · cited 11,687× · DOI ↗ · more like this ·

Part 1 The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, Christiane Fellbaum design and implementation of the WordNet lexical database and searching software, Randee I. Tengi. Part 2: automated discovery of WordNet relations, Marti A. Hearst representing verb alterations in WordNet, Karen T. Kohl et al the formalization of WordNet by methods of relational concept analysis, Uta E. Priss. Part 3 Applications of WordNet: building semantic concordances, Shari Landes et al performance and confidence in a semantic annotation task, Christiane Fellbaum et al WordNet and class-based probabilities, Philip Resnik combining local context and WordNet similarity for word sense identification, Claudia Leacock and Martin Chodorow using WordNet for text retrieval, Ellen M. Voorhees lexical chains as representations of…

The Sketch Engine

Adam Kilgarriff, Pavel Rychlý, Pavel Smrž +1 more

Artificial Intelligence · · cited 2,046× · OpenAlex ↗ · more like this ·

The chapter deals with word sketches - one-page automatic, corpus-based summaries of a word's grammatical and collocational behaviour.  They were first used in the production of the Macmillan English Dictionary and were presented at Euralex 2002.  At that point, they only existed for English.  Now, we have developed the Sketch Engine, a corpus tool which takes as input a corpus of any language and a corresponding grammar patterns and which generates word sketches for the words of that language.  It also generates a thesaurus and 'sketch differences', which specify similarities and differences between near-synonyms. We briefly present a case study investigating applicability of the Sketch Engine to free word-order languages. The results show that word sketches could facilitate lexicographic work in Czech as they have for English.

"I don't believe in word senses"

Adam Kilgarriff

cmp-lg · · cited 492× · arXiv ↗ · more like this ·

Word sense disambiguation assumes word senses. Within the lexicography and linguistics literature, they are known to be very slippery entities. The paper looks at problems with existing accounts of `word sense' and describes the various kinds of ways in which a word's meaning can deviate from its core meaning. An analysis is presented in which word senses are abstractions from clusters of corpus citations, in accordance with current lexicographic practice. The corpus citations, not the word senses, are the basic objects in the ontology. The corpus citations will be clustered into senses according to the purposes of whoever or whatever does the clustering. In the absence of such purposes, word senses do not exist. Word sense disambiguation also needs a set of word senses to disambiguate between. In most recent work, the set has been taken from a general-purpose lexical resource, with the…

Language is never, ever, ever, random

Adam Kilgarriff

Artificial Intelligence · Corpus Linguistics and Linguistic Theory · · cited 307× · DOI ↗ · more like this ·

Language users never choose words randomly, and language is essentially non-random. Statistical hypothesis testing uses a null hypothesis, which posits randomness. Hence, when we look at linguistic phenomena in corpora, the null hypothesis will never be true. Moreover, where there is enough data, we shall (almost) always be able to establish that it is not true. In corpus studies, we frequently do have enough data, so the fact that a relation between two phenomena is demonstrably non-random, does not support the inference that it is not arbitrary. We present experimental evidence of how arbitrary associations between word frequencies and corpora are systematically non-random. We review literature in which hypothesis testing has been used, and show how it has often led to unhelpful or misleading results.

Comparing Corpora

Adam Kilgarriff

Artificial Intelligence · International Journal of Corpus Linguistics · · cited 299× · DOI ↗ · more like this ·

Corpus linguistics lacks strategies for describing and comparing corpora. Currently most descriptions of corpora are textual, and questions such as ‘what sort of a corpus is this?’, or ‘how does this corpus compare to that?’ can only be answered impressionistically. This paper considers various ways in which different corpora can be compared more objectively. First we address the issue, ‘which words are particularly characteristic of a corpus?’, reviewing and critiquing the statistical methods which have been applied to the question and proposing the use of the Mann-Whitney ranks test. Results of two corpus comparisons using the ranks test are presented. Then, we consider measures for corpus similarity. After discussing limitations of the idea of corpus similarity, we present a method for evaluating corpus similarity measures. We consider several measures and establish that…

Googleology is Bad Science

Adam Kilgarriff

Artificial Intelligence · Computational Linguistics · · cited 286× · DOI ↗ · more like this ·

The World Wide Web is enormous, free, immediately available, and largely linguistic. As we discover, on ever more fronts, that language analysis and generation benefit from big data, so it becomes appealing to use the Web as a data source. The question, then, is how.

The SENSEVAL-3 English Lexical Sample Task

Rada Mihalcea, Timothy Chklovski, Adam Kilgarriff

Artificial Intelligence · University of North Texas Digital Library (University of North Texas) · · cited 227× · OpenAlex ↗ · more like this ·

This paper presents the task definition, resources, participating systems, and comparative results for the English lexical sample task, which was orga-nized as part of the SENSEVAL-3 evaluation exer-cise. The task drew the participation of 27 teams from around the world, with a total of 47 systems. 1

Helping Our Own: The HOO 2011 Pilot Shared Task

Robert Dale, Adam Kilgarriff

Artificial Intelligence · Natural Language Generation · · cited 176× · OpenAlex ↗ · more like this ·

The aim of the Helping Our Own (HOO) Shared Task is to promote the development of automated tools and techniques that can assist authors in the writing task, with a specific focus on writing within the natural language processing community. This paper reports on the results of a pilot run of the shared task, in which six teams participated. We describe the nature of the task and the data used, report on the results achieved, and discuss some of the things we learned that will guide future versions of the task. 1

Large linguistically-processed web corpora for multiple languages

Marco Baroni, Adam Kilgarriff

Artificial Intelligence · Repositori digital de la UPF (Universitat Pompeu Fabra) · · cited 124× · DOI ↗ · more like this ·

The Web contains vast amounts of linguistic data. One key issue for linguists and language technologists is how to access it. Commercial search engines give highly compromised access. An alternative is to crawl the Web ourselves, which also allows us to remove duplicates and near-duplicates, navigational material, and a range of other kinds of non-linguistic matter. We can also tokenize, lemmatise and part-of-speech tag the corpus, and load the data into a corpus query tool which supports sophisticated linguistic queries. We have now done this for German and Italian, with corpus sizes of over 1 billion words in each case. We provide Web access to the corpora in our query tool, the Sketch Engine.

The TenTen Corpus Family

Miloš Jakubíček, Adam Kilgarriff, Vojtěch Kovář +2 more

Artificial Intelligence · · cited 111× · OpenAlex ↗ · more like this ·

Everyone working on general language would like their corpus to be bigger, wider-coverage, cleaner, duplicate-free, and with richer metadata. In this paper we describe out programme to build ever better corpora along these lines for all of the world’s major languages (plus some others). Baroni and Kilgarriff (2006), Sharoff (2006), Baroni et al (2009), and Kilgarriff et al (2010) present the case for web corpora and programmes in which a number of them have been developed. TenTens are a development from them -- a new family of corpora of the order of 10 billion words. We describe how we are building them, what we have built so far, and how we shall continue maintaining them and keeping them up to date in the years ahead. While, as yet, they have very little metadata, we are working out how to gather and add metadata attribute by attribute. The corpora are all available for research…

SENSEVAL: An Exercise in Evaluating Word Sense Disambiguation Programs

Adam Kilgarriff

Artificial Intelligence · · cited 98× · OpenAlex ↗ · more like this ·

There are now many computer programs for automatically determining which sense a word is being used in. One would like to be able to say which were better, which worse, and also which words, or varieties of language, presented particular problems to which programs. In this paper I describe a pilot evaluation exercise (`SENSEVAL&amp;apos;) taking place under the auspices of ACL SIGLEX (the Lexicons Special Interest Group of the Association for Computational Linguistics) and EURALEX (European Association for Lexicography), ELSNET, and EU Projects SPARKLE and ECRAN, in 1998.

English Senseval: Report and Results

Adam Kilgarriff, Joseph Rosenzweig

Artificial Intelligence · Language Resources and Evaluation · · cited 92× · DOI ↗ · more like this ·

There are now many computer programs for automatically determining which sense a word is being used in. One would like to be able to say which were better, which worse, and also which words, or varieties of language, presented particular problems to which programs. In 1998 a first evaluation exercise, Senseval, took place. The English component of the exercise is described, and results presented. 1 Introduction There are now many computer programs for automatically determining which sense a word is being used in. One would like to be able to say which were better, which worse, and also which words, or varieties of language, presented particular problems to which programs. To this end, an evaluation exercise, Senseval, was organised under the auspices of ACL SIGLEX (the Lexicons Special Interest Group of the Association for Computational Linguistics), EURALEX (European Association for…

esTenTen, a Vast Web Corpus of Peninsular and American Spanish

Adam Kilgarriff, Irene Renau

Artificial Intelligence · Procedia - Social and Behavioral Sciences · · cited 91× · DOI ↗ · more like this ·

Everyone working on general language would like their corpus to be bigger, wider-coverage, cleaner, duplicate-free, and with richer metadata. As a response to that wish, Lexical Computing Ltd. has a programme to develop very large ‘TenTen’ web corpora. In this paper we introduce the Spanish corpus, esTenTen, of 8 billion words and 19 different national varieties of Spanish. We investigate the distance between the national varieties as represented in the corpus, and examine in detail the keywords of Peninsular Spanish vs. American Spanish, finding a wide range of linguistic, cultural and political contrasts.

Cleaneval: a Competition for Cleaning Web Pages

Marco Baroni, Francis Chantree, Adam Kilgarriff +1 more

Information Systems · Language Resources and Evaluation · · cited 88× · DOI ↗ · more like this ·

The articular lubricating fraction from bovine synovial fluid was prepared by repeated fractionation in three consecutive CsCl density gradients to remove completely traces of hyaluronic acid. The major glycoprotein consituent (LGP-I) was then isolated by repeated gel-permeation chromatography. The yield of the LGP-I component was about 20 mg/litre of synovial fluid. Sedimentation-equilibrium measurements showed that this glycoprotein was homogeneous and the mol.wt. was calculated to be 227500. Amino acids represented 43% (w/w) and carbohydrate constituents 44% (w/w) of the molecule. Threonine, glutamic acid, proline and lysine (224, 127, 242 and 128 residues/1000 residues respectively) were the major amino acids. Galactosamine, galactose and N-acetylneuraminic acid (202, 162 and 114 residues/molecule of LGP-I component respectively) accounted for 98% of the total carbohydrate residues…

Introduction to the special issue on evaluating word sense disambiguation systems

Philip Edmonds, Adam Kilgarriff

Artificial Intelligence · Natural Language Engineering · · cited 88× · DOI ↗ · more like this ·

Has system performance on Word Sense Disambiguation (WSD) reached a limit? Automatic systems don't perform nearly as well as humans on the task, and from the results of the S ENSEVAL exercises, recent improvements in system performance appear negligible or even negative. Still, systems do perform much better than the baselines, so something is being done right. System evaluation is crucial to explain these results and to show the way forward. Indeed, the success of any project in WSD is tied to the evaluation methodology used, and especially to the formalization of the task that the systems perform. The evaluation of WSD has turned out to be as difficult as designing the systems in the first place.

arTenTen: Arabic Corpus and Word Sketches

Tressy Arts, Yonatan Belinkov, Nizar Habash +2 more

Artificial Intelligence · Journal of King Saud University - Computer and Information Sciences · · cited 84× · DOI ↗ · more like this ·

We present arTenTen, a web-crawled corpus of Arabic, gathered in 2012. arTenTen consists of 5.8-billion words. A chunk of it has been lemmatized and part-of-speech (POS) tagged with the MADA tool and subsequently loaded into Sketch Engine, a leading corpus query tool, where it is open for all to use. We have also created ‘word sketches’: one-page, automatic, corpus-derived summaries of a word’s grammatical and collocational behavior. We use examples to demonstrate what the corpus can show us regarding Arabic words and phrases and how this can support lexicography and inform linguistic research. The article also presents the ‘sketch grammar’ (the basis for the word sketches) in detail, describes the process of building and processing the corpus, and considers the role of the corpus in additional research on Arabic.

A Corpus Factory for Many Languages

Adam Kilgarriff, Siva Reddy, Jan Pomikálek +1 more

Artificial Intelligence · Language Resources and Evaluation · · cited 80× · DOI ↗ · more like this ·

For many languages there are no large, general-language corpora available. Until the web, all but the richest institutions could do little but shake their heads in dismay as corpus-building was long, slow and expensive. But with the advent of the Web it can be highly automated and thereby fast and inexpensive. We have developed a `corpus factory &amp;apos; where we build large corpora. In this paper we describe the method we use, and how it has worked, and how various problems were

English Lexical Sample Task Description

Adam Kilgarriff

Artificial Intelligence · Meeting of the Association for Computational Linguistics · · cited 77× · OpenAlex ↗ · more like this ·

and nouns) for SENSEVAL 2 was set up according to the same principles as for SENSEVAL-1, as reported in (Kilgarriff and Rosenzweig, 2000). (Adjectives and nouns only, because the data preparation for the verbs lexical sample was undertaken alongside that for the English all-words task, and is reported in Palmer et al (this volume). All discussion below up to the Results section covers only adjectives and nouns.) 1 Lexical sample The lexicon was sampled to give a range of low, medium and high frequency words (see Table 1). These were all different words to the ones

Simple Maths for Keywords

Adam Kilgarriff

Artificial Intelligence · · cited 76× · OpenAlex ↗ · more like this ·

We present a simple method for identifying keywords of one corpus vs. another. There is no one-sizefits-all list, but different lists according to the frequency range the user is interested in. The method includes a variable which allows the user to focus on higher or lower frequency words. “This word is twice as common here as there.” Such observations are entirely central to corpus linguistics. We very often want to know which words are distinctive of one corpus, or text type, versus another. The simplest way to make the comparison is expressed in my opening sentence. “Twice as common” means the word’s frequency (per thousand words, or million words) in the one corpus is twice its frequency in the other. We count occurrences in each corpus, divide each number by the number of words in that corpus, optionally multiply by 1,000 or 1,000,000 to give frequencies per thousand or million…

WORD SKETCH: Extraction and Display of Signicant Collocations for Lexicography

Adam Kilgarriff, David Tugwell, Brighton Bn

Artificial Intelligence · · cited 76× · OpenAlex ↗ · more like this ·

This paper introduces the Word Sketch: a collocation-based resource of proven value for English lexicography. Issues involving the automatic extraction and presentation of salient collocations are discussed. It is further shown how the combination of signicant patterns may lead to even greater precision in the identication of collocations.

Fast Syntactic Searching in Very Large Corpora for Many Languages

MiloÅ¡ JakubÃÄek, Adam Kilgarriff, Diana McCarthy +1 more

Artificial Intelligence · Pacific Asia Conference on Language, Information, and Computation · · cited 73× · OpenAlex ↗ · more like this ·

Prvnim krokem pro mnoho lingvistických výzkumů je vyhledani přikladů. V 21. stoleti by tyto přiklady měly být vždy vyhledavany, nikoli vymýsleny. Proto potřebuji lingviste flexibilni nastroje pro vyhledavani i okrajových jazykových jevů. Takove vyhledavani musi být navic rychle i pro velke korpusy a složite dotazy. Představujeme rozsiřeni ke korpusovemu dotazovacimu jazyku CQL pro intuitivni vytvařeni syntaktických dotazů a ukažeme, že tyto dotazy mohou být rychle vyhodnocovany nasimi nastroji i pro korpusy o velikostech v řadech miliard pozic.

Using Word Frequency Lists to Measure Corpus Homogeneity and Similarity between Corpora

Adam Kilgarriff

Artificial Intelligence · Journal of Visual Languages & Computing · · cited 65× · OpenAlex ↗ · more like this ·

How similar are two corpora? A measure of corpus similarity would be very useful for language engineering. Word frequency lists are cheap and easy to generate so a measure based on them would be of use as a quick guide in many circumstances; for example, to judge how a newly available corpus related to existing resources, or how easy it might be to port an NLP system designed to work with one text type to work with another. Corpus similarity can only be interpreted in the light of corpus homogeneity. The paper presents a measure, based on the Ø 2 statistic, for measuring both corpus similarity and corpus homogeneity. A method for evaluating the accuracy of a corpus-similarity measure is introduced. The Ø 2 -based measure is compared with a rank-based measure and shown to outperform it. 1 Introduction How similar are two corpora? The question arises on many occasions. Does it matter…

Measures for Corpus Similarity and Homogeneity

Adam Kilgarriff, Tony Rose

Artificial Intelligence · Goldsmiths (University of London) · · cited 59× · OpenAlex ↗ · more like this ·

How similar are two corpora? A measure of corpus similarity would be very useful for NLP for many purposes, such as estimating the work involved in porting a system from one domain to another. First, we discuss difficulties in identifying what we mean by &amp;apos;corpus similariti: human similarity judgements are not finegrained enough, corpus similarity is inherently multidimensional, and similarity can only be interpreted in the light of corpus homogeneity. We then present an operational definition of corpus similarity \\vhich addresses or circumvents the problems, using purpose-built sets of aknown-similarity corpora&amp;quot;. These KSC sets can be used to evaluate the measures. We evaluate the measures described in the literature, including three variants of the information theoretic measure &amp;apos;perplexity&amp;apos;. A x 2-based measure, using word frequencies, is shnwn to…

An efficient algorithm for building a distributional thesaurus (and other Sketch Engine developments)

Pavel Rychlý, Adam Kilgarriff

Artificial Intelligence · · cited 47× · DOI ↗ · more like this ·

Gorman and Curran (2006) argue that thesaurus generation for billion+-word corpora is problematic as the full computation takes many days. We present an algorithm with which the computation takes under two hours. We have created, and made publicly available, thesauruses based on large corpora for (at time of writing) seven major world languages. The development is implemented in the Sketch Engine (Kilgarriff et al., 2004).