Author

Tomek Strzalkowski

101 papers · 1957–2026

1967peak 9 in 20032026

Frequent co-authors

Papers

showing 1–25 of 101 RSS

Procedure for quantitatively comparing the syntactic coverage of English grammars

Judith L. Klavans, Mark Liberman, Mitchell P. Marcus +9 more

Artificial Intelligence · 1991 · cited 436× · DOI ↗ · more like this ·

The problem of quantitatively comparing the performance of different broad-coverage grammars of English has to date resisted solution. Prima facie, known English grammars appear to disagree strongly with each other as to the elements of even the simplest sentences. For instance, the grammars of Steve Abney (Bellcore), Ezra Black (IBM), Dan Flickinger (Hewlett Packard), Claudia Gdaniec (Logos), Ralph Grishman and Tomek Strzalkowski (NYU), Phil Harrison (Boeing), Don Hindle (AT&T), Bob Ingria (BBN), and Mitch Marcus (U. of Pennsylvania) recognize in common only the following constituents, when each grammarian provides the single parse which he/she would ideally want his/her grammar to specify for three sample Brown Corpus sentences:The famed Yankee Clipper, now retired, has been assisting (as (a batting coach)).One of those capital-gains ventures, in fact, has saddled him (with Gore…

Natural Language Information Retrieval TREC-6 Report.

Tomek Strzalkowski, Louise Guthrie, Jussi Karlgren +6 more

Artificial Intelligence · Defense Technical Information Center (DTIC) · November 1994 · cited 82× · OpenAlex ↗ · more like this ·

. Natural language processing techniques may hold a tremendous potential for overcoming the inadequacies of purely quantitative methods of text information retrieval, but the empirical evidence to support such predictions has thus far been inadequate, and appropriate scale evaluations have been slow to emerge. In this chapter, we report on the progress of the Natural Language Information Retrieval project, a joint effort of several sites led by GE Research, and its evaluation in the 6th Text Retrieval Conferences (TREC-6). 1. Introduction and Motivation Recently, we noted a renewed interest in using NLP techniques in information retrieval, sparked in part by the sudden prominence, as well as the perceived limitations, of existing IR technology in rapidly emerging commercial applications, including on the Internet. This has also been reflected in what is being done at TREC: using phrasal…

Cross-document summarization by concept classification

Hilda Hardy, Nobuyuki Shimizu, Tomek Strzalkowski +3 more

Artificial Intelligence · 11 Aug 2002 · cited 78× · DOI ↗ · more like this ·

In this paper we describe a Cross Document Summarizer XDoX designed specifically to summarize large document sets (50-500 documents and more). Such sets of documents are typically obtained from routing or filtering systems run against a continuous stream of data, such as a newswire. XDoX works by identifying the most salient themes within the set (at the granularity level that is regulated by the user) and composing an extraction summary, which reflects these main themes. In the current version, XDoX is not optimized to produce a summary based on a few unrelated documents; indeed, such summaries are best obtained simply by concatenating summaries of individual documents. We show examples of summaries obtained in our tests as well as from our participation in the first Document Understanding Conference (DUC).

Information retrieval using robust natural language processing

Tomek Strzalkowski

Artificial Intelligence · The COCOON platform (University of Paris) · 1992 · cited 62× · DOI ↗ · more like this ·

We developed a fully automated Information Retrieval System which uses advanced natural language processing techniques to enhance the effectiveness of traditional key-word based document retrieval. In early experiments with the standard CACM-3204 collection of abstracts, the augmented system has displayed capabilities that made it clearly superior to the purely statistical base system.

A Robust Practical Text Summarization

Tomek Strzalkowski, Jin Wang, Bowden Wise

Artificial Intelligence · Anaesthesia · 1998 · cited 54× · DOI ↗ · more like this ·

We present an automated method of generating human-readable summaries from text documents such as news, technical reports, government documents, and even court records. Our approach exploits an empirical observation that much of the written text display certain regularities of organization and style, which we call the Discourse Macro Structure (DMS). A summary is therefore created to reflect the con.ponents of a given DMS. In order to produce ~ roherent and readable summary we select continuoa~, well-formed passages from the source document and assemble them into a mini-document within a DMS template. In this paper we describe the SummarizerTool, a Java-implemented prototype, and its applications in various document processing tasks.

Data-driven strategies for an automated dialogue system

Hilda Hardy, Tomek Strzalkowski, Min Wu +5 more

Artificial Intelligence · 2004 · cited 34× · DOI ↗ · more like this ·

We present a prototype natural-language problem-solving application for a financial services call center, developed as part of the Amitiés multilingual human-computer dialogue project. Our automated dialogue system, based on empirical evidence from real call-center conversations, features a data-driven approach that allows for mixed system/customer initiative and spontaneous conversation. Preliminary evaluation results indicate efficient dialogues and high user satisfaction, with performance comparable to or better than that of current conversational travel information systems.

Modeling Sociocultural phenomena in discourse

George Aaron Broadwell, Jennifer Stromer‐Galley, Tomek Strzalkowski +7 more

Artificial Intelligence · Natural Language Engineering · 12 Jan 2012 · cited 33× · DOI ↗ · more like this ·

Abstract In this paper, we describe a novel approach to computational modeling and understanding of social and cultural phenomena in multi-party dialogues. We developed a two-tier approach in which we first detect and classify certain sociolinguistic behaviors, including topic control, disagreement, and involvement, that serve as first-order models from which presence the higher level social roles, such as leadership, may be inferred.

HITIQA

Sharon Small, Ting Liu, Nobuyuki Shimizu +1 more

Artificial Intelligence · 2003 · cited 32× · DOI ↗ · more like this ·

HITIQA is an interactive question answering technology designed to allow intelligence analysts and other users of information systems to pose questions in natural language and obtain relevant answers, or the assistance they require in order to perform their tasks. Our objective in HITIQA is to allow the user to submit exploratory, analytical, non-factual questions, such as "What has been Russia's reaction to U.S. bombing of Kosovo?" The distinguishing property of such questions is that one cannot generally anticipate what might constitute the answer. While certain types of things may be expected (e.g., diplomatic statements), the answer is heavily conditioned by what information is in fact available on the topic. From a practical viewpoint, analytical questions are often underspecified, thus casting a broad net on a space of possible answers. Therefore, clarification dialogue is often…

Robust text processing in automated information retrieval

Tomek Strzalkowski

Artificial Intelligence · Defense Technical Information Center (DTIC) · 1994 · cited 32× · DOI ↗ · more like this ·

We report on the results of a series of experiments with a prototype text retrieval system which uses relatively advanced natural language processing techniques in order to enhance the effectiveness of statistical document retrieval. In this paper we show that large-scale natural language processing (hundreds of millions of words and more) is not only required for a better retrieval, but it is also doable, given appropriate resources. In particular, we demonstrate that the use of syntactic compounds in the representation of database documents as well as in the user queries, coupled with an appropriate term weighting strategy, can considerably improve the effectiveness of retrospective search. The experiments reported here were conducted on TIPSTER database in connection with the Text REtrieval Conference series (TREC).

A self-learning universal concept spotter

Tomek Strzalkowski, Jin Wang

Artificial Intelligence · 1996 · cited 27× · DOI ↗ · more like this ·

We describe the Universal Spotter, a system for identifying in-text references to entities of an arbitrary, user-specified type, such as people, organizations, equipment, products, materials, etc. Starting with some initial seed examples, and a training text corpus, the system generates rules that will find further concepts of the same type. The initial seed information is provided by the user in the form of a typical lexical context in which the entities to be spotted occur, e.g., "the name ends with Co.", or "to the right of produced or made", and so forth, or by simply supplying examples of the concept itself, e.g., Ford Taurus, gas turbine, Big Mac. In addition, negative examples can be supplied, if known. Given a sufficiently large training corpus, an unsupervised learning process is initiated in which the system will: (1) find instances of the sought-after concept using the…

MPC: A Multi-Party Chat Corpus for Modeling Social Phenomena in Discourse

Samira Shaikh, Tomek Strzalkowski, Aaron Broadwell +3 more

Artificial Intelligence · Language Resources and Evaluation · May 2010 · cited 26× · DOI ↗ · more like this ·

In this paper, we describe our experience with collecting and creating an annotated corpus of multi-party online conversations in a chat-room environment. This effort is part of a larger project to develop computational models of social phenomena such as agenda control, influence, and leadership in on-line interactions. Such models will help capturing the dialogue dynamics that are essential for developing, among others, realistic human-machine dialogue systems, including autonomous virtual chat agents. In this paper we describe data collection method used and the characteristics of the initial dataset of English chat. We have devised a multi-tiered collection process in which the subjects start from simple, free-flowing conversations and progress towards more complex and structured interactions. In this paper, we report on the first two stages of this process, which were recently…

Using interview data to identify evaluation criteria for interactive, analytical question‐answering systems

Diane Kelly, Nina Wacholder, Robert Rittman +4 more

Information Systems · Journal of the American Society for Information Science and Technology · 21 Mar 2007 · cited 25× · DOI ↗ · more like this ·

Abstract The purpose of this work is to identify potential evaluation criteria for interactive, analytical question‐answering (QA) systems by analyzing evaluative comments made by users of such a system. Qualitative data collected from intelligence analysts during interviews and focus groups were analyzed to identify common themes related to performance, use, and usability. These data were collected as part of an intensive, three‐day evaluation workshop of the High‐Quality Interactive Question Answering (HITIQA) system. Inductive coding and memoing were used to identify and categorize these data. Results suggest potential evaluation criteria for interactive, analytical QA systems, which can be used to guide the development and design of future systems and evaluations. This work contributes to studies of QA systems, information seeking and use behaviors, and interactive searching.

Multi-layer Dialogue Annotation for Automated Multilingual Customer Service

Hilda Hardy, Kirk Baker, Laurence Devillers +5 more

Artificial Intelligence · 2003 · cited 21× · OpenAlex ↗ · more like this ·

For the AMITIÉS multilingual human-computer dialogue project [1], we have developed new methods for the manual annotation of spoken dia-logue transcriptions from European financial call centers on multiple levels. We have modified the DAMSL schema [2] to create a dialogue act taxon-omy appropriate to the functions of call center dia-logues. We use a domain-independent framework populated with domain-specific lists to capture the semantics of spoken dialogues. Our new flexible, platform-independent Java annotation tool, called XDMLTool, takes plain-text dialogue files as in-put, and yields annotated files in the widely used XML format. To date, XDMLTool has been used to annotate several hundred call-center dialogues in France, the UK and the US. We present definitions of each tag as well as examples in English and French. These annotation methods are developed for an experimental system…

Recent developments in natural language text retrieval

Tomek Strzalkowski, Jose Perez Carballo

Artificial Intelligence · Text REtrieval Conference · 1993 · cited 21× · OpenAlex ↗ · more like this ·

This paper reports on some recent developments in our natural language text retrieval system. The system uses advanced natural language processing techniques to enhance the effectiveness of term-based document retrieval. The backbone of our system is a traditional statistical engine which builds inverted index files from pre-processed documents, and then searches and ranks the documents in response to user queries. Natural language processing is used to (1) preprocess the documents in order to extract content-carrying terms, (2) discover inter-term dependencies and build a conceptual hierarchy specific to the database domain, and (3) process user&apos;s natural language requests into effective search queries. For the present TREC-2 effort, the total of 550 MBytes of Wall Street Journal articles (ad-hoc queries database) and 300 MBytes of San Jose Mercury articles (routing data) have…

A New Dataset and Evaluation for Belief/Factuality

Vinodkumar Prabhakaran, Tomas By, Julia Hirschberg +9 more

Artificial Intelligence · 2015 · cited 20× · DOI ↗ · more like this ·

Vinodkumar Prabhakaran, Tomas By, Julia Hirschberg, Owen Rambow, Samira Shaikh, Tomek Strzalkowski, Jennifer Tracey, Michael Arrigo, Rupayan Basu, Micah Clark, Adam Dalton, Mona Diab, Louise Guthrie, Anna Prokofieva, Stephanie Strassel, Gregory Werner, Yorick Wilks, Janyce Wiebe. Proceedings of the Fourth Joint Conference on Lexical and Computational Semantics. 2015.

Questioning Answering By Pattern Matching, Web-Proofing, Semantic Form Proofing.

Min Wu, Xiaoyu Zheng, Michelle Duan +2 more

Artificial Intelligence · Text REtrieval Conference · 2003 · cited 20× · OpenAlex ↗ · more like this ·

In this paper, we introduce the University at Albany’s question answering system, ILQUA. It is developed on the following methods: pattern matching over annotated text, web-proofing and semantic form proofing. These methods are currently used in other QA systems, however, we revised them to work together in our QA system.

Building effective queries in natural language information retrieval

Tomek Strzalkowski, Fang Lin, José Pérez-Carballo +1 more

Artificial Intelligence · Defense Technical Information Center (DTIC) · 1997 · cited 20× · DOI ↗ · more like this ·

In this paper we report on our natural language information retrieval (NLIR) project as related to the recently concluded 5th Text Retrieval Conference (TREC-5). The main thrust of this project is to use natural language processing techniques to enhance the effectiveness of full-text document retrieval. One of our goals was to demonstrate that robust if relatively shallow NLP can help to derive a better representation of text documents for statistical search. Recently, we have turned our attention away from text representation issues and more towards query development problems. While our NLIR system still performs extensive natural language processing in order to extract phrasal and other indexing terms, our focus has shifted to the problems of building effective search queries. Specifically, we are interested in query construction that uses words, sentences, and entire passages to…

Natural language information retrieval

Tomek Strzalkowski

Artificial Intelligence · 1996 · cited 19× · DOI ↗ · more like this ·

We report on the joint GE/NYU natural language information retrieval project as related to the Tipster Phase 2 research conducted initially at NYU and subsequently at GE R&D Center and NYU. The evaluation results discussed here were obtained in connection with the 3rd and 4th Text Retrieval Conferences (TREC-3 and TREC-4). The main thrust of this project is to use natural language processing techniques to enhance the effectiveness of full-text document retrieval. During the course of the four TREC conferences, we have built a prototype IR system designed around a statistical full-text indexing and search backbone provided by the NIST's Prise engine. The original Prise has been modified to allow handling of multi-word phrases, differential term weighting schemes, automatic query expansion, index partitioning and rank merging, as well as dealing with complex documents. Natural language…

A model for quantitative evaluation of an end‐to‐end question‐answering system

Nina Wacholder, Diane Kelly, Paul B. Kantor +6 more

Artificial Intelligence · Journal of the American Society for Information Science and Technology · 23 Apr 2007 · cited 18× · DOI ↗ · more like this ·

Abstract We describe a procedure for quantitative evaluation of interactive question‐answering systems and illustrate it with application to the High‐Quality Interactive Question‐Answering (HITIQA) system. Our objectives were (a) to design a method to realistically and reliably assess interactive question‐answering systems by comparing the quality of reports produced using different systems, (b) to conduct a pilot test of this method, and (c) to perform a formative evaluation of the HITIQA system. Far more important than the specific information gathered from this pilot evaluation is the development of (a) a protocol for evaluating an emerging technology, (b) reusable assessment instruments, and (c) the knowledge gained in conducting the evaluation. We conclude that this method, which uses a surprisingly small number of subjects and does not rely on predetermined relevance judgments…

Summarization-based query expansion in information retrieval

Tomek Strzalkowski, Jin Wang, Bowden Wise

Artificial Intelligence · The COCOON platform (University of Paris) · 1998 · cited 18× · DOI ↗ · more like this ·

We discuss a semi-interactive approach to information retrieval which consists of two tasks performed in a sequence. First, the system assists the searcher in building a comprehensive statement of information need, using automatically generated topical summaries of sample documents. Second, the detailed statement of information need is automatically processed by a series of natural language processing routines in order to derive an optimal search query for a statistical information retrieval system. In this paper, we investigate the role of automated document summarization in building effective search statements. We also discuss the results of latest evaluation of our system at the annual Text Retrieval Conference (TREC).

NLP Track at TREC-5

Tomek Strzalkowski, Karen Spärck Jones

Artificial Intelligence · Defense Technical Information Center (DTIC) · November 1996 · cited 17× · OpenAlex ↗ · more like this ·

The Natural Language Processing (NLP) track was organized for the first time at TREC-5 to provide a more focused look at how NLP techniques can improve performance in information retrieval (IR). The intent was to see if the NLP techniques available today are mature enough to have an impact on IR, and whether they offer an advantage over purely quantitative methods. TREC-5 also was the place to try more expensive and more risky solutions than those used in main TREC evaluations. This NLP track demonstrated that NLP techniques have a solid but limited impact on the quality of text retrieval, particularly precision. Techniques aimed at producing higher quality queries, (e.g., query expansion, constraints) appear to be more effective than those aimed primarily at obtaining improved indexing of database documents. More work is needed before substantial gains can be seen, including the use of…

Reversible logic grammars for natural language parsing and generation

Tomek Strzalkowski

Artificial Intelligence · Computational Intelligence · August 1990 · cited 17× · DOI ↗ · more like this ·

The use of a single grammar in natural language parsing and generation is most desirable for a variety of reasons, including efficiency, perspicuity, integrity, robustness, and a certain amount of elegance. These characteristics have been noted before by several researchers, but it was only recently that more serious attention started to be paid to the problem of creating a bidirectional system for natural language processing. In this paper we discuss a somewhat more radical version of the problem: given a parser for a language, can we reverse it so that it becomes an efficient generator for the same language? Furthermore, since both the parser and the generator are based upon the same grammar, are there any normalization conditions upon the form of the grammar that must be met in order to assure the maximum efficiency of the reversed program? Can other grammars be transformed into the…

HITIQA: High-quality intelligence through interactive question answering

Sharon Small, Tomek Strzalkowski

Artificial Intelligence · Natural Language Engineering · 6 Nov 2008 · cited 16× · DOI ↗ · more like this ·

Abstract We describe an interactive question answering system, HITIQA, which helps users find answers to complex analytical problems. Such problems often necessitate the user to submit not one but an entire series of questions, both simple and complex, and then to negotiate the final content and form of the answer. HITIQA advances research in human–computer dialogue by enabling topical, mixed initiative interaction over unstructured data. HITIQA uses the process of text framing to bring a level of semantic representation to open-domain data in order to facilitate meaningful dialogue with the user. In this paper we give an overview of HITIQA's design and explain the workings of its main components with particular attention given to its dialogue capabilities. We also present results of end-to-end system evaluations that demonstrate the effectiveness of the system as a whole, as well as…

Communicating age in Second Life: The contributions of textual and visual factors

Rosa Mikeal Martey, Jennifer Stromer‐Galley, Mia Consalvo +3 more

Human-Computer Interaction · New Media & Society · 26 Sep 2013 · cited 15× · DOI ↗ · more like this ·

Although considerable research has identified patterns in online communication and interaction related to a range of individual characteristics, analyses of age have been limited, especially those that compare age groups. Research that does examine online communication by age largely focuses on linguistic elements. However, social identity approaches to group communication emphasize the importance of non-linguistic factors such as appearance and non-verbal behaviors. These factors are especially important to explore in online settings where traditional physical markers of age are largely unseen. To examine ways that users communicate age identity through both visual and textual means, we use multiple linear regression and qualitative methods to explore the behavior of 201 players of a custom game in the virtual world Second Life. Analyses of chat, avatar movement, and appearance suggest…

ILQUA--An IE-Driven Question Answering System.

Min Wu, Michelle Duan, Samira Shaikh +2 more

Artificial Intelligence · Text REtrieval Conference · 2005 · cited 15× · OpenAlex ↗ · more like this ·

ILQUA first participated in TREC QA main task in 2003. This year we have made modifications to the system by removing some components with poor performance and enhanced the system with new methods and new components. The newly built ILQUA is an IE-driven QA system. To answer “Factoid” and “List” questions, we apply our answer extraction methods on NE-tagged passages. The answer extraction methods adopted here are surface text pattern matching, n-gram proximity search and syntactic dependency matching. Surface text pattern matching has been applied in some previous TREC QA systems. However, the patterns used in ILQUA are automatically generated by a supervised learning system and represented in a format of regular expressions which can handle up to 4 question terms. N-gram proximity search and syntactic dependency matching are two steps of one component. N-grams of question terms are…