arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Adam Berger

32 papers · 1994–2026

1994: 11995: 01996: 21997: 31998: 31999: 22000: 52001: 02002: 22003: 22004: 02005: 02006: 02007: 12008: 02009: 02010: 02011: 02012: 02013: 12014: 02015: 02016: 12017: 12018: 02019: 12020: 12021: 02022: 32023: 02024: 02025: 22026: 1
1994peak 5 in 20002026

Frequent co-authors

Papers

showing 1–25 of 32 RSS

A maximum entropy approach to natural language processing

Adam Berger, Vincent J. Della Pietra, Stephen A. Della Pietra

Artificial Intelligence · Computational Linguistics · · cited 3,132× · DOI ↗ · more like this ·

The concept of maximum entropy can be traced back along multiple threads to Biblical times. Only recently, however, have computers become powerful enough to permit the widescale application of this concept to real world problems in statistical estimation and pattern recognition. In this paper we describe a method for statistical modeling based on maximum entropy. We present a maximum-likelihood approach for automatically constructing maximum entropy models and describe how to implement this approach efficiently, using as examples several problems in natural language processing.

Information Retrieval as Statistical Translation

Adam Berger, John Lafferty

Artificial Intelligence · ACM SIGIR Forum · · cited 631× · DOI ↗ · more like this ·

We propose a new probabilistic approach to information retrieval based upon the ideas and methods of statistical machine translation. The central ingredient in this approach is a statistical model of how a user might distill or "translate" a given document into a query. To assess the relevance of a document to a user's query, we estimate the probability that the query would have been generated as a translation of the document, and factor in the user's general preferences in the form of a prior distribution over documents. We propose a simple, well motivated model of the document-to-query translation process, and describe an algorithm for learning the parameters of this model in an unsupervised manner from a collection of documents. As we show, one can view this approach as a generalization and justification of the "language modeling" strategy recently proposed by Ponte and Croft. In a…

Bridging the lexical chasm

Adam Berger, Rich Caruana, David Cohn +2 more

Artificial Intelligence · · cited 309× · DOI ↗ · more like this ·

This paper investigates whether a machine can automatically learn the task of finding, within a large collection of candidate responses, the answers to questions. The learning process consists of inspecting a collection of answered questions and characterizing the relation between question and answer with a statistical model. For the purpose of learning this relation, we propose two sources of data: Usenet FAQ documents and customer service call-center dialogues from a large retail company. We will show that the task of “answer-finding” differs from both document retrieval and tradition question-answering, presenting challenges different from those found in these problems. The central aim of this work is to discover, through theoretical and empirical investigation, those statistical techniques best suited to the answer-finding problem.

Text Segmentation Using Exponential Models

Doug Beeferman, Adam Berger, John Lafferty

cmp-lg · · cited 157× · arXiv ↗ · more like this ·

This paper introduces a new statistical approach to partitioning text automatically into coherent segments. Our approach enlists both short-range and long-range language models to help it sniff out likely sites of topic changes in text. To aid its search, the system consults a set of simple lexical hints it has learned to associate with the presence of boundaries through inspection of a large corpus of annotated data. We also propose a new probabilistically motivated error metric for use by the natural language processing and information retrieval communities, intended to supersede precision and recall for appraising segmentation algorithms. Qualitative assessment of our algorithm as well as evaluation using this new metric demonstrate the effectiveness of our approach in two very different domains, Wall Street Journal articles and the TDT Corpus, a collection of newswire articles and…

OCELOT

Adam Berger, Vibhu O. Mittal

Artificial Intelligence · · cited 144× · DOI ↗ · more like this ·

We introduce OCELOT, a prototype system for automatically generating the “gist” of a web page by summarizing it. Although most text summarization research to date has focused on the task of news articles, web pages are quite different in both structure and content. Instead of coherent text with a well-defined discourse structure, they are more often likely to be a chaotic jumble of phrases, links, graphics and formatting commands. Such text provides little foothold for extractive summarization techniques, which attempt to generate a summary of a document by excerpting a contiguous, coherent span of text from it. This paper builds upon recent work in non-extractive summarization, producing the gist of a web page by “translating” it into a more concise representation rather than attempting to extract a text span verbatim. OCELOT uses probabilistic models to guide it in selecting and…

The Candide system for machine translation

Adam Berger, Peter F. Brown, Stephen A. Della Pietra +6 more

Artificial Intelligence · · cited 141× · DOI ↗ · more like this ·

We present an overview of Candide, a system for automatic translation of French text to English text. Candide uses methods of information theory and statistics to develop a probability model of the translation process. This model, which is made to accord as closely as possible with a large body of French and English sentence pairs, is then used to generate English translations of previously unseen French sentences. This paper provides a tutorial in these methods, discussions of the training and operation of the system, and a summary of test results.

A Model of Lexical Attraction and Repulsion

Doug Beeferman, Adam Berger, John Lafferty

cmp-lg · · cited 110× · arXiv ↗ · more like this ·

This paper introduces new methods based on exponential families for modeling the correlations between words in text and speech. While previous work assumed the effects of word co-occurrence statistics to be constant over a window of several hundred words, we show that their influence is nonstationary on a much smaller time scale. Empirical data drawn from English and Japanese text, as well as conversational speech, reveals that the ``attraction'' between words decays exponentially, while stylistic and syntactic contraints create a ``repulsion'' between words that discourages close co-occurrence. We show that these characteristics are well described by simple mixture models based on two-stage exponential distributions which can be trained using the EM algorithm. The resulting distance distributions can then be incorporated as penalizing features in an exponential language model.

Cyberpunc: a lightweight punctuation annotation system for speech

Doug Beeferman, Adam Berger, John Lafferty

Artificial Intelligence · · cited 85× · DOI ↗ · more like this ·

This paper describes a lightweight method for the automatic insertion of intra-sentence punctuation into text. Despite the intuition that pauses in an acoustic stream are a positive indicator for some types of punctuation, this work will demonstrate the feasibility of a system which relies solely on lexical information. Besides its potential role in a speech recognition system, such a system could serve equally well in non-speech applications such as automatic grammar correction in a word processor and parsing of spoken text. After describing the design of a punctuation-restoration system, which relies on a trigram language model and a straightforward application of the Viterbi algorithm, we summarize results, both quantitative and subjective, of the performance and behavior of a prototype system.

Query-relevant summarization using FAQs

Adam Berger, Vibhu O. Mittal

Artificial Intelligence · · cited 85× · DOI ↗ · more like this ·

This paper introduces a statistical model for query-relevant summarization: succinctly characterizing the relevance of a document to a query. Learning parameter values for the proposed model requires a large collection of summarized documents, which we do not have, but as a proxy, we use a collection of FAQ (frequently-asked question) documents. Taking a learning approach enables a principled, quantitative evaluation of the proposed system, and the results of some initial experiments---on a collection of Usenet FAQs and on a FAQ-like set of customer-submitted questions to several large retail companies---suggest the plausibility of learning for summarization.

The Improved Iterative Scaling Algorithm A Gentle Introduction

Adam J. Berger

Artificial Intelligence · · cited 68× · OpenAlex ↗ · more like this ·

This note concerns the improved iterative scaling algorithm for computing maximum likelihood estimates of the parameters of exponential models The algorithm was invented by members of the machine translation group at IBM s T J Watson Research Center in the early s The goal here is to motivate the improved iterative scaling algorithm for conditional models in a way that is as complete and self contained as possible yet minimizes the mathematical burden on the reader

Just-in-time language modelling

Adam Berger, Robert J. Miller

Artificial Intelligence · · cited 52× · DOI ↗ · more like this ·

Traditional approaches to language modelling have relied on a fixed corpus of text to inform the parameters of a probability distribution over word sequences. Increasing the corpus size often leads to better-performing language models, but no matter how large, the corpus is a static entity, unable to reflect information about events which postdate it. We introduce an online paradigm which interleaves the estimation and application of a language model. We present a Bayesian approach to online language modelling, in which the marginal probabilities of a static trigram model are dynamically updated to match the topic being dictated to the system. We also describe the architecture of a prototype we have implemented which uses the World Wide Web (WWW) as a source of information, and provide results from some initial proof of concept experiments.

Virtual Tumor Board Increases Provider Attendance and Case Presentations

Catherine H. Davis, Jason Ho, Ryan D. Stephenson +6 more

Sociology and Political Science · JCO Oncology Practice · · cited 24× · DOI ↗ · more like this ·

PURPOSE: Many cancer centers engage in multidisciplinary tumor board meetings to determine the optimal approach to complex cancer care. With the onset of the COVID-19 pandemic, many institutions changed the format of these meetings from in-person to virtual. The aim of this study was to determine if the change to a virtual meeting format had an impact on attendance and cases presented. METHODS: Tumor board records were analyzed to obtain attendance and case presentation information at a National Cancer Institute–designated Comprehensive Cancer Center. Twelve-month in-person tumor board data were compared with 12-month virtual tumor board data to assess for difference in attendance and case presentation patterns. RESULTS: Seven separate weekly tumor board meetings at the beginning of the study (breast, GI, gynecology, liver, lung, melanoma, and urology) were expanded to nine meetings on…

The Weaver System for Document Retrieval.

Adam Berger, John Lafferty

Artificial Intelligence · Text REtrieval Conference · · cited 18× · OpenAlex ↗ · more like this ·

This paper introduces Weaver, a probabilistic document retrieval system under development at Carnegie Mellon University, and discusses its performance in the TREC-8 ad hoc evaluation. We begin by describing the architecture and philosophyoftheWeaver system, which represents a departure from traditional approaches to retrieval. The central ingredient is a statistical model of how a user might distill or "translate" a given documentinto a query. The retrieval-as-translation approach is based on the noisy channel paradigm and statistical language modeling, and has much in common with other recently proposed models [12, 10]. After the initial high-level overview, the bulk of the paper contains a discussion of implementation details and the empirical performance of the Weaver retrieval system. 1 Introduction This paper introduces the Weaver system for document retrieval…

A Comparison of Criteria for Maximum Entropy/ Minimum Divergence Feature Selection

Adam Berger, Harry Printz

Computer Vision and Pattern Recognition · Empirical Methods in Natural Language Processing · · cited 12× · OpenAlex ↗ · more like this ·

In this paper we study the gain, a naturally-arising statistic from the theory of memd modeling [2], as a figure of merit for selecting features for an memd language model. We compare the gain with two popular alternatives---empirical activation and mutual information---and argue that the gain is the preferred statistic, on the grounds that it directly measures a feature 's contribution to improving upon the base model. Introduction Maximum entropy / minimum divergence (memd) modeling is a powerful technique for building statistical models of linguistic phenomena. It has been applied to problems as diverse as machine translation [2], parsing [10], word morphology [5] and language modeling [6, 11, 3, 9]. The heart of the method is to choose a collection of informative features, each encoding some linguistically significant event, and then to incorporate these features into a…

Nature-based solutions as water management measures in Hungary

László Balatonyi, Bálint Lengyel, General Directorate of Water Management +1 more

Geography, Planning and Development · Modern Geográfia · · cited 8× · DOI ↗ · more like this ·

Climate change, loss of biodiversity and degradation of ecosystems are all linked and have devastating consequences for our socio-economic stability, health and well-being. Working with nature is increasingly recognized as an efficient way to tackle these growing challenges, according to the new EEA report ‘Nature-based solutions in Europe: Policy, knowledge and practice for climate change adaptation and disaster risk reduction.’ In line with the basin wide updated flood risk strategy like International Commission for the Protection of the Danube River (hereafter: ICPDR) Flood Risk Management Plans 2021. Multilevel action plans have been developed. The EU level plans, such as the EU Strategy for the Danube Region, from the geographical point of view (for example: EU Green Deal) are mainly based on watersheds and on macro-regional scale. However, at the same time, counties should…

Recognition performance of a large-scale dependency grammar language model

Adam Berger, Harry Printz

Artificial Intelligence · · cited 5× · DOI ↗ · more like this ·

In this paper, we describe a large-scale investigation of dependency grammar language models. Our work includes several significant departures from earlier studies, notably a larger training corpus, improved model structure, different feature types, new feature selection methods, and more coherent training and test data. We report word error rate (wer) results of a speech recognition experiment, in which we used these models to rescore the output of the IBM speech recognition system. 1. INTRODUCTION One promising idea for advancing statistical language modeling is based upon dependency grammars, as reported in [4]. This work has the appeal of integrating, via the maximum entropy / minimum divergence (memd) technique, information from both syntax and ngrams. Moreover, unlike methods based upon context free grammars, grammatical information enters through the words themselves, rather than…

Water resources management and its homeland security aspect in Hungary

László Balatonyi, Krisztina Ligetvári, László Tóth +1 more

Geography, Planning and Development · Scientia et Securitas · · cited 4× · DOI ↗ · more like this ·

Summary. As a consequence of climate change, extreme weather events will have a profound impact on water resources, environmental security and long-term social compatibility. This is particularly true in the Danube river basin countries. Declining water resources and increasing foreign water use due to climate change could pose a serious security challenge for Hungary in the future. This is because our water resources are significant, but also vulnerable, as more than 95 percent of the water in our watercourses comes from across the border. This case study summarises the floods in the DRB over the last two decades and provides a more detailed analysis of Hungary. It also assesses water-related risks as a domestic security issue, based on national and international literature. Összefoglalás. A szélsőséges időjárási körülmények, mint az éghajlatváltozás következményei, negatívan hatnak a…

Asynchronous monad for reactive IoT programming

Zhao Tian, Adam Berger, Yonglun Li

Hardware and Architecture · · cited 4× · DOI ↗ · more like this ·

Many industrial IoT applications process sensor data over distributed networks to monitor devices in real-time. Since the sensor telemetries are transmitted over networks as events, imperative and event-driven programs are often used to handle IoT data. However, the inverted control flow and shared global states of these imperative programs make them difficult to interface with synchronized computation on IoT data. This problem is further complicated for high-frequency data such as electric signals, which may require dynamic adjustment to data sampling rate to operate under the constraints of network and system.

Cross of prime number occurrences, Krzyż występowania liczb pierwszych

Adam Berger

Algebra and Number Theory · Zenodo (CERN European Organization for Nuclear Research) · · cited 0× · DOI ↗ · more like this ·

I wanted to introduce you to a work on prime numbers, specifically why they appear there and why they appear there and not elsewhere. I'm starting with 3 as the right-hand prime number, because it wasn't excluded by the previous prime, 2. The rest of the work, presenting the concept, formulas, and the prime number cross, can be found in the attached PDF. Enjoy reading. Chciałem Państwa zapoznać z pracą na temat liczb pierwszych, a dokładniej dlaczego się pojawiają i dlaczego tam, a nie gdzie indziej. Zaczynam od 3 jako liczby pierwszej od prawj strony, ponieważ nie została wykluczona przez poprzednią liczbę pierwszą jaką jest 2. Reszta przedstawiająca koncepcję, wzory oraz krzyż liczb pierwszych w załączonym PDF. Miłej lektury. Euklides, Eratostenes, Bernhard Riemann, Pierre de Fermat, Leonhard Euler, Christian Goldbach, Stanisław Ulam, Wacław Sierpiński, Henryk Iwaniec, Diofantos, Carl…

Cross of prime number occurrences - prime number geometric exclusion field

Adam Berger

Algebra and Number Theory · Zenodo (CERN European Organization for Nuclear Research) · · cited 0× · DOI ↗ · more like this ·

I wanted to introduce you to a work on prime numbers, specifically why they appear there and why they appear there and not elsewhere. I'm starting with 3 as the right-hand prime number, because it wasn't excluded by the previous prime, 2. The rest of the work, presenting the concept, formulas, and the prime number cross, can be found in the attached PDF. Enjoy reading. Chciałem Państwa zapoznać z pracą na temat liczb pierwszych, a dokładniej dlaczego się pojawiają i dlaczego tam, a nie gdzie indziej. Zaczynam od 3 jako liczby pierwszej od prawj strony, ponieważ nie została wykluczona przez poprzednią liczbę pierwszą jaką jest 2. Reszta przedstawiająca koncepcję, wzory oraz krzyż liczb pierwszych w załączonym PDF. Miłej lektury. Euklides, Eratostenes, Bernhard Riemann, Pierre de Fermat, Leonhard Euler, Christian Goldbach, Stanisław Ulam, Wacław Sierpiński, Henryk Iwaniec, Diofantos, Carl…

Detection of Merkel Cell Carcinoma Polyomavirus in

Mucosal Merkel, Cell Carcinoma, Karen N. Wu +5 more

Sociology and Political Science · · cited 0× · OpenAlex ↗ · more like this ·

A 61-year-old woman presented with solitary lymphadenopathy suspicious for lymphoma. An excisional biopsy of a right inguinal lymph node demonstrated metastatic Merkel cell carcinoma (MCC). No skin lesions were detected, but a primary nasopharyngeal mass was identified. A microscopic examination of the nasopharyngeal tumor and the lymph node metastasis showed a monotonous population of small- to intermediate-sized, round blue cells with vesicular nuclei, finely granular and dusty chromatin, and multiple nucleoli. Immunohistochemistry showed perinuclear dot-like staining for cytokeratins AE1/AE3 and CK20. Microscopic appearance and immunohistochemical stains were consistent with MCC. MCC was recently shown to harbor a novel polyomavirus, Merkel cell polyomavirus (MCPyV), in the majority of cases. In this case, MCPyV was detected in the primary tumor and metastasis using polymerase chain…

Recent Residency Program Graduate Pledges Ongoing Support

Thomas Jefferson, Jennifer Brumbaugh, Susan Murphy +9 more

Gender Studies · The Medicine Forum · · cited 0× · OpenAlex ↗ · more like this ·

After graduating from Jefferson’s surgical residency program in 2008, Negar Golesorkhi, MD, went on to complete a prestigious breast surgical oncology fellowship at Allegheny Medical Center. She has since returned to her native Virginia where she is in private practice at the National Breast Center in Lorton. Just a few years into her practice, Dr. Golesorkhi has already pledged to support the surgical residency program that trained and prepared her so well. Dr. Golesorkhi’s commitment to the newly established Surgical Alumni for Education Fund will support academic enrichment for a surgical resident each year. “Surgical residency education is dual-faceted,” she says, “One aspect is focused on hands on clinical practice of general surgery and the other aspect is preparing to be credentialed.” Dr. Golesorkhi recalls the challenge of studying for the boards on her own, with assistance…

Information as Statistical Translation

Adam Berger, John Lafferty

Information Systems · · cited 0× · OpenAlex ↗ · more like this ·

We propose a new probabilistic approach to information retrieval based upon the ideas and methods of statistical machine translation. The central ingredientinthis approach is a statistical model of how a user might distill or "translate" a given document into a query. To assess the relevance of a document to a user's query, we estimate the probability that the query would have been generated as a translation of the document, and factor in the user's general preferences in the form of a prior distribution over documents. We propose a simple, well motivated model of the document-to-query translation process, and describe an algorithm for learning the parameters of this model in an unsupervised manner from a collection of documents. As we show, one can view this approach as a generalization and justification of the "language modeling&quot…

Modifying agent systems for an open, dynamic agent environment

Adam Berger, Robert R. Kessler

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Most agent systems today are closed and static. That is, one builds agent systems in which the set of agents is specified ahead of time and ontologies and protocols are predefined. Today's Internet is open and dynamic. We describe a new approach to constructing agents that matches the open, dynamic environment of the Internet, and the supporting infrastructure required to make such an approach work. This includes the use of a central dictionary of well-defined keywords and a simplified interaction protocol that better fits a dynamic environment by enabling greater flexibility and adaptation over time.