arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Donald

7,432 papers · 1852–2026

1967: 221968: 231969: 351970: 431971: 391972: 441973: 491974: 361975: 501976: 451977: 521978: 491979: 511980: 631981: 651982: 681983: 901984: 491985: 681986: 731987: 671988: 651989: 631990: 751991: 761992: 901993: 1051994: 1031995: 821996: 991997: 1181998: 1221999: 1422000: 1392001: 1382002: 1712003: 1892004: 1732005: 1972006: 2292007: 1772008: 1812009: 2532010: 2092011: 2032012: 1992013: 2302014: 2502015: 2682016: 1702017: 1232018: 1742019: 1512020: 1622021: 1702022: 1662023: 1702024: 1642025: 1522026: 216
1967peak 268 in 20152026

Frequent co-authors

Papers

showing 1–25 of 7,432 RSS

Emergent Abilities of Large Language Models

Jason Wei, Yi Tay, Rishi Bommasani +13 more

cs.CL · · cited 3,867× · arXiv ↗ · more like this ·

Scaling up language models has been shown to predictably improve performance and sample efficiency on a wide range of downstream tasks. This paper instead discusses an unpredictable phenomenon that we refer to as emergent abilities of large language models. We consider an ability to be emergent if it is not present in smaller models but is present in larger models. Thus, emergent abilities cannot be predicted simply by extrapolating the performance of smaller models. The existence of such emergence implies that additional scaling could further expand the range of capabilities of language models.

Using dynamic time warping to find patterns in time series

Donald J. Berndt, James Clifford

Signal Processing · Knowledge Discovery and Data Mining · · cited 2,900× · OpenAlex ↗ · more like this ·

Knowledge discovery in databases presents many interesting challenges within the context of providing computer tools for exploring large data archives. Electronic data repositories are growing quickly and contain data from commercial, scientific, and other domains. Much of this data is inherently temporal, such as stock prices or NASA telemetry data. Detecting patterns in such data streams or time series is an important knowledge discovery task. This paper describes some preliminary experiments with a dynamic programming approach to the problem. The pattern detection algorithm is based on the dynamic time warping technique used in the speech recognition field.

Wavelet methods for time series analysis

Percival, Donald B. 1946-, Walden, Andrew T. 1954-

Computer Vision and Pattern Recognition · Choice Reviews Online · · cited 2,607× · DOI ↗ · more like this ·

1. Introduction to wavelets 2. Review of Fourier theory and filters 3. Orthonormal transforms of time series 4. The discrete wavelet transform 5. The maximal overlap discrete wavelet transform 6. The discrete wavelet packet transform 7. Random variables and stochastic processes 8. The wavelet variance 9. Analysis and synthesis of long memory processes 10. Wavelet-based signal estimation 11. Wavelet analysis of finite energy signals Appendix. Answers to embedded exercises References Author index Subject index.

Causal Inference Using Potential Outcomes

Donald B. Rubin

Statistics and Probability · Journal of the American Statistical Association · · cited 2,167× · DOI ↗ · more like this ·

Causal effects are defined as comparisons of potential outcomes under different treatments on a common set of units. Observed values of the potential outcomes are revealed by the assignment mechanism—a probabilistic model for the treatment each unit receives as a function of covariates and potential outcomes. Fisher made tremendous contributions to causal inference through his work on the design of randomized experiments, but the potential outcomes perspective applies to other complex experiments and nonrandomized studies as well. As noted by Kempthorne in his 1976 discussion of Savage's Fisher lecture, Fisher never bridged his work on experimental design and his work on parametric modeling, a bridge that appears nearly automatic with an appropriate view of the potential outcomes framework, where the potential outcomes and covariates are given a Bayesian distribution to complete the…

Transitional objects and transitional phenomena 1 —a study of the first not-me possession 2

Donald W. Winnicott

Cultural Studies · PubMed · · cited 1,722× · DOI ↗ · more like this ·

This chapter introduces the terms "transitional object" and "transitional phenomena" for designation of the intermediate area of experience, between the oral erotism and true object-relationship, between primary creative activity and projection of what has already been introjected, between primary unawareness of indebtedness and the acknowledgement of indebtedness. It suggests that the pattern of transitional phenomena begins to show at about 4–6–8–12 months. As the infant starts to use organized sounds there may appear a "word" for the transitional object. When symbolism is employed the infant is already clearly distinguishing between fantasy and fact, between inner objects and external objects, between primary creativity and perception. But the term transitional object, gives room for the process of becoming able to accept difference and similarity. It is…

Efficient Transformers: A Survey

Yi Tay, Mostafa Dehghani, Dara Bahri +1 more

cs.LG · · cited 1,687× · arXiv ↗ · more like this ·

Transformer model architectures have garnered immense interest lately due to their effectiveness across a range of domains like language, vision and reinforcement learning. In the field of natural language processing for example, Transformers have become an indispensable staple in the modern deep learning stack. Recently, a dizzying number of "X-former" models have been proposed - Reformer, Linformer, Performer, Longformer, to name a few - which improve upon the original Transformer architecture, many of which make improvements around computational and memory efficiency. With the aim of helping the avid researcher navigate this flurry, this paper characterizes a large and thoughtful selection of recent efficiency-flavored "X-former" models, providing an organized and comprehensive overview of existing work and models across multiple domains.

Text Classification Algorithms: A Survey

Kamran Kowsari, Kiana Jafari Meimandi, Mojtaba Heidarysafa +3 more

cs.LG · · cited 1,585× · arXiv ↗ · more like this ·

In recent years, there has been an exponential growth in the number of complex documents and texts that require a deeper understanding of machine learning methods to be able to accurately classify texts in many applications. Many machine learning approaches have achieved surpassing results in natural language processing. The success of these learning algorithms relies on their capacity to understand complex models and non-linear relationships within data. However, finding suitable structures, architectures, and techniques for text classification is a challenge for researchers. In this paper, a brief overview of text classification algorithms is discussed. This overview covers different text feature extractions, dimensionality reduction methods, existing algorithms and techniques, and evaluations methods. Finally, the limitations of each technique and their application in the real-world…

The right to the city: social justice and the fight for public space

Donald G. Mitchell

Law · Choice Reviews Online · · cited 1,522× · DOI ↗ · more like this ·

"Presented are a series of linked cases that explore the judicial response to public demonstrations by early twentieth-century workers, and comparable legal issues surrounding anti-abortion protests today; the Free Speech Movement and the history of People's Park in Berkeley; and the plight of homeless people facing new laws against their presence in urban streets. The central focus is how political dissent gains meaning and momentum - and is regulated and policed - in the real, physical spaces of the city."--BOOK JACKET.

Generative metaphor: A perspective on problem-setting in social policy

Donald A. Schön

Sociology and Political Science · Cambridge University Press eBooks · · cited 1,150× · DOI ↗ · more like this ·

Much of the interest in metaphor on the part of linguists and philosophers of language has had to do with metaphor as a species of figurative language which needs explaining, or explaining away. (See, for a notable example, Searle, this volume. Two classic articles, Black, 1962b, and Beardsley, 1967, are also in this vein.) Metaphor, in this tradition, is a kind of anomaly of language, one which must be dispelled in order to clear the path for a general theory of reference or meaning. There is a very different tradition associated with the notion of metaphor, however – one which treats metaphor as central to the task of accounting for our perspectives on the world: how we think about things, make sense of reality, and set the problems we later try to solve. In this second sense, “metaphor” refers both to a certain kind of product – a perspective or frame, a way of looking at things –…

Assessing Sensitivity to an Unobserved Binary Covariate in an Observational Study with Binary Outcome

Peter Rosenbaum, Donald B. Rubin

Statistics and Probability · Journal of the Royal Statistical Society Series B (Statistical Methodology) · · cited 1,134× · DOI ↗ · more like this ·

SUMMARY This paper proposes a simple technique for assessing the range of plausible causal conclusions from observational studies with a binary outcome and an observed categorical covariate. The technique assesses the sensitivity of conclusions to assumptions about an unobserved binary covariate relevant to both treatment assignment and response. A medical study of coronary artery disease is used to illustrate the technique.

Review of surrogate modeling in water resources

Saman Razavi, Bryan A. Tolson, Donald H. Burn

Computational Theory and Mathematics · Water Resources Research · · cited 961× · DOI ↗ · more like this ·

Surrogate modeling, also called metamodeling, has evolved and been extensively used over the past decades. A wide variety of methods and tools have been introduced for surrogate modeling aiming to develop and utilize computationally more efficient surrogates of high‐fidelity models mostly in optimization frameworks. This paper reviews, analyzes, and categorizes research efforts on surrogate modeling and applications with an emphasis on the research accomplished in the water resources field. The review analyzes 48 references on surrogate modeling arising from water resources and also screens out more than 100 references from the broader research community. Two broad families of surrogates namely response surface surrogates, which are statistical or empirical data‐driven models emulating the high‐fidelity model responses, and lower‐fidelity physically based surrogates, which are…

Long Range Arena: A Benchmark for Efficient Transformers

Yi Tay, Mostafa Dehghani, Samira Abnar +7 more

cs.LG · · cited 950× · arXiv ↗ · more like this ·

Transformers do not scale very well to long sequence lengths largely because of quadratic self-attention complexity. In the recent months, a wide spectrum of efficient, fast Transformers have been proposed to tackle this problem, more often than not claiming superior or comparable model quality to vanilla Transformer models. To this date, there is no well-established consensus on how to evaluate this class of models. Moreover, inconsistent benchmarking on a wide spectrum of tasks and datasets makes it difficult to assess relative model quality amongst many models. This paper proposes a systematic and unified benchmark, LRA, specifically focused on evaluating model quality under long-context scenarios. Our benchmark is a suite of tasks consisting of sequences ranging from $1K$ to $16K$ tokens, encompassing a wide range of data types and modalities such as text, natural, synthetic images…

Unified Deep Supervised Domain Adaptation and Generalization

Saeid Motiian, Marco Piccirilli, Donald A. Adjeroh +1 more

cs.CV · · cited 901× · arXiv ↗ · more like this ·

This work provides a unified framework for addressing the problem of visual supervised domain adaptation and generalization with deep models. The main idea is to exploit the Siamese architecture to learn an embedding subspace that is discriminative, and where mapped visual domains are semantically aligned and yet maximally separated. The supervised setting becomes attractive especially when only few target data samples need to be labeled. In this scenario, alignment and separation of semantic probability distributions is difficult because of the lack of data. We found that by reverting to point-wise surrogates of distribution distances and similarities provides an effective solution. In addition, the approach has a high speed of adaptation, which requires an extremely low number of labeled target training samples, even one per category can be effective. The approach is extended to…

For objective causal inference, design trumps analysis

Donald B. Rubin

stat.AP · · cited 861× · arXiv ↗ · more like this ·

For obtaining causal inferences that are objective, and therefore have the best chance of revealing scientific truths, carefully designed and executed randomized experiments are generally considered to be the gold standard. Observational studies, in contrast, are generally fraught with problems that compromise any claim for objectivity of the resulting causal inferences. The thesis here is that observational studies have to be carefully designed to approximate randomized experiments, in particular, without examining any final outcome data. Often a candidate data set will have to be rejected as inadequate because of lack of data on key covariates, or because of lack of overlap in the distributions of key covariates between treatment and control groups, often revealed by careful propensity score analyses. Sometimes the template for the approximating randomized experiment will have to be…

Flowing Waters or Teeming Crowds: Mental Models of Electricity

Dedre Gentner, Donald R. Gentner

Artificial Intelligence · Psychology Press eBooks · · cited 713× · DOI ↗ · more like this ·

Analogical comparisons with simple or familiar systems occur often in people’s descriptions of complex systems, sometimes as explicit analogical models, and sometimes as implicit analogies, in which the person seems to borrow structure from the base domain without noticing it. Phrases like “ current being routed along a conductor,” or “ stopping the flow” of electricity are examples.

Who Drops Out of High School and Why? Findings from a National Study

Ruth B. Ekstrom, Margaret E. Goertz, Judith M. Pollack +1 more

Education · Teachers College Record The Voice of Scholarship in Education · · cited 705× · DOI ↗ · more like this ·

Using the most comprehensive data set on school dropouts that we have to date, the High School and Beyond study, Ruth Ekstrom, Margaret Goertz, Judith Pollack, and Donald Rock provide an analysis of the salient characteristics of the dropout population.

Quantization of diffeomorphism invariant theories of connections with local degrees of freedom

Abhay Ashtekar, Jerzy Lewandowski, Donald Marolf +2 more

gr-qc · · cited 642× · arXiv ↗ · more like this ·

Quantization of diffeomorphism invariant theories of connections is studied. A solutions of the diffeomorphism constraints is found. The space of solutions is equipped with an inner product that is shown to satisfy the physical reality conditions. This provides, in particular, a quantization of the Husain-Kuchař model. The main results also pave way to quantization of other diffeomorphism invariant theories such as general relativity. In the Riemannian case (i.e., signature ++++), the approach appears to contain all the necessary ingredients already. In the Lorentzian case, it will have to combined in an appropriate fashion with a coherent state transform to incorporate complex connections.

BEOWULF: A Parallel Workstation for Scientific Computation.

Thomas Sterling, Daniel Savarese, Donald Becker +3 more

Computer Networks and Communications · Proceedings of the International Conference on Parallel Processing · · cited 597× · OpenAlex ↗ · more like this ·

Network-of-Workstations technology is applied to the challenge of implementing very high performance workstations for Earth and space science applications. The Beowulf parallel workstation employs 16 PCbased processing modules integrated with multiple Ethernet networks. Large disk capacity and high disk to memory bandwidth is achieved through the use of a hard disk and controller for each processing module supporting up to 16 way concurrent accesses. The paper presents results from a series of experiments that measure the scaling characteristics of Beowulf in terms of communication bandwidth, file transfer rates, and processing performance. The evaluation includes a computational fluid dynamics code and an N-body gravitational simulation program. It is shown that the Beowulf architecture provides a new operating point in performance to cost for high performance workstations, especially…

U.S. Senators and Their World.

Gilbert Y. Steiner, Donald R. Matthews

Political Science and International Relations · Midwest Journal of Political Science · · cited 560× · DOI ↗ · more like this ·

At a time when the effectiveness of Congress is increasingly being questioned, this pioneering study takes on new significance. Drawing on extensive interviews with senators, Senate staff members, lobbyists, and Washington journalists, U.S. Senators and Their World is the first book to give a detailed picture of the inside workings of the United States Senate. The book's description of the Senate's structure and day-to-day functioning provides valuable pertinent information on the role of the legislative branch and its relation to other branches of government. When U.S. Senators and Their World was originally published, John F. Kennedy commented, This profile of the Senate is sharp, perceptive, instructive, and entertaining. Here, with anecdotes and critical comments, with charts and statistics, is the world of a United States Senator. In these careful pages one can see the strengths…

Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting

Zhen Qin, Rolf Jagerman, Kai Hui +9 more

cs.IR · · cited 512× · arXiv ↗ · more like this ·

Ranking documents using Large Language Models (LLMs) by directly feeding the query and candidate documents into the prompt is an interesting and practical problem. However, researchers have found it difficult to outperform fine-tuned baseline rankers on benchmark datasets. We analyze pointwise and listwise ranking prompts used by existing methods and argue that off-the-shelf LLMs do not fully understand these challenging ranking formulations. In this paper, we propose to significantly reduce the burden on LLMs by using a new technique called Pairwise Ranking Prompting (PRP). Our results are the first in the literature to achieve state-of-the-art ranking performance on standard benchmarks using moderate-sized open-sourced LLMs. On TREC-DL 2019&2020, PRP based on the Flan-UL2 model with 20B parameters performs favorably with the previous best approach in the literature, which is based on…

Transformer Memory as a Differentiable Search Index

Yi Tay, Vinh Q. Tran, Mostafa Dehghani +10 more

cs.CL · · cited 505× · arXiv ↗ · more like this ·

In this paper, we demonstrate that information retrieval can be accomplished with a single Transformer, in which all information about the corpus is encoded in the parameters of the model. To this end, we introduce the Differentiable Search Index (DSI), a new paradigm that learns a text-to-text model that maps string queries directly to relevant docids; in other words, a DSI model answers queries directly using only its parameters, dramatically simplifying the whole retrieval process. We study variations in how documents and their identifiers are represented, variations in training procedures, and the interplay between models and corpus sizes. Experiments demonstrate that given appropriate design choices, DSI significantly outperforms strong baselines such as dual encoder models. Moreover, DSI demonstrates strong generalization capabilities, outperforming a BM25 baseline in a zero-shot…

HDLTex: Hierarchical Deep Learning for Text Classification

Kamran Kowsari, Donald E. Brown, Mojtaba Heidarysafa +3 more

cs.LG · · cited 504× · arXiv ↗ · more like this ·

The continually increasing number of documents produced each year necessitates ever improving information processing methods for searching, retrieving, and organizing text. Central to these information processing methods is document classification, which has become an important application for supervised learning. Recently the performance of these traditional classifiers has degraded as the number of documents has increased. This is because along with this growth in the number of documents has come an increase in the number of categories. This paper approaches this problem differently from current document classification methods that view the problem as multi-class classification. Instead we perform hierarchical classification using an approach we call Hierarchical Deep Learning for Text classification (HDLTex). HDLTex employs stacks of deep learning architectures to provide specialized…

The birth of the giant component

Svante Janson, Donald E. Knuth, Tomasz Łuczak +1 more

math.PR · · cited 491× · arXiv ↗ · more like this ·

Limiting distributions are derived for the sparse connected components that are present when a random graph on $n$ vertices has approximately $\half n$ edges. In particular, we show that such a graph consists entirely of trees, unicyclic components, and bicyclic components with probability approaching $\sqrt{2\over 3} \cosh\sqrt{5\over 18}\approx0.9325$ as $n\to\infty$. The limiting probability that it consists of trees, unicyclic components, and at most one other component is approximately 0.9957; the limiting probability that it is planar lies between 0.987 and 0.9998. When a random graph evolves and the number of edges passes $\half n$, its components grow in cyclic complexity according to an interesting Markov process whose asymptotic structure is derived. The probability that there never is more than a single component with more edges than vertices, throughout the evolution…

Cheating among college and university students: A North American perspective

Donald L. McCabe

Safety Research · International Journal for Educational Integrity · · cited 444× · DOI ↗ · more like this ·

Academic integrity is an issue of critical importance to academic institutions and has been gaining increasing interest among scholars in the last few decades. This article discusses data obtained over the last three years from over 80,000 students and 12,000 faculty in the United States and Canada. While documenting that cheating on tests and exams and plagiarism are significant issues on our college and university campuses, it also offers some thoughts on possible strategies to encourage greater levels of academic integrity among students.

Global versus local search in constrained optimization of computer models

Matthias Schonlau, William J. Welch, Donald R. Jones

Computational Theory and Mathematics · Lecture notes-monograph series · · cited 437× · DOI ↗ · more like this ·

Engineering systems are now frequently optimized via computer models.The inputoutput relationships in these models are often highly nonlinear deterministic functions that are expensive to compute.Thus, when searching for the global optimum, it is desirable to minimize the number of function evaluations.Bayesian global optimization methods are well-suited to this task because they make use of all previous evaluations in selecting the next search point.A statistical model is fit to the sampled points which allows predictions to be made elsewhere, along with a measure of possible prediction error (uncertainty).The next point is chosen to maximize a criterion that balances searching where the predicted value of the function is good (local search) with searching where the uncertainty of prediction is large (global search).We extend this methodology in several ways.First, we introduce a…