arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Gary

7,993 papers · 1842–2026

1967: 41968: 91969: 81970: 121971: 91972: 81973: 191974: 201975: 181976: 341977: 271978: 431979: 341980: 461981: 291982: 501983: 411984: 341985: 431986: 451987: 581988: 571989: 501990: 651991: 741992: 771993: 1091994: 1111995: 1171996: 1171997: 1071998: 1411999: 1782000: 1642001: 1692002: 2152003: 2432004: 2052005: 2352006: 2162007: 2182008: 2692009: 2292010: 3522011: 2642012: 2802013: 2562014: 2752015: 2252016: 1562017: 1492018: 1962019: 2022020: 1892021: 2272022: 2102023: 2092024: 2442025: 2992026: 285
1967peak 352 in 20102026

Frequent co-authors

Papers

showing 1–25 of 7,993 RSS

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Gemini Team, Petko Georgiev, Ving Ian Lei +1134 more

cs.CL · · cited 4,033× · arXiv ↗ · more like this ·

In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. The family includes two new models: (1) an updated Gemini 1.5 Pro, which exceeds the February version on the great majority of capabilities and benchmarks; (2) Gemini 1.5 Flash, a more lightweight variant designed for efficiency with minimal regression in quality. Gemini 1.5 models achieve near-perfect recall on long-context retrieval tasks across modalities, improve the state-of-the-art in long-document QA, long-video QA and long-context ASR, and match or surpass Gemini 1.0 Ultra's state-of-the-art performance across a broad set of benchmarks. Studying the limits of Gemini 1.5's…

Gemma 2: Improving Open Language Models at a Practical Size

Gemma Team, Morgane Riviere, Shreya Pathak +195 more

cs.CL · · cited 2,513× · arXiv ↗ · more like this ·

In this work, we introduce Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters. In this new version, we apply several known technical modifications to the Transformer architecture, such as interleaving local-global attentions (Beltagy et al., 2020a) and group-query attention (Ainslie et al., 2023). We also train the 2B and 9B models with knowledge distillation (Hinton et al., 2015) instead of next token prediction. The resulting models deliver the best performance for their size, and even offer competitive alternatives to models that are 2-3 times bigger. We release all our models to the community.

Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks

Jierun Chen, Shiu-hong Kao, Hao He +4 more

cs.CV · · cited 2,039× · arXiv ↗ · more like this ·

To design fast neural networks, many works have been focusing on reducing the number of floating-point operations (FLOPs). We observe that such reduction in FLOPs, however, does not necessarily lead to a similar level of reduction in latency. This mainly stems from inefficiently low floating-point operations per second (FLOPS). To achieve faster networks, we revisit popular operators and demonstrate that such low FLOPS is mainly due to frequent memory access of the operators, especially the depthwise convolution. We hence propose a novel partial convolution (PConv) that extracts spatial features more efficiently, by cutting down redundant computation and memory access simultaneously. Building upon our PConv, we further propose FasterNet, a new family of neural networks, which attains substantially higher running speed than others on a wide range of devices, without compromising on…

Intergenerational Income Mobility in the United States

Gary Solon

Sociology and Political Science · American Economic Review · · cited 1,669× · OpenAlex ↗ · more like this ·

Social scientists and policy analysts have long expressed concern about the extent of intergenerational income mobility in the United States, but remarkably little empirical evidence is available. The few existing estimates of the intergenerational correlation in income have been biased downward by measurement error, unrepresentative samples, or both. New estimates based on intergenerational data from the Panel Study of Income Dynamics imply that the intergenerational correlation in long-run income is at least 0.4, indicating dramatically less mobility than suggested by earlier research. Copyright 1992 by American Economic Association.

Development and Social Change, a Global Perspective

Gary Teeple, Philip McMichael

Development · Labour / Le Travail · · cited 1,543× · DOI ↗ · more like this ·

About the Author Foreword Preface to the Fourth Edition A Timeline of Developmentalism and Globalism Acknowledgments Abbreviations Chapter 1: Development and Globalization: Framing Issues What Is the World Coming to? The Global Marketplace Global Interdependencies The Lifestyle Connection The Development Lifestyle The Project of Development Part I: The Developmen Project (Late 1940s to Early 1970s) Chapter 2: Instituting the Development Project Colonialism Decolonization Decolonization and Development Postwar Decolonization and the Rise of the Third World Ingredients of the Development Project Framing the Development Project Economic Nationalism Summary Chapter 3: The Development Project: International Relations The International Framework Remaking the International Division of Labor The Food-Aid Regime Remaking Third World Agricultures Summary Part II: From National Development to…

An Economic Analysis of Fertility

Gary S. Becker

Gender Studies · RePEc: Research Papers in Economics · · cited 1,276× · OpenAlex ↗ · more like this ·

THE inability of demographers to predict western birth rates accurately in the postwar period has had a salutary influence on demographic research. Most predictions had been based either on simple extrapolations of past trends or on extrapolations that adjusted for changes in the agesex-marital composition of the population. Socio-economic considerations are entirely absent from the former and are primitive and largely implicit in the latter. As long as even crude extrapolations continued to give fairly reliable predictions, as they did during the previous half century, there was little call for complicated analyses of the interrelation between socio-economic variables and fertility. However, the sharp decline in birth rates during the thirties coupled with the sharp rise in rates during the postwar period swept away confidence in the view that future rates could be predicted from a…

Multiobjective evolutionary algorithms: classifications, analyses, and new innovations

Gary B. Lamont, David A. Van Veldhuizen

Computational Theory and Mathematics · · cited 1,221× · OpenAlex ↗ · more like this ·

Abstract : This research organizes, presents, and analyzes contemporary Multiobjective Evolutionary Algorithm (MOEA) research and associated Multiobjective Optimization Problems (MOPs). Using a consistent MOEA terminology and notation, each cited MOEAs' key factors are presented in tabular form for ease of MOEA identification and selection. A detailed quantitative and qualitative MOEA analysis is presented, providing a basis for conclusions about various MOEA-related issues. The traditional notion of building blocks is extended to the MOP domain in an effort to develop more effective and efficient MOEAs. Additionally, the MOEA community's limited test suites contain various functions whose origins and rationale for use are often unknown. Thus, using general test suite guidelines appropriate MOEA test function suites are substantiated and generated. An experimental methodology…

Deep Learning: A Critical Appraisal

Gary Marcus

cs.AI · · cited 1,212× · arXiv ↗ · more like this ·

Although deep learning has historical roots going back decades, neither the term "deep learning" nor the approach was popular just over five years ago, when the field was reignited by papers such as Krizhevsky, Sutskever and Hinton's now classic (2012) deep network model of Imagenet. What has the field discovered in the five subsequent years? Against a background of considerable progress in areas such as speech recognition, image recognition, and game playing, and considerable enthusiasm in the popular press, I present ten concerns for deep learning, and suggest that deep learning must be supplemented by other techniques if we are to reach artificial general intelligence.

Agnostic Federated Learning

Mehryar Mohri, Gary Sivek, Ananda Theertha Suresh

cs.LG · · cited 1,171× · arXiv ↗ · more like this ·

A key learning scenario in large-scale applications is that of federated learning, where a centralized model is trained based on data originating from a large number of clients. We argue that, with the existing training and inference, federated models can be biased towards different clients. Instead, we propose a new framework of agnostic federated learning, where the centralized model is optimized for any target distribution formed by a mixture of the client distributions. We further show that this framework naturally yields a notion of fairness. We present data-dependent Rademacher complexity guarantees for learning with this objective, which guide the definition of an algorithm for agnostic federated learning. We also give a fast stochastic optimization algorithm for solving the corresponding optimization problem, for which we prove convergence bounds, assuming a convex loss function…

Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

Yizhong Wang, Swaroop Mishra, Pegah Alipoormolabashi +37 more

cs.CL · · cited 1,144× · arXiv ↗ · more like this ·

How well can NLP models generalize to a variety of unseen tasks when provided with task instructions? To address this question, we first introduce Super-NaturalInstructions, a benchmark of 1,616 diverse NLP tasks and their expert-written instructions. Our collection covers 76 distinct task types, including but not limited to classification, extraction, infilling, sequence tagging, text rewriting, and text composition. This large and diverse collection of tasks enables rigorous benchmarking of cross-task generalization under instructions -- training models to follow instructions on a subset of tasks and evaluating them on the remaining unseen ones. Furthermore, we build Tk-Instruct, a transformer model trained to follow a variety of in-context instructions (plain language task definitions or k-shot examples). Our experiments show that Tk-Instruct outperforms existing…

A research companion to Principles and standards for school mathematics

Jeremy Kilpatrick, W. Gary Martin, Deborah Schifter

Education · Medical Entomology and Zoology · · cited 1,132× · OpenAlex ↗ · more like this ·

This useful companion to Principles and Standards is for anyone seeking to explore the underpinnings of that document in the scholarly literature. It synthesises a sizeable portion of the professional literature to lend valuable insight into current thinking about school mathematics and presents a comprehensive analysis of what research should be expected to do in setting standards for school mathematics.

Student engagement and achievement in American secondary schools

<vcard>BEGIN:vCard\VERSION:3.0\FN:B. Bradford Brown\ORG:University of Wisconsin-Madison\ADR;TYPE=WORK,POSTAL,PARCEL:;;1000 Bascom Mall;Suite 377;Madison;WI;53706;US\END:vCard</vcard>, <vcard>BEGIN:vCard\VERSION:3.0\FN:Adam Gamoran\ORG:University of Wisconsin-Madison\ADR;TYPE=WORK,POSTAL,PARCEL:;;1025 W. Johnson St.;;Madison;WI;53706;US\END:vCard</vcard>, <vcard>BEGIN:vCard\VERSION:3.0\FN:Susie D. Lamborn\ORG:University of Wisconsin-Madison\ADR;TYPE=WORK,POSTAL,PARCEL:;;1000 Bascom Mall;Suite 377;Madison;WI;53706;US\END:vCard</vcard> +7 more

Education · Choice Reviews Online · · cited 1,119× · DOI ↗ · more like this ·

Findings from five main projects in the National Center on Effective Secondary Schools, which operated from December 1, 1985 to February 28, 1991, are presented. Projects investigated different aspects of engagement and achievement problems through literature reviews, analyses of existing data sets, and new studies of students and staff in 32 middle and 62 high schools throughout the United States. Material from the projects is integrated into the following chapters: (1) "The Significance and Sources of Student Engagement" (F. M. Newmann, G. G. Wehlage, and S. D. Lamborn); (2) "Taking Students Seriously" (A. Gamoran and M. Nystrand); (3) "Higher-Order Thinking and Prospects for Classroom Thoughtfulness" (F. M. Newmann); (4) "Building New Programs for Students at Risk" (G. G. Wehlage and G. A. Smith); (5) "Cultivating Teacher Engagement: Breaking the Iron Law of Social Class" (K. S.…

Metrics for Explainable AI: Challenges and Prospects

Robert R. Hoffman, Shane T. Mueller, Gary Klein +1 more

cs.AI · · cited 936× · arXiv ↗ · more like this ·

The question addressed in this paper is: If we present to a user an AI system that explains how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? In other words, how do we know that an explanainable AI system (XAI) is any good? Our focus is on the key concepts of measurement. We discuss specific methods for evaluating: (1) the goodness of explanations, (2) whether users are satisfied by explanations, (3) how well users understand the AI systems, (4) how curiosity motivates the search for explanations, (5) whether the user's trust and reliance on the AI are appropriate, and finally, (6) how the human-XAI work system performs. The recommendations we present derive from our integration of extensive research literatures and our own psychometric evaluations.

Hyperbolic Neural Networks

Octavian-Eugen Ganea, Gary Bécigneul, Thomas Hofmann

cs.LG · · cited 907× · arXiv ↗ · more like this ·

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par with Euclidean geometry, mostly because of the absence of corresponding hyperbolic neural network layers. This makes it hard to use hyperbolic embeddings in downstream tasks. Here, we bridge this gap in a principled manner by combining the formalism of Möbius gyrovector spaces with the Riemannian geometry of the Poincaré model of hyperbolic spaces. As a result, we derive hyperbolic versions of important deep learning tools: multinomial logistic regression, feed-forward and recurrent neural networks such as gated recurrent units. This allows to embed sequential data and perform classification in the hyperbolic space. Empirically, we show that, even if hyperbolic…

Distance and de Sitter Conjectures on the Swampland

Hirosi Ooguri, Eran Palti, Gary Shiu +1 more

hep-th · · cited 763× · arXiv ↗ · more like this ·

Among Swampland conditions, the distance conjecture characterizes the geometry of scalar fields and the de Sitter conjecture constrains allowed potentials on it. We point out a connection between the distance conjecture and a refined version of the de Sitter conjecture in any parametrically controlled regime of string theory by using Bousso's covariant entropy bound. The refined version turns out to evade all counter-examples at scalar potential maxima that have been raised. We comment on the relation of our result to the Dine-Seiberg problem.

Automatically designing CNN architectures using genetic algorithm for image classification

Yanan Sun, Bing Xue, Mengjie Zhang +1 more

cs.NE · · cited 737× · arXiv ↗ · more like this ·

Convolutional Neural Networks (CNNs) have gained a remarkable success on many image classification tasks in recent years. However, the performance of CNNs highly relies upon their architectures. For most state-of-the-art CNNs, their architectures are often manually-designed with expertise in both CNNs and the investigated problems. Therefore, it is difficult for users, who have no extended expertise in CNNs, to design optimal CNN architectures for their own image classification problems of interest. In this paper, we propose an automatic CNN architecture design method by using genetic algorithms, to effectively address the image classification tasks. The most merit of the proposed algorithm remains in its "automatic" characteristic that users do not need domain knowledge of CNNs when using the proposed algorithm, while they can still obtain a promising CNN architecture for the given…

Report of the Dark Energy Task Force

Andreas Albrecht, Gary Bernstein, Robert Cahn +10 more

astro-ph · · cited 735× · arXiv ↗ · more like this ·

Dark energy appears to be the dominant component of the physical Universe, yet there is no persuasive theoretical explanation for its existence or magnitude. The acceleration of the Universe is, along with dark matter, the observed phenomenon that most directly demonstrates that our theories of fundamental particles and gravity are either incorrect or incomplete. Most experts believe that nothing short of a revolution in our understanding of fundamental physics will be required to achieve a full understanding of the cosmic acceleration. For these reasons, the nature of dark energy ranks among the very most compelling of all outstanding problems in physical science. These circumstances demand an ambitious observational program to determine the dark energy properties as well as possible.

Evolving Deep Convolutional Neural Networks for Image Classification

Yanan Sun, Bing Xue, Mengjie Zhang +1 more

cs.NE · · cited 670× · arXiv ↗ · more like this ·

Evolutionary computation methods have been successfully applied to neural networks since two decades ago, while those methods cannot scale well to the modern deep neural networks due to the complicated architectures and large quantities of connection weights. In this paper, we propose a new method using genetic algorithms for evolving the architectures and connection weight initialization values of a deep convolutional neural network to address image classification problems. In the proposed algorithm, an efficient variable-length gene encoding strategy is designed to represent the different building blocks and the unpredictable optimal depth in convolutional neural networks. In addition, a new representation scheme is developed for effectively initializing connection weights of deep convolutional neural networks, which is expected to avoid networks getting stuck into local minima which…

A Survey on Evolutionary Neural Architecture Search

Yuqiao Liu, Yanan Sun, Bing Xue +3 more

cs.NE · · cited 611× · arXiv ↗ · more like this ·

Deep Neural Networks (DNNs) have achieved great success in many applications. The architectures of DNNs play a crucial role in their performance, which is usually manually designed with rich expertise. However, such a design process is labour intensive because of the trial-and-error process, and also not easy to realize due to the rare expertise in practice. Neural Architecture Search (NAS) is a type of technology that can design the architectures automatically. Among different methods to realize NAS, Evolutionary Computation (EC) methods have recently gained much attention and success. Unfortunately, there has not yet been a comprehensive summary of the EC-based NAS algorithms. This paper reviews over 200 papers of most recent EC-based NAS methods in light of the core components, to systematically discuss their design principles as well as justifications on the design. Furthermore…

Why Did the Incumbency Advantage in U.S. House Elections Grow?

Gary W. Cox, Jonathan N. Katz

Political Science and International Relations · American Journal of Political Science · · cited 574× · DOI ↗ · more like this ·

Theory: A simple rational entry argument suggests that the value of incumbency&#13;\nconsists not just of a direct effect, reflecting the value of resources (such as staff)&#13;\nattached to legislative office, but also of an indirect effect, reflecting the fact that&#13;\nstronger challengers are less likely to contest incumbent-held seats. The indirect&#13;\neffect is the product of a scare-off effect-the ability of incumbents to scare off&#13;\nhigh-quality challengers-and a quality effect-reflecting how much electoral advantage&#13;\na party accrues when it has an experienced rather than an inexperienced&#13;\ncandidate.&#13;\nHypothesis: The growth of the overall incumbency advantage was driven principally&#13;\nby increases in the quality effect.&#13;\nMethods: We use a simple two-equation model, estimated by ordinary least-squares&#13;\nregression, to analyze U.S. House election…

DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations

John Giorgi, Osvald Nitski, Bo Wang +1 more

cs.CL · · cited 548× · arXiv ↗ · more like this ·

Sentence embeddings are an important component of many natural language processing (NLP) systems. Like word embeddings, sentence embeddings are typically learned on large text corpora and then transferred to various downstream tasks, such as clustering and retrieval. Unlike word embeddings, the highest performing solutions for learning sentence embeddings require labelled data, limiting their usefulness to languages and domains where labelled data is abundant. In this paper, we present DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations. Inspired by recent advances in deep metric learning (DML), we carefully design a self-supervised objective for learning universal sentence embeddings that does not require labelled training data. When used to extend the pretraining of transformer-based language models, our approach closes the performance gap between unsupervised…

A model of intergenerational mobility variation over time and place

Gary Solon

Sociology and Political Science · Cambridge University Press eBooks · · cited 543× · DOI ↗ · more like this ·

A rapidly growing literature, surveyed in Solon (1999), is examining the empirical association between the incomes of parents and their children. With the acquisition of new data, researchers recently have begun to explore the ways in which intergenerational income mobility varies between countries and over time. Solon (2002) summarizes the new international evidence, which is substantially expanded by several of the chapters in this book. In addition, Reville (1995), Fertig (2001), and the authors of Chapter 5 have begun to study temporal change in intergenerational mobility in the United States, and the authors of Chapter 6 address that subject for the United Kingdom. This new research on intergenerational mobility variation over time and place is important both because it documents important features and trends in income inequality and because it may produce valuable clues about how…

Deconstructing special education and constructing inclusion

Gary Thomas, Andrew Loxley

Education · British Journal of Educational Studies · · cited 531× · OpenAlex ↗ · more like this ·

Special education - theory and theory talk The knowledge-roots of special education The great problem of 'need' - a case study in children who don't behave Thinking about learning failure, especially in reading Modelling difference Inclusive schools in an inclusive society? policy, politics and paradox Constructing inclusion.

Lives in context: the art of life history research

Cole, Andra L., Knowles, J. Gary

Education · Choice Reviews Online · · cited 522× · DOI ↗ · more like this ·

Chapter 1 Preface Chapter 2 Beginnings: Reseraching the Professor: Thomas Part 3 Exploring Method Chapter 4 What is Life History Research Chapter 5 Principles Guiding Life History Researching Chapter 6 Beginning a Life History Research Project Chapter 7 Doing Life History Research Chapter 8 Preparing to Make Sense of Gathered Life History Information Chapter 9 Making Sense of and Representing Lives-in-Context Part 10 Experiencing Method Chapter 11 Lessons from Nurses' Lives Chapter 12 Responsibilities to Community: Relationality and Mutality with Home-educating Families Chapter 13 Research as Relationship Chapter 14 Fidelity and Ethical Ideals Chapter 15 Telling Inside The Paradox of Researcher Privilege Chapter 16 Going Deep: Intersecting of Self as Researcher and Researched Chapter 17 A Life History as Artistic Interpretation Chapter 18 Reflections on Our Stories: Women in Cardiac…

The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence

Gary Marcus

cs.AI · · cited 519× · arXiv ↗ · more like this ·

Recent research in artificial intelligence and machine learning has largely emphasized general-purpose learning and ever-larger training sets and more and more compute. In contrast, I propose a hybrid, knowledge-driven, reasoning-based approach, centered around cognitive models, that could provide the substrate for a richer, more robust AI than is currently possible.