arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Amanda

6,333 papers · 1907–2026

1967: 01968: 11969: 21970: 21971: 01972: 01973: 21974: 01975: 21976: 11977: 31978: 31979: 41980: 61981: 31982: 21983: 41984: 91985: 51986: 21987: 91988: 61989: 71990: 81991: 81992: 231993: 181994: 181995: 231996: 341997: 291998: 451999: 442000: 812001: 532002: 802003: 882004: 1292005: 1162006: 1822007: 2112008: 2292009: 3202010: 3302011: 3912012: 4372013: 4912014: 5312015: 3842016: 742017: 872018: 1042019: 1442020: 1562021: 1772022: 1862023: 2202024: 2572025: 2762026: 265
1967peak 531 in 20142026

Frequent co-authors

Papers

showing 1–25 of 6,333 RSS

Language Models are Few-Shot Learners

Tom B. Brown, Benjamin Mann, Nick Ryder +28 more

cs.CL · · cited 64,094× · arXiv ↗ · more like this ·

Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still requires task-specific fine-tuning datasets of thousands or tens of thousands of examples. By contrast, humans can generally perform a new language task from only a few examples or from simple instructions - something which current NLP systems still largely struggle to do. Here we show that scaling up language models greatly improves task-agnostic, few-shot performance, sometimes even reaching competitiveness with prior state-of-the-art fine-tuning approaches. Specifically, we train GPT-3, an autoregressive language model with 175 billion parameters, 10x more than any previous non-sparse language model, and test its performance in the few-shot setting. For all…

Learning Transferable Visual Models From Natural Language Supervision

Alec Radford, Jong Wook Kim, Chris Hallacy +9 more

cs.CV · · cited 56,683× · arXiv ↗ · more like this ·

State-of-the-art computer vision systems are trained to predict a fixed set of predetermined object categories. This restricted form of supervision limits their generality and usability since additional labeled data is needed to specify any other visual concept. Learning directly from raw text about images is a promising alternative which leverages a much broader source of supervision. We demonstrate that the simple pre-training task of predicting which caption goes with which image is an efficient and scalable way to learn SOTA image representations from scratch on a dataset of 400 million (image, text) pairs collected from the internet. After pre-training, natural language is used to reference learned visual concepts (or describe new ones) enabling zero-shot transfer of the model to downstream tasks. We study the performance of this approach by benchmarking on over 30 different…

Training language models to follow instructions with human feedback

Long Ouyang, Jeff Wu, Xu Jiang +17 more

cs.CL · · cited 24,599× · arXiv ↗ · more like this ·

Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we use to fine-tune GPT-3 using supervised learning. We then collect a dataset of rankings of model outputs, which we use to further fine-tune this supervised model using reinforcement learning from human feedback. We call the resulting models InstructGPT. In human evaluations on our prompt…

The Llama 3 Herd of Models

Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri +558 more

cs.AI · · cited 19,265× · arXiv ↗ · more like this ·

Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs…

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Yuntao Bai, Andy Jones, Kamal Ndousse +28 more

cs.CL · · cited 4,403× · arXiv ↗ · more like this ·

We apply preference modeling and reinforcement learning from human feedback (RLHF) to finetune language models to act as helpful and harmless assistants. We find this alignment training improves performance on almost all NLP evaluations, and is fully compatible with training for specialized skills such as python coding and summarization. We explore an iterated online mode of training, where preference models and RL policies are updated on a weekly cadence with fresh human feedback data, efficiently improving our datasets and models. Finally, we investigate the robustness of RLHF training, and identify a roughly linear relation between the RL reward and the square root of the KL divergence between the policy and its initialization. Alongside our main results, we perform peripheral analyses on calibration, competing objectives, and the use of OOD detection, compare our models with human…

Constitutional AI: Harmlessness from AI Feedback

Yuntao Bai, Saurav Kadavath, Sandipan Kundu +48 more

cs.CL · · cited 3,771× · arXiv ↗ · more like this ·

As AI systems become more capable, we would like to enlist their help to supervise other AIs. We experiment with methods for training a harmless AI assistant through self-improvement, without any human labels identifying harmful outputs. The only human oversight is provided through a list of rules or principles, and so we refer to the method as 'Constitutional AI'. The process involves both a supervised learning and a reinforcement learning phase. In the supervised phase we sample from an initial model, then generate self-critiques and revisions, and then finetune the original model on revised responses. In the RL phase, we sample from the finetuned model, use a model to evaluate which of the two samples is better, and then train a preference model from this dataset of AI preferences. We then train with RL using the preference model as the reward signal, i.e. we use 'RL from AI…

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

BigScience Workshop, :, Teven Le Scao +391 more

cs.CL · · cited 3,043× · arXiv ↗ · more like this ·

Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to widespread adoption, most LLMs are developed by resource-rich organizations and are frequently kept from the public. As a step towards democratizing this powerful technology, we present BLOOM, a 176B-parameter open-access language model designed and built thanks to a collaboration of hundreds of researchers. BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total). We find that BLOOM achieves competitive performance on a wide variety of benchmarks, with stronger results after undergoing multitask prompted finetuning. To facilitate future research and applications using LLMs, we…

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448 more

cs.CL · · cited 2,670× · arXiv ↗ · more like this ·

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-future capabilities and limitations of language models. To address this challenge, we introduce the Beyond the Imitation Game benchmark (BIG-bench). BIG-bench currently consists of 204 tasks, contributed by 450 authors across 132 institutions. Task topics are diverse, drawing problems from linguistics, childhood development, math, common-sense reasoning, biology, physics, social bias, software development, and beyond. BIG-bench focuses on tasks that are believed to be beyond the capabilities of…

Gemma 2: Improving Open Language Models at a Practical Size

Gemma Team, Morgane Riviere, Shreya Pathak +195 more

cs.CL · · cited 2,513× · arXiv ↗ · more like this ·

In this work, we introduce Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters. In this new version, we apply several known technical modifications to the Transformer architecture, such as interleaving local-global attentions (Beltagy et al., 2020a) and group-query attention (Ainslie et al., 2023). We also train the 2B and 9B models with knowledge distillation (Hinton et al., 2015) instead of next token prediction. The resulting models deliver the best performance for their size, and even offer competitive alternatives to models that are 2-3 times bigger. We release all our models to the community.

Language Models (Mostly) Know What They Know

Saurav Kadavath, Tom Conerly, Amanda Askell +33 more

cs.CL · · cited 2,121× · arXiv ↗ · more like this ·

We study whether language models can evaluate the validity of their own claims and predict which questions they will be able to answer correctly. We first show that larger models are well-calibrated on diverse multiple choice and true/false questions when they are provided in the right format. Thus we can approach self-evaluation on open-ended sampling tasks by asking models to first propose answers, and then to evaluate the probability "P(True)" that their answers are correct. We find encouraging performance, calibration, and scaling for P(True) on a diverse array of tasks. Performance at self-evaluation further improves when we allow models to consider many of their own samples before predicting the validity of one specific possibility. Next, we investigate whether models can be trained to predict "P(IK)", the probability that "I know" the answer to a question, without reference to…

Quantum error correction below the surface code threshold

Rajeev Acharya, Laleh Aghababaie-Beni, Igor Aleiner +246 more

quant-ph · · cited 1,441× · arXiv ↗ · more like this ·

Quantum error correction provides a path to reach practical quantum computing by combining multiple physical qubits into a logical qubit, where the logical error rate is suppressed exponentially as more qubits are added. However, this exponential suppression only occurs if the physical error rate is below a critical threshold. In this work, we present two surface code memories operating below this threshold: a distance-7 code and a distance-5 code integrated with a real-time decoder. The logical error rate of our larger quantum memory is suppressed by a factor of $Λ$ = 2.14 $\pm$ 0.02 when increasing the code distance by two, culminating in a 101-qubit distance-7 code with 0.143% $\pm$ 0.003% error per cycle of error correction. This logical memory is also beyond break-even, exceeding its best physical qubit's lifetime by a factor of 2.4 $\pm$ 0.3. We maintain below-threshold…

Towards Understanding Sycophancy in Language Models

Mrinank Sharma, Meg Tong, Tomasz Korbak +16 more

cs.CL · · cited 1,420× · arXiv ↗ · more like this ·

Human feedback is commonly utilized to finetune AI assistants. But human feedback may also encourage model responses that match user beliefs over truthful ones, a behaviour known as sycophancy. We investigate the prevalence of sycophancy in models whose finetuning procedure made use of human feedback, and the potential role of human preference judgments in such behavior. We first demonstrate that five state-of-the-art AI assistants consistently exhibit sycophancy across four varied free-form text-generation tasks. To understand if human preferences drive this broadly observed behavior, we analyze existing human preference data. We find that when a response matches a user's views, it is more likely to be preferred. Moreover, both humans and preference models (PMs) prefer convincingly-written sycophantic responses over correct ones a non-negligible fraction of the time. Optimizing model…

Microblogging during two natural hazards events

Sarah Vieweg, Amanda Hughes, Kate Starbird +1 more

Communication · · cited 1,415× · DOI ↗ · more like this ·

We analyze microblog posts generated during two recent, concurrent emergency events in North America via Twitter, a popular microblogging service. We focus on communications broadcast by people who were "on the ground" during the Oklahoma Grassfires of April 2009 and the Red River Floods that occurred in March and April 2009, and identify information that may contribute to enhancing situational awareness (SA). This work aims to inform next steps for extracting useful, relevant information during emergencies using information extraction (IE) techniques.

A General Language Assistant as a Laboratory for Alignment

Amanda Askell, Yuntao Bai, Anna Chen +19 more

cs.CL · · cited 1,255× · arXiv ↗ · more like this ·

Given the broad capabilities of large language models, it should be possible to work towards a general-purpose, text-based assistant that is aligned with human values, meaning that it is helpful, honest, and harmless. As an initial foray in this direction we study simple baseline techniques and evaluations, such as prompting. We find that the benefits from modest interventions increase with model size, generalize to a variety of alignment evaluations, and do not compromise the performance of large models. Next we investigate scaling trends for several training objectives relevant to alignment, comparing imitation learning, binary discrimination, and ranked preference modeling. We find that ranked preference modeling performs much better than imitation learning, and often scales more favorably with model size. In contrast, binary discrimination typically performs and scales very…

Digital Inequality

Eszter Hargittai, Amanda Hinnant

Communication · Communication Research · · cited 1,214× · DOI ↗ · more like this ·

This article expands understanding of the digital divide to more nuanced measures of use by examining differences in young adults' online activities. Young adults are the most highly connected age group, but that does not mean that their Internet uses are homogenous. Analyzing data about the Web uses of 270 adults from across the United States, the article explores the differences in 18- to 26-year-olds' online activities and what social factors explain the variation. Findings suggest that those with higher levels of education and of a more resource-rich background use the Web for more “capitalenhancing” activities. Detailed analyses of user attributes also reveal that online skill is an important mediating factor in the types of activities people pursue online. The authors discuss the implications of these findings for a “second-level digital divide,” that is, differences among the…

Stereotypes as Dynamic Constructs: Women and Men of the Past, Present, and Future

Amanda B. Diekman, Alice H. Eagly

Sociology and Political Science · Personality and Social Psychology Bulletin · · cited 1,137× · DOI ↗ · more like this ·

Dynamic stereotypes characterize social groups that are thought to have changed from the attributes they manifested in the past and even to continue to change in the future. According to social role theory’s assumption that the role behavior of group members shapes their stereotype, groups should have dynamic stereotypes to the extent that their typical social roles are perceived to change over time. Applied to men and women, this theory makes two predictions about perceived change: (a) perceivers should think that sex differences are eroding because of increasing similarity of the roles of men and women and (b) the female stereotype should be particularly dynamic because of greater change in the roles of women than of men. This theory was tested and confirmed in five experiments that examined perceptions of the roles and the personality, cognitive, and physical attributes of men and…

Discovering Language Model Behaviors with Model-Written Evaluations

Ethan Perez, Sam Ringer, Kamilė Lukošiūtė +60 more

cs.CL · · cited 1,090× · arXiv ↗ · more like this ·

As language models (LMs) scale, they develop many novel behaviors, good and bad, exacerbating the need to evaluate how they behave. Prior work creates evaluations with crowdwork (which is time-consuming and expensive) or existing data sources (which are not always available). Here, we automatically generate evaluations with LMs. We explore approaches with varying amounts of human effort, from instructing LMs to write yes/no questions to making complex Winogender schemas with multiple stages of LM-based generation and filtering. Crowdworkers rate the examples as highly relevant and agree with 90-100% of labels, sometimes more so than corresponding human-written datasets. We generate 154 datasets and discover new cases of inverse scaling where LMs get worse with size. Larger LMs repeat back a dialog user's preferred answer ("sycophancy") and express greater desire to pursue concerning…

In-context Learning and Induction Heads

Catherine Olsson, Nelson Elhage, Neel Nanda +23 more

cs.LG · · cited 1,064× · arXiv ↗ · more like this ·

"Induction heads" are attention heads that implement a simple algorithm to complete token sequences like [A][B] ... [A] -> [B]. In this work, we present preliminary and indirect evidence for a hypothesis that induction heads might constitute the mechanism for the majority of all "in-context learning" in large transformer models (i.e. decreasing loss at increasing token indices). We find that induction heads develop at precisely the same point as a sudden sharp increase in in-context learning ability, visible as a bump in the training loss. We present six complementary lines of evidence, arguing that induction heads may be the mechanistic source of general in-context learning in transformer models of any size. For small attention-only models, we present strong, causal evidence; for larger models with MLPs, we present correlational evidence.

Fission‐Fusion Dynamics

Filippo Aureli, Colleen M. Schaffner, Christophe Boesch +9 more

Sociology and Political Science · Current Anthropology · · cited 1,062× · DOI ↗ · more like this ·

Renewed interest in fission-fusion dynamics is due to the recognition that such dynamics may create unique challenges for social interaction and distinctive selective pressures acting on underlying communicative and cognitive abilities. New frameworks for integrating current knowledge on fission-fusion dynamics emerge from a fundamental rethinking of the term "fission-fusion" away from its current general use as a label for a particular modal type of social system (i.e., "fission-fusion societies"). Specifically, because the degree of spatial and temporal cohesion of group members varies both within and across taxa, any social system can be described in terms of the extent to which it expresses fission-fusion dynamics. This perspective has implications for socioecology, communication, cognitive demands, and human social evolution.

Tackling the wider social determinants of health and health inequalities: evidence from systematic reviews

Clare Bambra, Marcia Gibson, Amanda Sowden +3 more

Health · Journal of Epidemiology & Community Health · · cited 997× · DOI ↗ · more like this ·

BACKGROUND: There is increasing pressure to tackle the wider social determinants of health through the implementation of appropriate interventions. However, turning these demands for better evidence about interventions around the social determinants of health into action requires identifying what we already know and highlighting areas for further development. METHODS: Systematic review methodology was used to identify systematic reviews (from 2000 to 2007, developed countries only) that described the health effects of any intervention based on the wider social determinants of health: water and sanitation, agriculture and food, access to health and social care services, unemployment and welfare, working conditions, housing and living environment, education, and transport. RESULTS: Thirty systematic reviews were identified. Generally, the effects of interventions on health inequalities…

Twitter adoption and use in mass convergence and emergency events

Amanda Hughes, Leysia Palen

Communication · International Journal of Emergency Management · · cited 992× · DOI ↗ · more like this ·

This paper offers a descriptive account of Twitter (a microblogging service) across four high-profile, mass convergence events - two emergency and two national security. We statistically examine how Twitter is being used surrounding these events, and compare and contrast how that behaviour is different from more general Twitter use. Our findings suggest that Twitter messages sent during these types of events contain more displays of information broadcasting and brokerage, and we observe that general Twitter use seems to have evolved over time to offer more of an information-sharing purpose. We also provide preliminary evidence that Twitter users who join during and in apparent relation to a mass convergence or emergency event are more likely to become long-term adopters of the technology.

Searching the web: The public and their queries

Amanda Spink, Dietmar Wolfram, Major B. J. Jansen +1 more

Information Systems · Journal of the American Society for Information Science and Technology · · cited 942× · DOI ↗ · more like this ·

In studying actual Web searching by the public at large, we analyzed over one million Web queries by users of the Excite search engine. We found that most people use few search terms, few modified queries, view few Web pages, and rarely use advanced search features. A small number of search terms are used with high frequency, and a great many terms are unique; the language of Web queries is distinctive. Queries about recreation and entertainment rank highest. Findings are compared to data from two other large studies of Web queries. This study provides an insight into the public practices and choices in Web searching.

Release Strategies and the Social Impacts of Language Models

Irene Solaiman, Miles Brundage, Jack Clark +12 more

cs.CL · · cited 916× · arXiv ↗ · more like this ·

Large language models have a range of beneficial uses: they can assist in prose, poetry, and programming; analyze dataset biases; and more. However, their flexibility and generative capabilities also raise misuse concerns. This report discusses OpenAI's work related to the release of its GPT-2 language model. It discusses staged release, which allows time between model releases to conduct risk and benefit analyses as model sizes increased. It also discusses ongoing partnership-based research and provides recommendations for better coordination and responsible publication in AI.

Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned

Deep Ganguli, Liane Lovitt, Jackson Kernion +33 more

cs.CL · · cited 896× · arXiv ↗ · more like this ·

We describe our early efforts to red team language models in order to simultaneously discover, measure, and attempt to reduce their potentially harmful outputs. We make three main contributions. First, we investigate scaling behaviors for red teaming across 3 model sizes (2.7B, 13B, and 52B parameters) and 4 model types: a plain language model (LM); an LM prompted to be helpful, honest, and harmless; an LM with rejection sampling; and a model trained to be helpful and harmless using reinforcement learning from human feedback (RLHF). We find that the RLHF models are increasingly difficult to red team as they scale, and we find a flat trend with scale for the other model types. Second, we release our dataset of 38,961 red team attacks for others to analyze and learn from. We provide our own analysis of the data and find a variety of harmful outputs, which range from offensive language to…

Supervision in Social Work

Amanda M Nickson, Margaret- Anne Carter, Abraham P. Francis

Public Administration · · cited 760× · DOI ↗ · more like this ·

Preface Acknowledgments1. History, Definition, and Significance2. Administrative Supervision3. Administrative Supervision: Problems in Implementation4. Educational Supervision: Definition, Differentiation, Content, and Process5. Principles and Problems in Implementing Educational Supervision6. Supportive Supervision7. Problems and Stresses in Becoming and Being a Supervisor8. Evaluation9. Group Supervision10. Problems and InnovationsBibliographyIndex