arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sanjay

6,671 papers · 1962–2026

1967: 01968: 01969: 11970: 11971: 01972: 01973: 11974: 01975: 01976: 11977: 01978: 01979: 01980: 21981: 11982: 31983: 41984: 01985: 11986: 61987: 51988: 91989: 131990: 331991: 201992: 221993: 311994: 291995: 441996: 311997: 511998: 471999: 382000: 532001: 582002: 1672003: 1152004: 1212005: 1612006: 1932007: 1972008: 1992009: 2282010: 3372011: 3422012: 4512013: 4262014: 5002015: 4142016: 3352017: 1002018: 1372019: 1452020: 1762021: 1642022: 1632023: 1862024: 2482025: 3112026: 348
1967peak 500 in 20142026

Frequent co-authors

Papers

showing 1–25 of 6,671 RSS

The Llama 3 Herd of Models

Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri +558 more

cs.AI · · cited 19,265× · arXiv ↗ · more like this ·

Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs…

MapReduce

Jay B. Dean, Sanjay Ghemawat

Information Systems · Communications of the ACM · · cited 18,538× · DOI ↗ · more like this ·

MapReduce is a programming model and an associated implementation for processing and generating large datasets that is amenable to a broad variety of real-world tasks. Users specify the computation in terms of a map and a reduce function, and the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks. Programmers find the system easy to use: more than ten thousand distinct MapReduce programs have been implemented internally at Google over the past four years, and an average of one hundred thousand MapReduce jobs are executed on Google's clusters every day, processing a total of more than twenty petabytes of data per day.

TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems

Martín Abadi, Ashish Agarwal, Paul Barham +37 more

cs.DC · · cited 11,866× · arXiv ↗ · more like this ·

TensorFlow is an interface for expressing machine learning algorithms, and an implementation for executing such algorithms. A computation expressed using TensorFlow can be executed with little or no change on a wide variety of heterogeneous systems, ranging from mobile devices such as phones and tablets up to large-scale distributed systems of hundreds of machines and thousands of computational devices such as GPU cards. The system is flexible and can be used to express a wide variety of algorithms, including training and inference algorithms for deep neural network models, and it has been used for conducting research and for deploying machine learning systems into production across more than a dozen areas of computer science and other fields, including speech recognition, computer vision, robotics, information retrieval, natural language processing, geographic information extraction…

TensorFlow: A system for large-scale machine learning

Martín Abadi, Paul Barham, Jianmin Chen +19 more

cs.DC · · cited 8,825× · arXiv ↗ · more like this ·

TensorFlow is a machine learning system that operates at large scale and in heterogeneous environments. TensorFlow uses dataflow graphs to represent computation, shared state, and the operations that mutate that state. It maps the nodes of a dataflow graph across many machines in a cluster, and within a machine across multiple computational devices, including multicore CPUs, general-purpose GPUs, and custom designed ASICs known as Tensor Processing Units (TPUs). This architecture gives flexibility to the application developer: whereas in previous "parameter server" designs the management of shared state is built into the system, TensorFlow enables developers to experiment with novel optimizations and training algorithms. TensorFlow supports a variety of applications, with particularly strong support for training and inference on deep neural networks. Several Google services use…

PaLM: Scaling Language Modeling with Pathways

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin +64 more

cs.CL · · cited 8,437× · arXiv ↗ · more like this ·

Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning, which drastically reduces the number of task-specific training examples needed to adapt the model to a particular application. To further our understanding of the impact of scale on few-shot learning, we trained a 540-billion parameter, densely activated, Transformer language model, which we call Pathways Language Model PaLM. We trained PaLM on 6144 TPU v4 chips using Pathways, a new ML system which enables highly efficient training across multiple TPU Pods. We demonstrate continued benefits of scaling by achieving state-of-the-art few-shot learning results on hundreds of language understanding and generation benchmarks. On a number of these tasks, PaLM 540B achieves breakthrough performance, outperforming the finetuned state-of-the-art on a suite…

The Google file system

Sanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung

Computer Networks and Communications · ACM SIGOPS Operating Systems Review · · cited 5,003× · DOI ↗ · more like this ·

We have designed and implemented the Google File Sys-tem, a scalable distributed file system for large distributed data-intensive applications. It provides fault tolerance while running on inexpensive commodity hardware, and it delivers high aggregate performance to a large number of clients. While sharing many of the same goals as previous dis-tributed file systems, our design has been driven by obser-vations of our application workloads and technological envi-ronment, both current and anticipated, that reflect a marked departure from some earlier file system assumptions. This has led us to reexamine traditional choices and explore rad-ically different design points. The file system has successfully met our storage needs. It is widely deployed within Google as the storage platform for the generation and processing of data used by our ser-vice as well as research and development efforts…

The Hadoop Distributed File System

Konstantin V. Shvachko, Hairong Kuang, Sanjay Radia +1 more

Information Systems · · cited 4,827× · DOI ↗ · more like this ·

The Hadoop Distributed File System (HDFS) is designed to store very large data sets reliably, and to stream those data sets at high bandwidth to user applications. In a large cluster, thousands of servers both host directly attached storage and execute user application tasks. By distributing storage and computation across many servers, the resource can grow with demand while remaining economical at every size. We describe the architecture of HDFS and report on experience using HDFS to manage 25 petabytes of enterprise data at Yahoo!.

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Gemini Team, Petko Georgiev, Ving Ian Lei +1134 more

cs.CL · · cited 4,033× · arXiv ↗ · more like this ·

In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over fine-grained information from millions of tokens of context, including multiple long documents and hours of video and audio. The family includes two new models: (1) an updated Gemini 1.5 Pro, which exceeds the February version on the great majority of capabilities and benchmarks; (2) Gemini 1.5 Flash, a more lightweight variant designed for efficiency with minimal regression in quality. Gemini 1.5 models achieve near-perfect recall on long-context retrieval tasks across modalities, improve the state-of-the-art in long-document QA, long-video QA and long-context ASR, and match or surpass Gemini 1.0 Ultra's state-of-the-art performance across a broad set of benchmarks. Studying the limits of Gemini 1.5's…

Bigtable

Fay W. Chang, Jay B. Dean, Sanjay Ghemawat +6 more

Computer Networks and Communications · ACM Transactions on Computer Systems · · cited 3,432× · DOI ↗ · more like this ·

Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers. Many projects at Google store data in Bigtable, including web indexing, Google Earth, and Google Finance. These applications place very different demands on Bigtable, both in terms of data size (from URLs to web pages to satellite imagery) and latency requirements (from backend bulk processing to real-time data serving). Despite these varied demands, Bigtable has successfully provided a flexible, high-performance solution for all of these Google products. In this article, we describe the simple data model provided by Bigtable, which gives clients dynamic control over data layout and format, and we describe the design and implementation of Bigtable.

Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.

Samuel D. Gosling, Simine Vazire, Sanjay Srivastava +1 more

Sociology and Political Science · American Psychologist · · cited 2,940× · DOI ↗ · more like this ·

The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.

Recurrent Neural Networks for Multivariate Time Series with Missing Values

Zhengping Che, Sanjay Purushotham, Kyunghyun Cho +2 more

cs.LG · · cited 2,628× · arXiv ↗ · more like this ·

Multivariate time series data in practical applications, such as health care, geoscience, and biology, are characterized by a variety of missing values. In time series prediction and other related tasks, it has been noted that missing values and their missing patterns are often correlated with the target labels, a.k.a., informative missingness. There is very limited work on exploiting the missing patterns for effective imputation and improving prediction performance. In this paper, we develop novel deep learning models, namely GRU-D, as one of the early attempts. GRU-D is based on Gated Recurrent Unit (GRU), a state-of-the-art recurrent neural network. It takes two representations of missing patterns, i.e., masking and time interval, and effectively incorporates them into a deep model architecture so that it not only captures the long-term temporal dependencies in time series, but also…

Deep Learning for Anomaly Detection: A Survey

Raghavendra Chalapathy, Sanjay Chawla

cs.LG · · cited 1,923× · arXiv ↗ · more like this ·

Anomaly detection is an important problem that has been well-studied within diverse research areas and application domains. The aim of this survey is two-fold, firstly we present a structured and comprehensive overview of research methods in deep learning-based anomaly detection. Furthermore, we review the adoption of these methods for anomaly across various application domains and assess their effectiveness. We have grouped state-of-the-art research techniques into different categories based on the underlying assumptions and approach adopted. Within each category we outline the basic anomaly detection technique, along with its variants and present key assumptions, to differentiate between normal and anomalous behavior. For each category, we present we also present the advantages and limitations and discuss the computational complexity of the techniques in real application domains.…

Continuous finite-time stabilization of the translational and rotational double integrators

Sanjay P. Bhat, Dennis S. Bernstein

Numerical Analysis · IEEE Transactions on Automatic Control · · cited 1,683× · DOI ↗ · more like this ·

A class of bounded continuous time-invariant finite-time stabilizing feedback laws is given for the double integrator. Lyapunov theory is used to prove finite-time convergence. For the rotational double integrator, these controllers are modified to obtain finite-time-stabilizing feedback that avoid "unwinding".

On the Implementation of a Primal-Dual Interior Point Method

Sanjay Mehrotra

Numerical Analysis · SIAM Journal on Optimization · · cited 1,623× · DOI ↗ · more like this ·

This paper gives an approach to implementing a second-order primal-dual interior point method. It uses a Taylor polynomial of second order to approximate a primal-dual trajectory. The computations for the second derivative are combined with the computations for the centering direction. Computations in this approach do not require that primal and dual solutions be feasible. Expressions are given to compute all the higher-order derivatives of the trajectory of interest. The implementation ensures that a suitable potential function is reduced by a constant amount at each iteration. There are several salient features of this approach. An adaptive heuristic for estimating the centering parameter is given. The approach used to compute the step length is also adaptive. A new practical approach to compute the starting point is given. This approach treats primal and dual problems symmetrically.…

A case for end system multicast

Yang-hua Chu, Sanjay Rao, S. Seshan +1 more

Computer Networks and Communications · IEEE Journal on Selected Areas in Communications · · cited 1,521× · DOI ↗ · more like this ·

The conventional wisdom has been that Internet protocol (IP) is the natural protocol layer for implementing multicast related functionality. However, more than a decade after its initial proposal, IP multicast is still plagued with concerns pertaining to scalability, network management, deployment, and support for higher layer functionality such as error, flow, and congestion control. We explore an alternative architecture that we term end system multicast, where end systems implement all multicast related functionality including membership management and packet replication. This shifting of multicast support from routers to end systems has the potential to address most problems associated with IP multicast. However, the key concern is the performance penalty associated with such a model. In particular, end system multicast introduces duplicate packets on physical links and incurs…

Exploiting Shared Representations for Personalized Federated Learning

Liam Collins, Hamed Hassani, Aryan Mokhtari +1 more

cs.LG · · cited 1,269× · arXiv ↗ · more like this ·

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be fully-realized in federated settings. Although data in federated settings is often non-i.i.d. across clients, the success of centralized deep learning suggests that data often shares a global feature representation, while the statistical heterogeneity across clients or tasks is concentrated in the labels. Based on this intuition, we propose a novel federated learning framework and algorithm for learning a shared data representation across clients and unique local heads for each client. Our algorithm harnesses the distributed computational power across clients to perform many local-updates with respect to the low-dimensional local parameters for every…

Gemma: Open Models Based on Gemini Research and Technology

Gemma Team, Thomas Mesnard, Cassidy Hardin +105 more

cs.CL · · cited 1,258× · arXiv ↗ · more like this ·

This work introduces Gemma, a family of lightweight, state-of-the art open models built from the research and technology used to create Gemini models. Gemma models demonstrate strong performance across academic benchmarks for language understanding, reasoning, and safety. We release two sizes of models (2 billion and 7 billion parameters), and provide both pretrained and fine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out of 18 text-based tasks, and we present comprehensive evaluations of safety and responsibility aspects of the models, alongside a detailed description of model development. We believe the responsible release of LLMs is critical for improving the safety of frontier models, and for enabling the next wave of LLM innovations.

A scheme for robust distributed sensor fusion based on average consensus

Lin Xiao, Stephen Boyd, Sanjay Lall

Computer Networks and Communications · CaltechAUTHORS (California Institute of Technology) · · cited 1,210× · DOI ↗ · more like this ·

Abstract We consider a network of distributed sensors, where each sensor takes a linear measurement of some unknown param-eters, corrupted by independent Gaussian noises. We propose a simple distributed iterative scheme, based on distributed average consensus in the network, to compute the maximum-likelihood estimate of the parameters. This scheme doesn’t involve explicit point-to-point message passing or routing; instead, it diffuses information across the network by updating each node’s data with a weighted average of its neighbors ’ data (they maintain the same data structure). At each step, every node can compute a local weighted least-squares estimate, which converges to the global maximum-likelihood solution. This scheme is robust to unreliable communication links. We show that it works in a network with dynamically changing topology, provided that the innitely occurring…

Razor: a low-power pipeline based on circuit-level timing speculation

Dan Ernst, Nam Sung Kim, Shidhartha Das +8 more

Hardware and Architecture · International Symposium on Microarchitecture · · cited 1,081× · DOI ↗ · more like this ·

With increasing clock frequencies and silicon integration, power aware computing has become a critical concern in the design of embedded processors and systems-on-chip. One of the more effective and widely used methods for power-aware computing is dynamic voltage scaling (DVS). In order to obtain the maximum power savings from DVS, it is essential to scale the supply voltage as low as possible while ensuring correct operation of the processor. The critical voltage is chosen such that under a worst-case scenario of process and environmental variations, the processor always operates correctly. However, this approach leads to a very conservative supply voltage since such a worst-case combination of different variabilities will be very rare. In this paper, we propose a new approach to DVS, called Razor, based on dynamic detection and correction of circuit timing errors. The key idea of…

Connected Histories: Notes towards a Reconfiguration of Early Modern Eurasia

Sanjay Subrahmanyam

Cultural Studies · Modern Asian Studies · · cited 1,063× · DOI ↗ · more like this ·

The majority of Japanese even today believe that the politico-cultural universe of the Edo period was fundamentally determined by the closure of the country. They also think that the opening of Japan can be reduced to the development of exchanges with the West, following the birth of the Meiji regime. It is hard for them to imagine that Japan developed in relation with other Asian countries, since they are hardly used to appreciating Asian cultures.

FAST TCP: Motivation, Architecture, Algorithms, Performance

David X. Wei, Cheng Jin, Steven H. Low +1 more

Computer Networks and Communications · IEEE/ACM Transactions on Networking · · cited 960× · DOI ↗ · more like this ·

We describe FAST TCP, a new TCP congestion control algorithm for high-speed long-latency networks, from design to implementation. We highlight the approach taken by FAST TCP to address the four difficulties which the current TCP implementation has at large windows. We describe the architecture and summarize some of the algorithms implemented in our prototype. We characterize its equilibrium and stability properties. We evaluate it experimentally in terms of throughput, fairness, stability, and responsiveness

A case for end system multicast (keynote address)

Yang-hua Chu, Sanjay Rao, Hui Zhang

Computer Networks and Communications · · cited 957× · DOI ↗ · more like this ·

The conventional wisdom has been that IP is the natural protocol layer for implementing multicast related functionality. However, ten years after its initial proposal, IP Multicast is still plagued with concerns pertaining to scalability, network management, deployment and support for higher layer functionality such as error, flow and congestion control. In this paper, we explore an alternative architecture for small and sparse groups, where end systems implement all multicast related functionality including membership management and packet replication. We call such a scheme End System Multicast. This shifting of multicast support from routers to end systems has the potential to address most problems associated with IP Multicast. However, the key concern is the performance penalty associated with such a model. In particular, End System Multicast introduces duplicate packets on physical…

World development report 1997 : the state in a changing world

Alison Evans, Brian Levy, Simon Commander +6 more

Development · · cited 888× · OpenAlex ↗ · more like this ·

This is the twentieth in the annual series assessing major development issues. The report is devoted to the role and effectiveness of the state: what it should do, how it should do it, and how it can improve in a rapidly changing world. Governments with both centrally-planned and mixed economies are shrinking their market role because of failed state interventions. This report takes an opposite stance: that state's role in the institutional environment underlying the economy, that is, its ability to enforce a rule of law to underpin transactions, is vital to making government contribute more effectively to development. It argues against reducing government to a minimalist state, explaining that development requires an effective state that plays a facilitator role in encouraging and complementing the activities of private businesses and individuals. The report presents a state reform…

The Role of Organizations in Fostering Public Service Motivation

Donald P. Moynihan, Sanjay K. Pandey

Public Administration · Public Administration Review · · cited 883× · DOI ↗ · more like this ·

In seeking to explain the antecedents of public service motivation, James Perry focuses on the formative role of sociohistorical context. This study tests Perry’s theory and examines the role that organizational factors play in shaping public service motivation, based on responses from a national survey of state government health and human service managers. The findings support the role of sociohistorical context, showing that public service motivation is strongly and positively related to level of education and membership in professional organizations. The results also underscore the significant influence of organizational institutions, indicating that red tape and length of organizational membership are negatively related to public service motivation, whereas hierarchical authority and reform efforts have a positive relationship. Therefore, public organizations have both an…

Sensor networks: an overview

Malik Tubaishat, Sanjay Madria

Computer Networks and Communications · IEEE Potentials · · cited 871× · DOI ↗ · more like this ·

Advances in hardware and wireless network technologies have created low-cost, low-power, multifunctional miniature sensor devices. These devices make up hundreds or thousands of ad hoc tiny sensor nodes spread across a geographical area. These sensor nodes collaborate among themselves to establish a sensing network. A sensor network can provide access to information anytime, anywhere by collecting, processing, analyzing and disseminating data. Thus, the network actively participates in creating a smart environment.