arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Patel

7,982 papers · 1961–2024

1965: 01966: 01967: 01968: 11969: 21970: 51971: 51972: 61973: 41974: 81975: 111976: 111977: 111978: 31979: 81980: 111981: 61982: 101983: 81984: 81985: 131986: 141987: 151988: 171989: 241990: 161991: 251992: 281993: 291994: 371995: 341996: 291997: 371998: 541999: 502000: 532001: 632002: 1942003: 1292004: 1142005: 1382006: 1682007: 1662008: 1832009: 2492010: 3442011: 3832012: 4402013: 5512014: 6112015: 5722016: 2562017: 2312018: 2392019: 2632020: 3852021: 4212022: 4352023: 4712024: 380
1965peak 611 in 20142024

Frequent co-authors

Papers

showing 1–25 of 7,982 RSS

The Llama 3 Herd of Models

Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri +558 more

cs.AI · · cited 19,265× · arXiv ↗ · more like this ·

Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs…

OWL Web Ontology Language - Reference

Mike Dean, A.T. Schreiber, Sean Bechofer +6 more

Artificial Intelligence · Data Archiving and Networked Services (DANS) · · cited 2,392× · OpenAlex ↗ · more like this ·

The {W}eb {O}ntology {L}anguage {OWL} is a semantic markup language for publishing and sharing ontologies on the {W}orld {W}ide {W}eb. {OWL} is developed as a vocabulary extension of {RDF} (the {R}esource {D}escription {F}ramework) and is derived from the {DAML}+{OIL} {W}eb {O}ntology {L}anguage. {T}his document contains a structured informal description of the full set of {OWL} language constructs and is meant to serve as a reference for {OWL} users who want to construct {OWL} ontologies.

VL2

Albert Greenberg, James R. Hamilton, Navendu Jain +6 more

Computer Networks and Communications · Communications of the ACM · · cited 2,107× · DOI ↗ · more like this ·

To be agile and cost effective, data centers must allow dynamic resource allocation across large server pools. In particular, the data center network should provide a simple flat abstraction: it should be able to take any set of servers anywhere in the data center and give them the illusion that they are plugged into a physically separate, noninterfering Ethernet switch with as many ports as the service needs. To meet this goal, we present VL2, a practical network architecture that scales to support huge data centers with uniform high capacity between servers, performance isolation between services, and Ethernet layer-2 semantics. VL2 uses (1) flat addressing to allow service instances to be placed anywhere in the network, (2) Valiant Load Balancing to spread traffic uniformly across network paths, and (3) end system--based address resolution to scale to large server pools without…

Experimental Security Analysis of a Modern Automobile

Karl Koscher, Alexei Czeskis, Franziska Roesner +8 more

Signal Processing · · cited 1,834× · DOI ↗ · more like this ·

Modern automobiles are no longer mere mechanical devices; they are pervasively monitored and controlled by dozens of digital computers coordinated via internal vehicular networks. While this transformation has driven major advancements in efficiency and safety, it has also introduced a range of new potential risks. In this paper we experimentally evaluate these issues on a modern automobile and demonstrate the fragility of the underlying system structure. We demonstrate that an attacker who is able to infiltrate virtually any Electronic Control Unit (ECU) can leverage this ability to completely circumvent a broad array of safety-critical systems. Over a range of experiments, both in the lab and in road tests, we demonstrate the ability to adversarially control a wide range of automotive functions and completely ignore driver input\dash including disabling the brakes, selectively braking…

Data center TCP (DCTCP)

Mohammad Alizadeh, Albert Greenberg, David A. Maltz +5 more

Information Systems · · cited 1,818× · DOI ↗ · more like this ·

Cloud data centers host diverse applications, mixing workloads that require small predictable latency with others requiring large sustained throughput. In this environment, today's state-of-the-art TCP protocol falls short. We present measurements of a 6000 server production cluster and reveal impairments that lead to high application latencies, rooted in TCP's demands on the limited buffer space available in data center switches. For example, bandwidth hungry "background" flows build up queues at the switches, and thus impact the performance of latency sensitive "foreground" traffic.

The cost of a cloud

Albert Greenberg, James R. Hamilton, David A. Maltz +1 more

Information Systems · ACM SIGCOMM Computer Communication Review · · cited 1,623× · DOI ↗ · more like this ·

The data centers used to create cloud services represent a significant investment in capital outlay and ongoing costs. Accordingly, we first examine the costs of cloud service data centers today. The cost breakdown reveals the importance of optimizing work completed per dollar invested. Unfortunately, the resources inside the data centers often operate at low utilization due to resource stranding and fragmentation. To attack this first problem, we propose (1) increasing network agility, and (2) providing appropriate incentives to shape resource consumption. Second, we note that cloud service providers are building out geo-distributed networks of data centers. Geo-diversity lowers latency to users and increases reliability in the presence of an outage taking out an entire site. However, without appropriate design and management, these geo-diverse data center networks can raise the cost…

A Transformer-based Framework for Multivariate Time Series Representation Learning

George Zerveas, Srideepika Jayaraman, Dhaval Patel +2 more

cs.LG · · cited 1,567× · arXiv ↗ · more like this ·

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and classification, forecasting and missing value imputation. By evaluating our models on several benchmark datasets for multivariate time series regression and classification, we show that not only does our modeling approach represent the most successful method employing unsupervised learning of multivariate time series presented to date, but also that it exceeds the current state-of-the-art performance of supervised methods; it does so even when the number of training samples is very limited, while offering computational efficiency. Finally, we demonstrate that unsupervised pre-training of our transformer models offers a substantial performance benefit over fully…

Inference-Time Intervention: Eliciting Truthful Answers from a Language Model

Kenneth Li, Oam Patel, Fernanda Viégas +2 more

cs.LG · · cited 1,533× · arXiv ↗ · more like this ·

We introduce Inference-Time Intervention (ITI), a technique designed to enhance the "truthfulness" of large language models (LLMs). ITI operates by shifting model activations during inference, following a set of directions across a limited number of attention heads. This intervention significantly improves the performance of LLaMA models on the TruthfulQA benchmark. On an instruction-finetuned LLaMA called Alpaca, ITI improves its truthfulness from 32.5% to 65.1%. We identify a tradeoff between truthfulness and helpfulness and demonstrate how to balance it by tuning the intervention strength. ITI is minimally invasive and computationally inexpensive. Moreover, the technique is data efficient: while approaches like RLHF require extensive annotations, ITI locates truthful directions using only few hundred examples. Our findings suggest that LLMs may have an internal representation of the…

Are NLP Models really able to Solve Simple Math Word Problems?

Arkil Patel, Satwik Bhattamishra, Navin Goyal

cs.CL · · cited 1,367× · arXiv ↗ · more like this ·

The problem of designing NLP solvers for math word problems (MWP) has seen sustained research activity and steady gains in the test accuracy. Since existing solvers achieve high performance on the benchmark datasets for elementary level MWPs containing one-unknown arithmetic word problems, such problems are often considered "solved" with the bulk of research attention moving to more complex MWPs. In this paper, we restrict our attention to English MWPs taught in grades four and lower. We provide strong evidence that the existing MWP solvers rely on shallow heuristics to achieve high performance on the benchmark datasets. To this end, we show that MWP solvers that do not have access to the question asked in the MWP can still solve a large fraction of MWPs. Similarly, models that treat MWPs as bag-of-words can also achieve surprisingly high accuracy. Further, we introduce a challenge…

StarCoder: may the source be with you!

Raymond Li, Loubna Ben Allal, Yangtian Zi +64 more

cs.CL · · cited 1,336× · arXiv ↗ · more like this ·

The BigCode community, an open-scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder and StarCoderBase: 15.5B parameter models with 8K context length, infilling capabilities and fast large-batch inference enabled by multi-query attention. StarCoderBase is trained on 1 trillion tokens sourced from The Stack, a large collection of permissively licensed GitHub repositories with inspection tools and an opt-out process. We fine-tuned StarCoderBase on 35B Python tokens, resulting in the creation of StarCoder. We perform the most comprehensive evaluation of Code LLMs to date and show that StarCoderBase outperforms every open Code LLM that supports multiple programming languages and matches or outperforms the OpenAI code-cushman-001 model. Furthermore, StarCoder outperforms every model that is fine-tuned on Python…

HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition

Rajeev Ranjan, Vishal M. Patel, Rama Chellappa

cs.CV · · cited 1,309× · arXiv ↗ · more like this ·

We present an algorithm for simultaneous face detection, landmarks localization, pose estimation and gender recognition using deep convolutional neural networks (CNN). The proposed method called, HyperFace, fuses the intermediate layers of a deep CNN using a separate CNN followed by a multi-task learning algorithm that operates on the fused features. It exploits the synergy among the tasks which boosts up their individual performances. Additionally, we propose two variants of HyperFace: (1) HyperFace-ResNet that builds on the ResNet-101 model and achieves significant improvement in performance, and (2) Fast-HyperFace that uses a high recall fast face detector for generating region proposals to improve the speed of the algorithm. Extensive experiments show that the proposed models are able to capture both global and local information in faces and performs significantly better than many…

Image De-raining Using a Conditional Generative Adversarial Network

He Zhang, Vishwanath Sindagi, Vishal M. Patel

cs.CV · · cited 1,215× · arXiv ↗ · more like this ·

Severe weather conditions such as rain and snow adversely affect the visual quality of images captured under such conditions thus rendering them useless for further usage and sharing. In addition, such degraded images drastically affect performance of vision systems. Hence, it is important to solve the problem of single image de-raining/de-snowing. However, this is a difficult problem to solve due to its inherent ill-posed nature. Existing approaches attempt to introduce prior information to convert it into a well-posed problem. In this paper, we investigate a new point of view in addressing the single image de-raining problem. Instead of focusing only on deciding what is a good prior or a good framework to achieve good quantitative and qualitative performance, we also ensure that the de-rained image itself does not degrade the performance of a given computer vision algorithm such as…

Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks

Yizhong Wang, Swaroop Mishra, Pegah Alipoormolabashi +37 more

cs.CL · · cited 1,144× · arXiv ↗ · more like this ·

How well can NLP models generalize to a variety of unseen tasks when provided with task instructions? To address this question, we first introduce Super-NaturalInstructions, a benchmark of 1,616 diverse NLP tasks and their expert-written instructions. Our collection covers 76 distinct task types, including but not limited to classification, extraction, infilling, sequence tagging, text rewriting, and text composition. This large and diverse collection of tasks enables rigorous benchmarking of cross-task generalization under instructions -- training models to follow instructions on a subset of tasks and evaluating them on the remaining unseen ones. Furthermore, we build Tk-Instruct, a transformer model trained to follow a variety of in-context instructions (plain language task definitions or k-shot examples). Our experiments show that Tk-Instruct outperforms existing…

Trickle: a self-regulating algorithm for code propagation and maintenance in wireless sensor networks

Philip Levis, Neil Patel, David Culler +1 more

Computer Networks and Communications · UC Berkeley · · cited 1,136× · OpenAlex ↗ · more like this ·

We present Trickle, an algorithm for propagating and maintaining code updates in wireless sensor networks. Trickle uses a "polite gossip" policy, where nodes periodically broadcast a code summary to local neighbors but stay quiet if they have recently heard a summary identical to theirs. When a node hears an older summary than its own, it broadcasts an update. Instead of flooding a network with packets, the algorithm controls the send rate so each node hears a small trickle of packets, just enough to stay up to date. <p>We first analyze Trickle using an idealized single-cell network model, with perfect synchronization and no packet loss. Progressively relaxing these assumptions, we evaluate the algorithm in simulation, first without synchronization, then in the presence of loss, and finally in the multi-cell case. We validate these simulation results with empirical data from a…

Densely Connected Pyramid Dehazing Network

He Zhang, Vishal M. Patel

cs.CV · · cited 1,113× · arXiv ↗ · more like this ·

We propose a new end-to-end single image dehazing method, called Densely Connected Pyramid Dehazing Network (DCPDN), which can jointly learn the transmission map, atmospheric light and dehazing all together. The end-to-end learning is achieved by directly embedding the atmospheric scattering model into the network, thereby ensuring that the proposed method strictly follows the physics-driven scattering model for dehazing. Inspired by the dense network that can maximize the information flow along features from different levels, we propose a new edge-preserving densely connected encoder-decoder structure with multi-level pyramid pooling module for estimating the transmission map. This network is optimized using a newly introduced edge-preserving loss function. To further incorporate the mutual structural information between the estimated transmission map and the dehazed result, we propose…

Poverty and common mental disorders in developing countries.

Vikram Patel, Arthur M. Kleinman

Health · PubMed · · cited 1,105× · OpenAlex ↗ · more like this ·

A review of English-language journals published since 1990 and three global mental health reports identified 11 community studies on the association between poverty and common mental disorders in six low- and middle-income countries. Most studies showed an association between indicators of poverty and the risk of mental disorders, the most consistent association being with low levels of education. A review of articles exploring the mechanism of the relationship suggested weak evidence to support a specific association with income levels. Factors such as the experience of insecurity and hopelessness, rapid social change and the risks of violence and physical ill-health may explain the greater vulnerability of the poor to common mental disorders. The direct and indirect costs of mental ill-health worsen the economic condition, setting up a vicious cycle of poverty and mental disorder.…

Density-aware Single Image De-raining using a Multi-stream Dense Network

He Zhang, Vishal M. Patel

cs.CV · · cited 1,074× · arXiv ↗ · more like this ·

Single image rain streak removal is an extremely challenging problem due to the presence of non-uniform rain densities in images. We present a novel density-aware multi-stream densely connected convolutional neural network-based algorithm, called DID-MDN, for joint rain density estimation and de-raining. The proposed method enables the network itself to automatically determine the rain-density information and then efficiently remove the corresponding rain-streaks guided by the estimated rain-density label. To better characterize rain-streaks with different scales and shapes, a multi-stream densely connected de-raining network is proposed which efficiently leverages features from different scales. Furthermore, a new dataset containing images with rain-density labels is created and used to train the proposed density-aware network. Extensive experiments on synthetic and real datasets…

UNeXt: MLP-based Rapid Medical Image Segmentation Network

Jeya Maria Jose Valanarasu, Vishal M. Patel

eess.IV · · cited 1,047× · arXiv ↗ · more like this ·

UNet and its latest extensions like TransUNet have been the leading medical image segmentation methods in recent years. However, these networks cannot be effectively adopted for rapid image segmentation in point-of-care applications as they are parameter-heavy, computationally complex and slow to use. To this end, we propose UNeXt which is a Convolutional multilayer perceptron (MLP) based network for image segmentation. We design UNeXt in an effective way with an early convolutional stage and a MLP stage in the latent stage. We propose a tokenized MLP block where we efficiently tokenize and project the convolutional features and use MLPs to model the representation. To further boost the performance, we propose shifting the channels of the inputs while feeding in to MLPs so as to focus on learning local dependencies. Using tokenized MLPs in latent space reduces the number of parameters…

Analysis of a simple successive interference cancellation scheme in a DS/CDMA system

Pulin R. Patel, J.M. Holtzman

Computer Networks and Communications · IEEE Journal on Selected Areas in Communications · · cited 1,039× · DOI ↗ · more like this ·

Compensating for near/far effects is critical for satisfactory performance of DS/CDMA systems. So far, practical systems have used power control to overcome fading and near/far effects. Another approach, which has a fundamental potential in not only eliminating near/far effects but also in substantially raising the capacity, is multiuser detection and interference cancellation. Various optimal and suboptimal schemes have been investigated. Most of these schemes, however, get too complex even for relatively simple systems and rely on good channel estimates. For interference cancellation, estimation of channel parameters (viz. received amplitude and phase) is important. We analyze a simple successive interference cancellation scheme for coherent BPSK modulation, where the parameter estimation is done using the output of a linear correlator. We then extend the analysis for a noncoherent…

The nature of data center traffic

Srikanth Kandula, Sudipta Sengupta, Albert Greenberg +2 more

Information Systems · · cited 1,031× · DOI ↗ · more like this ·

We explore the nature of traffic in data centers, designed to support the mining of massive data sets. We instrument the servers to collect socket-level logs, with negligible performance impact. In a 1500 server operational cluster, we thus amass roughly a petabyte of measurements over two months, from which we obtain and report detailed views of traffic and congestion conditions and patterns. We further consider whether traffic matrices in the cluster might be obtained instead via tomographic inference from coarser-grained counter data.

PicoRodio supports ad hoc ultra-low power wireless networking

Jan M. Rabaey, M.J. Ammer, J.L. da Silva +2 more

Computer Networks and Communications · Computer · · cited 1,009× · DOI ↗ · more like this ·

Technology advances have made it conceivable to build and deploy dense wireless networks of heterogeneous nodes collecting and disseminating wide ranges of environmental data. Applications of such sensor and monitoring networks include smart homes equipped with security, identification, and personalization systems; intelligent assembly systems; warehouse inventory control; interactive learning toys; and disaster mitigation. The opportunities emerging from this technology give rise to new definitions of distributed computing and the user interface. Crucial to the success of these ubiquitous networks is the availability of small, lightweight, low-cost network elements, which the authors call PicoNodes. The authors present a configurable architecture that enables these opportunities to be efficiently realized in silicon. They believe that this energy-conscious system design and…

Visual Domain Adaptation: A survey of recent advances

Vishal M. Patel, Raghuraman Gopalan, Ruonan Li +1 more

Artificial Intelligence · IEEE Signal Processing Magazine · · cited 942× · DOI ↗ · more like this ·

In pattern recognition and computer vision, one is often faced with scenarios where the training data used to learn a model have different distribution from the data on which the model is applied. Regardless of the cause, any distributional change that occurs after learning a classifier can degrade its performance at test time. Domain adaptation tries to mitigate this degradation. In this article, we provide a survey of domain adaptation methods for visual recognition. We discuss the merits and drawbacks of existing domain adaptation approaches and identify promising avenues for research in this rapidly evolving field.

A Network Algorithm for Performing Fisher's Exact Test in <i>r</i> × <i>c</i> Contingency Tables

Cyrus R. Mehta, Nitin R. Patel

Statistics and Probability · Journal of the American Statistical Association · · cited 909× · DOI ↗ · more like this ·

Abstract An exact test of significance of the hypothesis that the row and column effects are independent in an r × c contingency table can be executed in principle by generalizing Fisher's exact treatment of the 2 × 2 contingency table. Each table in a conditional reference set of r × c tables with fixed marginal sums is assigned a generalized hypergeometric probability. The significance level is then computed by summing the probabilities of all tables that are no larger (on the probability scale) than the observed table. However, the computational effort required to generate all r × c contingency tables with fixed marginal sums severely limits the use of Fisher's exact test. A novel technique that considerably extends the bounds of computational feasibility of the exact test is proposed here. The problem is transformed into one of identifying all paths through a directed acyclic…

Interactive Medical Image Segmentation using Deep Learning with Image-specific Fine-tuning

Guotai Wang, Wenqi Li, Maria A. Zuluaga +8 more

cs.CV · · cited 780× · arXiv ↗ · more like this ·

Convolutional neural networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they have not demonstrated sufficiently accurate and robust results for clinical use. In addition, they are limited by the lack of image-specific adaptation and the lack of generalizability to previously unseen object classes. To address these problems, we propose a novel deep learning-based framework for interactive segmentation by incorporating CNNs into a bounding box and scribble-based segmentation pipeline. We propose image-specific fine-tuning to make a CNN model adaptive to a specific test image, which can be either unsupervised (without additional user interactions) or supervised (with additional scribbles). We also propose a weighted loss function considering network and interaction-based uncertainty for the fine-tuning. We applied this framework to…

Structural joins: a primitive for efficient XML query pattern matching

Shurug Al-Khalifa, H. V. Jagadish, Nick Koudas +3 more

Computer Networks and Communications · · cited 780× · DOI ↗ · more like this ·

XML queries typically specify patterns of selection predicates on multiple elements that have some specified tree structured relationships. The primitive tree structured relationships are parent-child and ancestor-descendant, and finding all occurrences of these relationships in an XML database is a core operation for XML query processing. We develop two families of structural join algorithms for this task: tree-merge and stack-tree. The tree-merge algorithms are a natural extension of traditional merge joins and the multi-predicate merge joins, while the stack-tree algorithms have no counterpart in traditional relational join processing. We present experimental results on a range of data and queries using the TIMBER native XML query engine built on top of SHORE. We show that while, in some cases, tree-merge algorithms can have performance comparable to stack-tree algorithms, in many…