Author

Menon

4,048 papers · 1900–2026

1967peak 377 in 20252026

Frequent co-authors

Papers

showing 1–25 of 4,048 RSS

The Llama 3 Herd of Models

Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri +558 more

cs.AI · July 2024 · cited 19,265× · arXiv ↗ · more like this ·

Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs…

Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation

Konstantinos Kamnitsas, Christian Ledig, Virginia F. J. Newcombe +5 more

cs.CV · March 2016 · cited 3,428× · arXiv ↗ · more like this ·

We propose a dual pathway, 11-layers deep, three-dimensional Convolutional Neural Network for the challenging task of brain lesion segmentation. The devised architecture is the result of an in-depth analysis of the limitations of current networks proposed for similar applications. To overcome the computational burden of processing 3D medical scans, we have devised an efficient and effective dense training scheme which joins the processing of adjacent image patches into one pass through the network while automatically adapting to the inherent class imbalance present in the data. Further, we analyze the development of deeper, thus more discriminative 3D CNNs. In order to incorporate both local and larger contextual information, we employ a dual pathway architecture that processes the input images at multiple scales simultaneously. For post-processing of the network's soft segmentation, we…

OpenMP: an industry standard API for shared-memory programming

Leonardo Dagum, Ramesh Menon

Hardware and Architecture · IEEE Computational Science and Engineering · 1998 · cited 3,323× · DOI ↗ · more like this ·

At its most elemental level, OpenMP is a set of compiler directives and callable runtime library routines that extend Fortran (and separately, C and C++ to express shared memory parallelism. It leaves the base language unspecified, and vendors can implement OpenMP in any Fortran compiler. Naturally, to support pointers and allocatables, Fortran 90 and Fortran 95 require the OpenMP implementation to include additional semantics over Fortran 77. OpenMP leverages many of the X3H5 concepts while extending them to support coarse grain parallelism. The standard also includes a callable runtime library with accompanying environment variables.

Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approach

Giorgio Patrini, Alessandro Rozza, Aditya Menon +2 more

stat.ML · September 2016 · cited 1,745× · arXiv ↗ · more like this ·

We present a theoretically grounded approach to train deep neural networks, including recurrent networks, subject to class-dependent label noise. We propose two procedures for loss correction that are agnostic to both application domain and network architecture. They simply amount to at most a matrix inversion and multiplication, provided that we know the probability of each class being corrupted into another. We further show how one can estimate these probabilities, adapting a recent technique for noise estimation to the multi-class setting, and thus providing an end-to-end framework. Extensive experiments on MNIST, IMDB, CIFAR-10, CIFAR-100 and a large scale dataset of clothing images employing a diversity of architectures --- stacking dense, convolutional, pooling, dropout, batch normalization, word embedding, LSTM and residual layers --- demonstrate the noise robustness of our…

AutoRec

Suvash Sedhain, Aditya Krishna Menon, Scott Sanner +1 more

Information Systems · ANU Open Research (Australian National University) · 18 May 2015 · cited 1,180× · DOI ↗ · more like this ·

This paper proposes AutoRec, a novel autoencoder framework for collaborative filtering (CF). Empirically, AutoRec's compact and efficiently trainable model outperforms state-of-the-art CF techniques (biased matrix factorization, RBM-CF and LLORMA) on the Movielens and Netflix datasets.

Long-tail learning via logit adjustment

Aditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat +3 more

cs.LG · July 2020 · cited 1,092× · arXiv ↗ · more like this ·

Real-world classification problems typically exhibit an imbalanced or long-tailed label distribution, wherein many labels are associated with only a few samples. This poses a challenge for generalisation on such labels, and also makes naïve learning biased towards dominant labels. In this paper, we present two simple modifications of standard softmax cross-entropy training to cope with these challenges. Our techniques revisit the classic idea of logit adjustment based on the label frequencies, either applied post-hoc to a trained model, or enforced in the loss during training. Such adjustment encourages a large relative margin between logits of rare versus dominant labels. These techniques unify and generalise several recent proposals in the literature, while possessing firmer statistical grounding and empirical performance.

ViperGPT: Visual Inference via Python Execution for Reasoning

Dídac Surís, Sachit Menon, Carl Vondrick

cs.CV · 14 Mar 2023 · cited 884× · arXiv ↗ · more like this ·

Answering visual queries is a complex task that requires both visual processing and reasoning. End-to-end models, the dominant approach for this task, do not explicitly differentiate between the two, limiting interpretability and generalization. Learning modular programs presents a promising alternative, but has proven challenging due to the difficulty of learning both the programs and modules simultaneously. We introduce ViperGPT, a framework that leverages code-generation models to compose vision-and-language models into subroutines to produce a result for any query. ViperGPT utilizes a provided API to access the available modules, and composes them by generating Python code that is later executed. This simple approach requires no further training, and achieves state-of-the-art results across various complex visual tasks.

EVENODD: an efficient scheme for tolerating double disk failures in RAID architectures

Mario Blaum, J. Brady, Jehoshua Bruck +1 more

Computer Networks and Communications · IEEE Transactions on Computers · 1995 · cited 699× · DOI ↗ · more like this ·

We present a novel method, that we call EVENODD, for tolerating up to two disk failures in RAID architectures. EVENODD employs the addition of only two redundant disks and consists of simple exclusive-OR computations. This redundant storage is optimal, in the sense that two failed disks cannot be retrieved with less than two redundant disks. A major advantage of EVENODD is that it only requires parity hardware, which is typically present in standard RAID-5 controllers. Hence, EVENODD can be implemented on standard RAID-5 controllers without any hardware changes. The most commonly used scheme that employes optimal redundant storage (i.e., two extra disks) is based on Reed-Solomon (RS) error-correcting codes. This scheme requires computation over finite fields and results in a more complex implementation. For example, we show that the complexity of implementing EVENODD in a disk array…

PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models

Sachit Menon, Alexandru Damian, Shijia Hu +2 more

cs.CV · March 2020 · cited 656× · arXiv ↗ · more like this ·

The primary aim of single-image super-resolution is to construct high-resolution (HR) images from corresponding low-resolution (LR) inputs. In previous approaches, which have generally been supervised, the training objective typically measures a pixel-wise average distance between the super-resolved (SR) and HR images. Optimizing such metrics often leads to blurring, especially in high variance (detailed) regions. We propose an alternative formulation of the super-resolution problem based on creating realistic SR images that downscale correctly. We present an algorithm addressing this problem, PULSE (Photo Upsampling via Latent Space Exploration), which generates high-resolution, realistic images at resolutions previously unseen in the literature. It accomplishes this in an entirely self-supervised fashion and is not confined to a specific degradation operator used during training…

Online Peer and Editorial Recommendations, Trust, and Choice in Virtual Markets

Donnavieve Smith, Satya Menon, K. Sivakumar

Sociology and Political Science · Journal of Interactive Marketing · 5 Jul 2005 · cited 646× · DOI ↗ · more like this ·

This research examines the influence of recommendations on consumer decision making during online shopping experiences. Evidence from two empirical studies suggests that many online consumers seek and accept recommendations in order to effectively manage the amount of information available during online search processes. These findings suggest that consumers use the mere availability of peer recommendations as a decision-making heuristic, irrespective of the peer recommender's personal characteristics. Findings also suggest that consumer preference for peer versus editorial recommendations depends on the specific nature of the consumer's shopping goal: utilitarian or hedonic. Finally, results from this study indicate that consumers prefer peer and editorial recommendations over other types of effort-reducing cues that might be available during online search. As such, retailers must…

Developmental Changes in Mental Arithmetic: Evidence for Increased Functional Specialization in the Left Inferior Parietal Cortex

Susan M. Rivera, Allan L. Reiss, Mark A. Eckert +1 more

Statistics and Probability · Cerebral Cortex · 16 Feb 2005 · cited 622× · DOI ↗ · more like this ·

Arithmetic reasoning is arguably one of the most important cognitive skills a child must master. Here we examine neurodevelopmental changes in mental arithmetic. Subjects (ages 8-19 years) viewed arithmetic equations and were asked to judge whether the results were correct or incorrect. During two-operand addition or subtraction trials, for which accuracy was comparable across age, older subjects showed greater activation in the left parietal cortex, along the supramarginal gyrus and adjoining anterior intra-parietal sulcus as well as the left lateral occipital temporal cortex. These age-related changes were not associated with alterations in gray matter density, and provide novel evidence for increased functional maturation with age. By contrast, younger subjects showed greater activation in the prefrontal cortex, including the dorsolateral and ventrolateral prefrontal cortex and the…

A Model of Marketing Knowledge Use within Firms

Anil Menon, P. Rajan Varadarajan

Communication · Journal of Marketing · October 1992 · cited 596× · DOI ↗ · more like this ·

The process of knowledge utilization within firms has come to be viewed as an increasingly important area for research in light of its implications for organizational effectiveness. However, our current understanding of this phenomenon is limited because the process of knowledge use in organizations is complex and difficult to conceptualize and measure. Building on prior research in public policy, sociology, marketing, and other administrative disciplines, the authors first explicate the nature of knowledge utilization and propose a framework for circumscribing the concept of knowledge utilization. Next, using an emerging theoretical perspective on knowledge utilization, the “organizational” view, the authors present a conceptual model and research propositions that provide insights into informational and organizational factors that affect marketing knowledge utilization in firms.

Cause-Related Marketing: A Coalignment of Marketing Strategy and Corporate Philanthropy

P. Rajan Varadarajan, Anil Menon

Sociology and Political Science · Journal of Marketing · July 1988 · cited 582× · DOI ↗ · more like this ·

Cause-related marketing represents the confluence of perspectives from several specialized areas of inquiry such as marketing for nonprofit organizations, the promotion mix, corporate philanthropy, corporate social responsibility, fund-raising management, and public relations. The authors outline the concept of cause-related marketing, its characteristics, and how organizations, both for-profit and not-for-profit, can benefit from effective use of this promising marketing tool.

Diagnosing performance overheads in the xen virtual machine environment

Aravind Menon, Jose Renato Santos, Yoshio Turner +2 more

Computer Networks and Communications · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 11 Jun 2005 · cited 534× · DOI ↗ · more like this ·

Virtual Machine (VM) environments (e.g., VMware and Xen) are experiencing a resurgence of interest for diverse uses including server consolidation and shared hosting. An application's performance in a virtual machine environment can differ markedly from its performance in a non-virtualized environment because of interactions with the underlying virtual machine monitor and other virtual machines. However, few tools are currently available to help debug performance problems in virtual machine environments.In this paper, we present Xenoprof, a system-wide statistical profiling toolkit implemented for the Xen virtual machine environment. The toolkit enables coordinated profiling of multiple VMs in a system to obtain the distribution of hardware events such as clock cycles and cache and TLB misses. The toolkit will facilitate a better understanding of performance characteristics of Xen's…

Using game theory to analyze wireless ad hoc networks

Vivek Srivastava, James Neel, Allen B. MacKenzie +5 more

Computer Networks and Communications · IEEE Communications Surveys & Tutorials · 2005 · cited 478× · DOI ↗ · more like this ·

The application of mathematical analysis to the study of wireless ad hoc networks has met with limited success due to the complexity of mobility and traffic models, the dynamic topology, and the unpredictability of link quality that characterize such networks. The ability to model individual, independent decision makers whose actions potentially affect all other decision makers renders game theory particularly attractive to analyze the performance of ad hoc networks. In this article we describe how various interactions in wireless ad hoc networks can be modeled as a game. This allows the analysis of existing protocols and resource management schemes, as well as the design of equilibrium-inducing mechanisms that provide incentives for individual users to behave in socially-constructive ways. We survey the recent literature on game theoretic analysis of ad hoc networks, highlighting its…

Does label smoothing mitigate label noise?

Michal Lukasik, Srinadh Bhojanapalli, Aditya Krishna Menon +1 more

cs.LG · 5 Mar 2020 · cited 432× · arXiv ↗ · more like this ·

Label smoothing is commonly used in training deep learning models, wherein one-hot training labels are mixed with uniform label vectors. Empirically, smoothing has been shown to improve both predictive performance and model calibration. In this paper, we study whether label smoothing is also effective as a means of coping with label noise. While label smoothing apparently amplifies this problem --- being equivalent to injecting symmetric noise to the labels --- we show how it relates to a general family of loss-correction techniques from the label noise literature. Building on this connection, we show that label smoothing is competitive with loss-correction under label noise. Further, we show that when distilling models from noisy data, label smoothing of the teacher is beneficial; this is in contrast to recent findings for noise-free problems, and sheds further light on settings where…

Apache hadoop goes realtime at Facebook

Dhruba Borthakur, Jonathan David Gray, Joydeep Sen Sarma +9 more

Computer Networks and Communications · 12 Jun 2011 · cited 432× · DOI ↗ · more like this ·

Facebook recently deployed Facebook Messages, its first ever user-facing application built on the Apache Hadoop platform. Apache HBase is a database-like layer built on Hadoop designed to support billions of messages per day. This paper describes the reasons why Facebook chose Hadoop and HBase over other systems such as Apache Cassandra and Voldemort and discusses the application's requirements for consistency, availability, partition tolerance, data model and scalability. We explore the enhancements made to Hadoop to make it a more effective realtime system, the tradeoffs we made while configuring the system, and how this solution has significant advantages over the sharded MySQL database scheme used in other applications at Facebook and many other web-scale companies. We discuss the motivations behind our design choices, the challenges that we face in day-to-day operations, and future…

Anomaly Detection using One-Class Neural Networks

Raghavendra Chalapathy, Aditya Krishna Menon, Sanjay Chawla

cs.LG · February 2018 · cited 426× · arXiv ↗ · more like this ·

We propose a one-class neural network (OC-NN) model to detect anomalies in complex data sets. OC-NN combines the ability of deep networks to extract a progressively rich representation of data with the one-class objective of creating a tight envelope around normal data. The OC-NN approach breaks new ground for the following crucial reason: data representation in the hidden layer is driven by the OC-NN objective and is thus customized for anomaly detection. This is a departure from other approaches which use a hybrid approach of learning deep features using an autoencoder and then feeding the features into a separate anomaly detection method like one-class SVM (OC-SVM). The hybrid OC-SVM approach is sub-optimal because it is unable to influence representational learning in the hidden layers. A comprehensive set of experiments demonstrate that on complex data sets (like CIFAR and GTSRB)…

Visual Classification via Description from Large Language Models

Sachit Menon, Carl Vondrick

cs.CV · October 2022 · cited 425× · arXiv ↗ · more like this ·

Vision-language models (VLMs) such as CLIP have shown promising performance on a variety of recognition tasks using the standard zero-shot classification procedure -- computing similarity between the query image and the embedded words for each category. By only using the category name, they neglect to make use of the rich context of additional information that language affords. The procedure gives no intermediate understanding of why a category is chosen, and furthermore provides no mechanism for adjusting the criteria used towards this decision. We present an alternative framework for classification with VLMs, which we call classification by description. We ask VLMs to check for descriptive features rather than broad categories: to find a tiger, look for its stripes; its claws; and more. By basing decisions on these descriptors, we can provide additional cues that encourage using the…

Child Health and School Enrollment: A Longitudinal Analysis

Harold Alderman, Jere R. Behrman, Victor Lavy +1 more

Safety Research · The Journal of Human Resources · 2001 · cited 415× · DOI ↗ · more like this ·

Better child health is widely thought to improve school performance, and therefore post-school productivity. But most of the literature ignores that child health as well as child schooling reflects behavioral choices. Therefore the estimated impact of child health on child schooling in these studies may be biased, perhaps substantially. This study employs longitudinal data to investigate the impact of child health (as indicated by nutritional status) on school enrollments in rural Pakistan using an explicit dynamic model for the preferred estimates. These estimates use price shocks when children were of preschool age to control for behavior determining the child health stock measure. They indicate that child health (nutrition) is three times as important for enrollment than suggested by "naive estimates" that assume that child health is predetermined rather than determined by household…

The Promise of Infrastructure

Siddharth Menon

Political Science and International Relations · The AAG Review of Books · 2 Oct 2019 · cited 379× · DOI ↗ · more like this ·

Nikhil Anand, Akhil Gupta, and Hannah Appel, eds. Durham, NC: Duke University Press, 2018. viii and 256 pp., acknowledgments, contributors, index. $99.95 cloth (ISBN 978-1-4780-0003-7); $25.95 pape...

The principal-agent approach and the study of the European Union: promise unfulfilled?

Menon, Anand, Kassim, H

Political Science and International Relations · Journal of European Public Policy · 20 Feb 2003 · cited 359× · DOI ↗ · more like this ·

The principal-agent model holds great promise for understanding the institutional complexities of the EU and for moving beyond the sterile debate between intergovernmentalism and neofunctionalism. As yet, however, scholars have failed to exploit the insights that this construct affords. After a brief discussion of the principal-agent model, this article offers a critical examination of the way that the principal-agent approach has been deployed by liberal intergovernmentalism, institutional intergovernmentalism, historical institutionalist supranationalism, and rational-choice supranationalism. It argues that, in all four cases, the a priori commitments of the theorists, in support either of the view that the member states effectively control their supranational agents and dominate EU governance or of the belief in an inevitable trend towards greater integration, led by supranational…

The Neurodevelopmental Basis of Math Anxiety

Christina B. Young, Sarah S. Wu, Vinod Menon

Statistics and Probability · Psychological Science · 20 Mar 2012 · cited 330× · DOI ↗ · more like this ·

Math anxiety is a negative emotional reaction to situations involving mathematical problem solving. Math anxiety has a detrimental impact on an individual's long-term professional success, but its neurodevelopmental origins are unknown. In a functional MRI study on 7- to 9-year-old children, we showed that math anxiety was associated with hyperactivity in right amygdala regions that are important for processing negative emotions. In addition, we found that math anxiety was associated with reduced activity in posterior parietal and dorsolateral prefrontal cortex regions involved in mathematical reasoning. Multivariate classification analysis revealed distinct multivoxel activity patterns, which were independent of overall activation levels in the right amygdala. Furthermore, effective connectivity between the amygdala and ventromedial prefrontal cortex regions that regulate negative…

Status Differences in the Cognitive Activation of Social Networks

Edward B. Smith, Tanya Menon, Leigh Thompson

Sociology and Political Science · Organization Science · 30 Apr 2011 · cited 324× · DOI ↗ · more like this ·

We develop a dynamic cognitive model of network activation and show that people at different status levels spontaneously activate, or call to mind, different subsections of their networks when faced with job threat. Using a multimethod approach (General Social Survey data and a laboratory experiment), we find that, under conditions of job threat, people with low status exhibit a winnowing response (i.e., activating smaller and tighter subsections of their networks), whereas people with high status exhibit a widening response (i.e., activating larger and less constrained subsections of their networks). We integrate traditional network theories with cognitive psychology, suggesting that cognitively activating social networks is a precondition to mobilizing them. One implication is that narrowing the network in response to threat might reduce low-status group members' access to new…

Optimizing network virtualization in Xen

Aravind Menon, Alan L. Cox, Willy Zwaenepoel

Computer Networks and Communications · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 30 May 2006 · cited 322× · OpenAlex ↗ · more like this ·

BEST PAPER AWARD In this paper, we propose and evaluate three techniques for optimizing network performance in the Xen virtualized environment. Our techniques retain the basic Xen architecture of locating device drivers in a privileged `driver' domain with access to I/O devices, and providing network access to unprivileged `guest' domains through virtualized network interfaces. First, we redefine the virtual network interfaces of guest domains to incorporate high-level network offfload features available in most modern network cards. We demonstrate the performance benefits of high-level offload functionality in the virtual interface, even when such functionality is not supported in the underlying physical interface. Second, we optimize the implementation of the data transfer path between guest and driver…