arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Adam D. Cobb

42 papers · 1994–2026

1994: 11995: 01996: 01997: 01998: 01999: 02000: 02001: 02002: 02003: 02004: 02005: 02006: 02007: 02008: 02009: 02010: 02011: 12012: 02013: 02014: 02015: 02016: 02017: 12018: 42019: 32020: 62021: 32022: 42023: 42024: 42025: 72026: 4
1994peak 7 in 20252026

Frequent co-authors

Papers

showing 1–25 of 42 RSS

Improving Differential Evolution through Bayesian Hyperparameter Optimization

Subhodip Biswas, Debanjan Saha, Shuvodeep De +3 more

Artificial Intelligence · · cited 112× · DOI ↗ · more like this ·

We propose a novel Evolutionary Algorithm (EA) based on the Differential Evolution algorithm for solving global numerical optimization problem in real-valued continuous parameter space. The proposed MadDE algorithm leverages the power of the multiple adaptation strategy with respect to the control parameters and search mechanisms, and is tested on the benchmark functions taken from the CEC 2021 special session & competition on single-objective bound-constrained optimization. Experimental results indicate that MadDE is able to achieve superior performance on global numerical optimization problems when compared against state-of-the-art real-parameter optimizers. We also provide a hyperparameter optimization algorithm SUBHO for improving the search performance of any EA by finding an optimal set of control parameters, and demonstrate its efficacy in enhancing MadDE's performance on the…

Scaling Hamiltonian Monte Carlo Inference for Bayesian Neural Networks with Symmetric Splitting

Adam D. Cobb, Brian Jalaian

stat.ML · · cited 90× · arXiv ↗ · more like this ·

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) approach that exhibits favourable exploration properties in high-dimensional models such as neural networks. Unfortunately, HMC has limited use in large-data regimes and little work has explored suitable approaches that aim to preserve the entire Hamiltonian. In our work, we introduce a new symmetric integration scheme for split HMC that does not rely on stochastic gradients. We show that our new formulation is more efficient than previous approaches and is easy to implement with a single GPU. As a result, we are able to perform full HMC over common deep learning architectures using entire data sets. In addition, when we compare with stochastic gradient MCMC, we show that our method achieves better performance in both accuracy and uncertainty quantification. Our approach demonstrates HMC as a feasible option when…

Loss-Calibrated Approximate Inference in Bayesian Neural Networks

Adam D. Cobb, Stephen J. Roberts, Yarin Gal

stat.ML · · cited 46× · arXiv ↗ · more like this ·

Current approaches in approximate inference for Bayesian neural networks minimise the Kullback-Leibler divergence to approximate the true posterior over the weights. However, this approximation is without knowledge of the final application, and therefore cannot guarantee optimal predictions for a given task. To make more suitable task-specific approximations, we introduce a new loss-calibrated evidence lower bound for Bayesian neural networks in the context of supervised learning, informed by Bayesian decision theory. By introducing a lower bound that depends on a utility function, we ensure that our approximation achieves higher utility than traditional methods for applications that have asymmetric utility functions. Furthermore, in using dropout inference, we highlight that our new objective is identical to that of standard dropout neural networks, with an additional utility-dependent…

BayesOpt Adversarial Attack

Binxin Ru, Adam D. Cobb, Arno Blaas +1 more

Artificial Intelligence · International Conference on Learning Representations · · cited 44× · OpenAlex ↗ · more like this ·

Black-box adversarial attacks require a large number of attempts before finding successful adversarial examples that are visually indistinguishable from the original input. Current approaches relying on substitute model training, gradient estimation or genetic algorithms often require an excessive number of queries. Therefore, they are not suitable for real-world systems where the maximum query number is limited due to cost. We propose a query-efficient black-box attack which uses Bayesian optimisation in combination with Bayesian model selection to optimise over the adversarial perturbation and the optimal degree of search space dimension reduction. We demonstrate empirically that our method can achieve comparable success rates with 2-5 times fewer queries compared to previous state-of-the-art black-box attacks.

Bayesian Deep Learning for Exoplanet Atmospheric Retrieval

Frank Soboczenski, Michael D. Himes, Molly D. O'Beirne +8 more

astro-ph.EP · · cited 17× · arXiv ↗ · more like this ·

Over the past decade, the study of extrasolar planets has evolved rapidly from plain detection and identification to comprehensive categorization and characterization of exoplanet systems and their atmospheres. Atmospheric retrieval, the inverse modeling technique used to determine an exoplanetary atmosphere's temperature structure and composition from an observed spectrum, is both time-consuming and compute-intensive, requiring complex algorithms that compare thousands to millions of atmospheric models to the observational data to find the most probable values and associated uncertainties for each model parameter. For rocky, terrestrial planets, the retrieved atmospheric composition can give insight into the surface fluxes of gaseous species necessary to maintain the stability of that atmosphere, which may in turn provide insight into the geological and/or biological processes active…

Better call Surrogates: A hybrid Evolutionary Algorithm for Hyperparameter optimization

Subhodip Biswas, Adam D Cobb, Andreea Sistrunk +2 more

cs.NE · · cited 9× · arXiv ↗ · more like this ·

In this paper, we propose a surrogate-assisted evolutionary algorithm (EA) for hyperparameter optimization of machine learning (ML) models. The proposed STEADE model initially estimates the objective function landscape using RadialBasis Function interpolation, and then transfers the knowledge to an EA technique called Differential Evolution that is used to evolve new solutions guided by a Bayesian optimization framework. We empirically evaluate our model on the hyperparameter optimization problems as a part of the black box optimization challenge at NeurIPS 2020 and demonstrate the improvement brought about by STEADE over the vanilla EA.

Robust Decision-Making in the Internet of Battlefield Things Using Bayesian Neural Networks

Adam D. Cobb, Brian Jalaian, Nathaniel D. Bastian +1 more

Artificial Intelligence · 2021 Winter Simulation Conference (WSC) · · cited 7× · DOI ↗ · more like this ·

The Internet of Battlefield Things (IoBT) is a dynamically composed network of intelligent sensors and actuators that operate as a command and control, communications, computers, and intelligence complex-system with the aim to enable multi-domain operations. The use of artificial intelligence can help transform the IoBT data into actionable insight to create information and decision advantage on the battlefield. In this work, we focus on how accounting for uncertainty in IoBT systems can result in more robust and safer systems. Human trust in these systems requires the ability to understand and interpret how machines make decisions. Most real-world applications currently use deterministic machine learning techniques that cannot incorporate uncertainty. In this work, we focus on the machine learning task of classifying vehicles from their audio recordings, comparing deterministic…

Optimising Worlds to Evaluate and Influence Reinforcement Learning Agents

Richard Everett, Adam D. Cobb, Andrew Markham +1 more

Artificial Intelligence · Adaptive Agents and Multi-Agents Systems · · cited 5× · DOI ↗ · more like this ·

Training reinforcement learning agents on a distribution of procedurally generated environments has become an increasingly common method for obtaining more generalisable agents. However, this makes evaluation challenging, as the space of possible environment settings is large; simply looking at the average performance is insufficient for understanding how well - or how poorly - the agents perform. To address this, we introduce a method for strategically evaluating and influencing the behaviour of reinforcement learning agents. Using deep generative modelling to encode the environment, we propose a World Agent which efficiently generates and optimises worlds (i.e. environment settings) relative to the performance of the agents. Through the use of our method on two distinct environments, we demonstrate the existence of worlds which minimise and maximise agent reward beyond the typically…

Challenges and Opportunities in Neuro-Symbolic Composition of Foundation Models

Susmit Jha, Anirban Roy, Adam D. Cobb +2 more

Computer Vision and Pattern Recognition · · cited 4× · DOI ↗ · more like this ·

Trustworthy, resilient, and interpretable artificial intelligence (AI) is essential for effective operation of the Internet of Things (IoT) in adversarial environments. Such a robust and interpretable AI is needed to improve tactical coordination through scalability, corroboration, and context-aware intelligence. It is crucial to have robust machine learning (ML) models with characteristics such as low-supervision adaptability, decision explanations, and adaptive inference. Pre-trained large language models (LLMs) and foundation models (FMs) address some of these challenges, but are unpredictable and cannot directly solve complex tasks in mission-critical scenarios. However, their generalization capabilities make them potential building blocks for high-assurance AI/ML systems that compose multiple FMs and LLMs. In this paper, we propose combining neural foundation models (FMs) using…

On Diverse System-Level Design Using Manifold Learning and Partial Simulated Annealing

Adam D. Cobb, Anirban Roy, Daniel Elenius +2 more

Computational Theory and Mathematics · Proceedings of the Design Society · · cited 4× · DOI ↗ · more like this ·

Abstract The goal in system-level design is to generate a diverse set of high-performing design configurations that allow trade-offs across different objectives and avoid early concretization. We use deep generative models to learn a manifold of the valid design space, followed by Monte Carlo sampling to explore and optimize design over the learned manifold, producing a diverse set of optimal designs. We demonstrate the efficacy of our proposed approach on the design of an SAE race vehicle and propeller.

URSABench: Comprehensive Benchmarking of Approximate Bayesian Inference Methods for Deep Neural Networks

Meet P. Vadera, Adam D. Cobb, Brian Jalaian +1 more

cs.LG · · cited 4× · arXiv ↗ · more like this ·

While deep learning methods continue to improve in predictive accuracy on a wide range of application domains, significant issues remain with other aspects of their performance including their ability to quantify uncertainty and their robustness. Recent advances in approximate Bayesian inference hold significant promise for addressing these concerns, but the computational scalability of these methods can be problematic when applied to large-scale models. In this paper, we describe initial work on the development ofURSABench(the Uncertainty, Robustness, Scalability, and Accu-racy Benchmark), an open-source suite of bench-marking tools for comprehensive assessment of approximate Bayesian inference methods with a focus on deep learning-based classification tasks

Direct Amortized Likelihood Ratio Estimation

Adam D. Cobb, Brian Matejek, Daniel Elenius +2 more

stat.ML · · cited 3× · arXiv ↗ · more like this ·

We introduce a new amortized likelihood ratio estimator for likelihood-free simulation-based inference (SBI). Our estimator is simple to train and estimates the likelihood ratio using a single forward pass of the neural estimator. Our approach directly computes the likelihood ratio between two competing parameter sets which is different from the previous approach of comparing two neural network output values. We refer to our model as the direct neural ratio estimator (DNRE). As part of introducing the DNRE, we derive a corresponding Monte Carlo estimate of the posterior. We benchmark our new ratio estimator and compare to previous ratio estimators in the literature. We show that our new ratio estimator often outperforms these previous approaches. As a further contribution, we introduce a new derivative estimator for likelihood ratio estimators that enables us to compare likelihood-free…

hamiltorch: A PyTorch-based library for Hamiltonian Monte Carlo

Adam D. Cobb

Statistics and Probability · · cited 3× · DOI ↗ · more like this ·

This paper summarizes the recent developments of hamiltorch,1 which is a PyTorch-based library for Hamiltonian Monte Carlo (HMC). HMC is a gradient-based Markov chain Monte Carlo technique that has favorable scaling properties to high-dimensional parameter spaces, leading to it often becoming the sampling method of choice when derivatives are available. HMC is therefore especially suited to performing Bayesian inference over neural networks (NN). As a result hamiltorch has been specifically developed to sample from PyTorch NN models. The development of hamiltorch has also led to new sampling schemes that are part of the library. In this paper I will highlight such novelties as well as provide a brief introduction to the features of hamiltorch and highlight its use-cases in recently referenced work.

Identifying Sources and Sinks in the Presence of Multiple Agents with Gaussian Process Vector Calculus

Adam D. Cobb, Richard Everett, Andrew Markham +1 more

cs.MA · · cited 3× · arXiv ↗ · more like this ·

In systems of multiple agents, identifying the cause of observed agent dynamics is challenging. Often, these agents operate in diverse, non-stationary environments, where models rely on hand-crafted environment-specific features to infer influential regions in the system's surroundings. To overcome the limitations of these inflexible models, we present GP-LAPLACE, a technique for locating sources and sinks from trajectories in time-varying fields. Using Gaussian processes, we jointly infer a spatio-temporal vector field, as well as canonical vector calculus operations on that field. Notably, we do this from only agent trajectories without requiring knowledge of the environment, and also obtain a metric for denoting the significance of inferred causal features in the environment by exploiting our probabilistic method. To evaluate our approach, we apply it to both synthetic and real-world…

Don't stop with Joint Forces Command … cut AFRICOM too

Adam D. Cobb

Political Science and International Relations · African Security Review · · cited 2× · DOI ↗ · more like this ·

Abstract The United States Africa Command (AFRICOM) has been a military success but a strategic messaging failure. The United States’ relationships across Africa cannot be boiled down to military affairs. This paper argues that Africa has many more opportunities than challenges and thus requires a more balanced foreign policy solution from Washington DC than a new military command. For the military engagement that does need to take place, a more low-profile approach would benefit the United States in Africa.

Applications of Certainty Scoring for Machine Learning Classification and Out-of-Distribution Detection

Alexander Berenbeim, Adam D. Cobb, Anirban Roy +2 more

Artificial Intelligence · ACM transactions on probabilistic machine learning. · · cited 1× · DOI ↗ · more like this ·

Quantitative characterizations and estimations of uncertainty are of fundamental importance for machine learning classification, particularly in safety-critical settings where continuous real-time monitoring requires explainable and reliable scoring. Reliance on the maximum a posteriori principle to determine label classification can obscure the certainty of a label assignment. We develop a theoretical framework for quantitative scores of certainty and competence based on predicted probability estimates, formally prove their properties, and empirically confirm the inferential power of these properties across different data modalities, tasks, and model architectures. Our theoretical results establish that competent models have distinct distributions of certainty for true and false positives conditioned on inputs similar to training and testing data, and prove that this framework provides…

Bayesian graph representation learning for adversarial patch detection

Alexander Berenbeim, Alexander Wei, Adam D. Cobb +3 more

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

Representing context, reasoning within contexts, and providing quantitative assessments of machine learning (ML) model certainty are all tasks of fundamental importance for secure, interpretable, and reliable model development. Recent enthusiasm regarding generative ML models has highlighted the importance of representing context, which is contingent on relevant and contextual features of data and model predictions are unreliable on out-of-context inputs. Herein, we develop the theory of graph representation learning (GRL) to extend to Bayesian Graph Neural Networks and to incorporate various forms of uncertainty quantification to improve model development and application in the presence of adversarial attacks. Within this framework, we approach the challenge of adversarial patch detection using a synthesized dataset consisting of images from the APRICOT and COCO datasets to study…

Trinity AI Co-Designer for Hierarchical Oracle-guided Design of Cyber-Physical Systems

Adam D. Cobb, Anirban Roy, Daniel Elenius +1 more

Information Systems · · cited 1× · DOI ↗ · more like this ·

The design of complex cyber-physical systems entails satisfying several competing performance objectives. In practice, some design requirements are often implicit in the intuition and knowledge of designers who have many years of experience working with similar designs. Designers use this experience to sample a few promising candidates in the design space and evaluate or simulate them using detailed, typically slow scientific models. The goal in design is usually to generate a diverse set of high-performing design configurations that allow trade-offs across different objectives and avoid early concretization. In this paper, we present a demonstration of Trinity AI co-designer that implements a machine learning approach to automate some aspects of system design. Trinity implements an extension of oracle-guided inductive synthesis, where the learning approaches interact with a hierarchy…

Polysemantic Dropout: Conformal OOD Detection for Specialized LLMs

Ayush Gupta, Ramneet Kaur, Anirban Roy +3 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

We propose a novel inference-time out-of-domain (OOD) detection algorithm for specialized large language models (LLMs). Despite achieving state-of-the-art performance on in-domain tasks through fine-tuning, specialized LLMs remain vulnerable to incorrect or unreliable outputs when presented with OOD inputs, posing risks in critical applications. Our method leverages the Inductive Conformal Anomaly Detection (ICAD) framework, using a new non-conformity measure based on the model's dropout tolerance. Motivated by recent findings on polysemanticity and redundancy in LLMs, we hypothesize that in-domain inputs exhibit higher dropout tolerance than OOD inputs. We aggregate dropout tolerance across multiple layers via a valid ensemble approach, improving detection while maintaining theoretical false alarm bounds from ICAD. Experiments with medical-specialized LLMs show that our approach…

Privacy Preserving In-Context-Learning Framework for Large Language Models

Bishnu Bhusal, Manoj Acharya, Ramneet Kaur +5 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive information. Studies have highlighted the risk of information leakage, where adversaries can extract sensitive information embedded in the prompts. In this work, we introduce a novel private prediction framework for generating high-quality synthetic text with strong privacy guarantees. Our approach leverages the Differential Privacy (DP) framework to ensure worst-case theoretical bounds on information leakage without requiring any fine-tuning of the underlying models. The proposed method performs inference on private records and aggregates the resulting per-token output distributions. This enables the generation of longer and coherent synthetic text while maintaining privacy guarantees. Additionally, we propose…

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference

Colin Samplawski, Adam D. Cobb, Manoj Acharya +2 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Despite their widespread use, large language models (LLMs) are known to hallucinate incorrect information and be poorly calibrated. This makes the uncertainty quantification of these models of critical importance, especially in high-stakes domains, such as autonomy and healthcare. Prior work has made Bayesian deep learning-based approaches to this problem more tractable by performing inference over the low-rank adaptation (LoRA) parameters of a fine-tuned model. While effective, these approaches struggle to scale to larger LLMs due to requiring further additional parameters compared to LoRA. In this work we present $\textbf{Scala}$ble $\textbf{B}$ayesian $\textbf{L}$ow-Rank Adaptation via Stochastic Variational Subspace Inference (ScalaBL). We perform Bayesian inference in an $r$-dimensional subspace, for LoRA rank $r$. By repurposing the LoRA parameters as projection matrices, we are…

AGENT: An Aerial Vehicle Generation and Design Tool Using Large Language Models

Colin Samplawski, Adam D. Cobb, Susmit Jha

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Computer-aided design (CAD) is a promising application area for emerging artificial intelligence methods. Traditional workflows for cyberphysical systems create detailed digital models which can be evaluated by physics simulators in order to narrow the search space before creating physical prototypes. A major bottleneck of this approach is that the simulators are often computationally expensive and slow. Recent advancements in AI methods offer the possibility to accelerate these pipelines. We use the recently released AircraftVerse dataset, which is especially suited for developing and evaluating large language models for designs. AircraftVerse contains a diverse set of UAV designs represented via textual design trees together with detailed physics simulation results. Following the recent success of large language models (LLMs), we propose AGENT (Aircraft GENeraTor). AGENT is a…

Addressing Uncertainty in LLMs to Enhance Reliability in Generative AI

Ramneet Kaur, Colin Samplawski, Adam D. Cobb +8 more

cs.AI · · cited 0× · arXiv ↗ · more like this ·

In this paper, we present a dynamic semantic clustering approach inspired by the Chinese Restaurant Process, aimed at addressing uncertainty in the inference of Large Language Models (LLMs). We quantify uncertainty of an LLM on a given query by calculating entropy of the generated semantic clusters. Further, we propose leveraging the (negative) likelihood of these clusters as the (non)conformity score within Conformal Prediction framework, allowing the model to predict a set of responses instead of a single output, thereby accounting for uncertainty in its predictions. We demonstrate the effectiveness of our uncertainty quantification (UQ) technique on two well known question answering benchmarks, COQA and TriviaQA, utilizing two LLMs, Llama2 and Mistral. Our approach achieves SOTA performance in UQ, as assessed by metrics such as AUROC, AUARC, and AURAC. The proposed conformal…

Post-hoc Uncertainty Quantification for Neurosymbolic Artificial Intelligence

Alexander Berenbeim, Ramneet Kaur, Adam D. Cobb +3 more

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

The proliferation of deep neural network architectures into the space of mission-critical applications raises great risks given the lack of transparency behind model predictions and the paucity of reliable metrics to quantify model uncertainty. By combining certainty and competence scoring, derived from a recent post-hoc uncertainty quantification framework, and with the use of logic tensor networks (LTN), a form of neurosymbolic artificial intelligence, we examine and make improvements to the baseline xView2 neural network architecture developed for disaster damage assessment for aerial image data. This framework is able to identify gross incompetence on the part of the baseline model at damage assessment despite its superficially strong performance with unbalanced data, while also demonstrating the relative resilience of LTNs that incorporate the baseline model as a trainable feature.…

Impact of Parameter Sparsity on Stochastic Gradient MCMC Methods for Bayesian Deep Learning

Meet P. Vadera, Adam D. Cobb, Brian Jalaian +1 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Bayesian methods hold significant promise for improving the uncertainty quantification ability and robustness of deep neural network models. Recent research has seen the investigation of a number of approximate Bayesian inference methods for deep neural networks, building on both the variational Bayesian and Markov chain Monte Carlo (MCMC) frameworks. A fundamental issue with MCMC methods is that the improvements they enable are obtained at the expense of increased computation time and model storage costs. In this paper, we investigate the potential of sparse network structures to flexibly trade-off model storage costs and inference run time against predictive performance and uncertainty quantification ability. We use stochastic gradient MCMC methods as the core Bayesian inference method and consider a variety of approaches for selecting sparse network structures. Surprisingly, our…