arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Troy Butler

18 papers · 2014–2026

2014: 22015: 02016: 02017: 12018: 12019: 02020: 22021: 02022: 12023: 12024: 42025: 32026: 3
2014peak 4 in 20242026

Frequent co-authors

Papers

showing 1–18 of 18 RSS

Inverse Problems for Physics-Based Process Models

Derek Bingham, Troy Butler, Donald Estep

Artificial Intelligence · Annual Review of Statistics and Its Application · · cited 22× · DOI ↗ · more like this ·

We describe and compare two formulations of inverse problems for a physics-based process model in the context of uncertainty and random variability: the Bayesian inverse problem and the stochastic inverse problem. We describe the foundations of the two problems in order to create a context for interpreting the applicability and solutions of inverse problems important for scientific and engineering inference. We conclude by comparing them to statistical approaches to related problems, including Bayesian calibration of computer models.

Solving Stochastic Inverse Problems using Sigma-Algebras on Contour Maps

Troy Butler, Don Estep, Simon Tavener +3 more

math.NA · · cited 6× · arXiv ↗ · more like this ·

We compute approximate solutions to inverse problems for determining parameters in differential equation models with stochastic data on output quantities. The formulation of the problem and modeling framework define a solution as a probability measure on the parameter domain for a given $σ-$algebra. In the case where the number of output quantities is less than the number of parameters, the inverse of the map from parameters to data defines a type of generalized contour map. The approximate contour maps define a geometric structure on events in the $σ-$algebra for the parameter domain. We develop and analyze an inherently non-intrusive method of sampling the parameter domain and events in the given $σ-$algebra to approximate the probability measure. We use results from stochastic geometry for point processes to prove convergence of a random sample based approximation method. We define a…

Parameter Estimation with Maximal Updated Densities

Michael Pilosov, Carlos del-Castillo-Negrete, Tian Yu Yen +2 more

math.NA · · cited 2× · arXiv ↗ · more like this ·

A recently developed measure-theoretic framework solves a stochastic inverse problem (SIP) for models where uncertainties in model output data are predominantly due to aleatoric (i.e., irreducible) uncertainties in model inputs (i.e., parameters). The subsequent inferential target is a distribution on parameters. Another type of inverse problem is to quantify uncertainties in estimates of "true" parameter values under the assumption that such uncertainties should be reduced as more data are incorporated into the problem, i.e., the uncertainty is considered epistemic. A major contribution of this work is the formulation and solution of such a parameter identification problem (PIP) within the measure-theoretic framework developed for the SIP. The approach is novel in that it utilizes a solution to a stochastic forward problem (SFP) to update an initial density only in the parameter…

Copula Transformations for Data-Consistent Inversion

Troy Butler, Tianyi Jiang, João Silva +2 more

stat.ML · · cited 0× · arXiv ↗ · more like this ·

Data-consistent inversion (DCI) constructs probability measures whose push-forward distributions agree with observed data, while iterative data-consistent inversion (iDCI) extends this framework to generalized stochastic inverse problems by enforcing multiple push-forward constraints sequentially. Although iDCI avoids the direct approximation of high-dimensional joint densities, its relationship to the original joint DCI solution has remained unclear. In this work, we establish this relationship through copula theory. Using Sklar's theorem, we derive a factorization of the DCI update into separate marginal and dependence transformations and show that the discrepancy remaining after convergence of the iDCI algorithm is entirely characterized by the copulas associated with the observed and predicted joint distributions. This characterization motivates a copula-transformed iDCI solution…

Nonparametric Bayesian Calibration of Computer Models

Haiyi Shi, Lei Yang, Jiarui Chi +4 more

stat.ME · · cited 0× · arXiv ↗ · more like this ·

Combining field data and computer models is a crucial step for making inferences, predictions, and decisions for complex science and engineering systems. We formulate and analyze a nonparametric Bayesian methodology for calibrating the distribution of parameters in a computer model using field observations. Our results include establishing; a unique nonparametric Bayesian posterior corresponding to a chosen prior with an explicit formula for the posterior density; a maximum entropy property of the posterior corresponding to the uniform prior; the almost everywhere continuity of the posterior density; and a comprehensive statistical analysis of an estimator based on importance sampling. They also include establishing the well-posedness of the nonparametric Bayesian solution of the calibration problem. We illustrate the results using several examples.

Building Population-Informed Priors for Bayesian Inference Using Data-Consistent Stochastic Inversion

Rebekah D. White, John D. Jakeman, Tim Wildey +1 more

stat.ME · · cited 0× · arXiv ↗ · more like this ·

Bayesian inference provides a powerful tool for leveraging observational data to inform model predictions and uncertainties. However, when such data is limited, Bayesian inference may not adequately constrain uncertainty without the use of highly informative priors. Common approaches for constructing informative priors typically rely on either assumptions or knowledge of the underlying physics, which may not be available in all scenarios. In this work, we consider the scenario where data are available on a population of assets/individuals, which occurs in many problem domains such as biomedical or digital twin applications, and leverage this population-level data to systematically constrain the Bayesian prior and subsequently improve individualized inferences. The approach proposed in this paper is based upon a recently developed technique known as data-consistent inversion (DCI) for…

Learning Quantities of Interest from Dynamical Systems for Observation-Consistent Inversion

Steven Mattis, Kyle Robert Steffen, Troy Butler +2 more

math.NA · · cited 0× · arXiv ↗ · more like this ·

Dynamical systems arise in a wide variety of mathematical models from science and engineering. A common challenge is to quantify uncertainties on model inputs (parameters) that correspond to a quantitative characterization of uncertainties on observable Quantities of Interest (QoI). To this end, we consider a stochastic inverse problem (SIP) with a solution described by a pullback probability measure. We call this an observation-consistent solution, as its subsequent push-forward through the QoI map matches the observed probability distribution on model outputs. A distinction is made between QoI useful for solving the SIP and arbitrary model output data. In dynamical systems, model output data are often given as a series of state variable responses recorded over a particular time window. Consequently, the dimension of output data can easily exceed $\mathcal{O}(1E4)$ or more due to the…

Designing experiments to reduce uncertainty in point source locations in the Helmholtz equation

Troy Butler

Artificial Intelligence · 2018 International Applied Computational Electromagnetics Society Symposium (ACES) · · cited 0× · DOI ↗ · more like this ·

We show how a recently developed approach to formulating and solving stochastic inverse problems can be combined with an expected information gain to determine the physical placement of sensors that optimally reduce the uncertainty in the point source location for the inhomogeneous Helmholtz equation.

A STOCHASTIC INVERSE PROBLEM FOR MULTISCALE MODELS

Nishant Panda, Troy Butler, Donald Estep +2 more

Computational Theory and Mathematics · International Journal for Multiscale Computational Engineering · · cited 0× · DOI ↗ · more like this ·

Descriptions of complex multiscaled physical systems often involve many physical processes interacting through a multitude of scales. In many cases, the primary interest lies in predicting behavior of the system at the macroscale (i.e., engineering scale) where continuum, physics-based, models such as partial differential equations provide high-fidelity descriptions. However, in multiscale systems, the behavior of continuum models can depend strongly on microscale properties and effects, which are often included in the macroscale model as a parameter field obtained by some upscaling process from a microscale model. Generally, a number of choices have to be made in choosing an upscaling procedure and the resulting representation of the parameter. These choices have a strong impact on both the fidelity and the computational efficiency of the model. Thus, choosing a good parameter…

A Data-Consistent Approach to Ensemble Filtering

Rylan Spence, Troy Butler, Clint Dawson

math.ST · · arXiv ↗ · more like this ·

Ensemble data assimilation is challenging when the ensemble size is substantially smaller than the state and observation dimensions, leaving empirical covariance information rank deficient and sensitive to finite sampling. We introduce the Quantity-of-Interest Principal Component Analysis Ensemble Data-Consistent Filter (QPCA-EnDCF), a deterministic filtering method motivated by data-consistent inversion that regularizes the update in the whitened forecast--observation mismatch space. The method restricts the correction to a rank-$κ$ empirical spectral subspace before mapping it to state space through an empirical EnDCF gain. We establish concentration and spectral-projector perturbation results and derive a bias--variance decomposition showing that truncation bias is governed by the discarded component of the population mean residual, while finite-ensemble variability depends on…

Iterative Data-Consistent Inversion with Multiple Push-forward Constraints

Tianyi Jiang, Troy Butler, Timothy Wildey +2 more

math.OC · · arXiv ↗ · more like this ·

A foundational challenge in uncertainty quantification involves estimating a probability measure on the space of uncertain parameters such that its push-forward through a computational model matches an observed probability measure on the output data associated with quantities of interest (QoI). When multiple, distinct sets of observational data are available, the desired parameter measure should simultaneously satisfy multiple push-forward constraints associated with various subsets of the QoI. In this work, we present a convergent measure-theoretic framework for solving this problem based on an iterative application of Data-Consistent Inversion (DCI). We first rigorously establish the theoretical optimality of the DCI solution to the standard problem, proving that it minimizes the $f$-divergence over the space of all possible pullback measures that satisfy the push-forward constraint.…

Variational Data-Consistent Assimilation

Rylan Spence, Troy Butler, Clint Dawson

math.NA · · arXiv ↗ · more like this ·

This work introduces a new class of four-dimensional variational data assimilation (4D-Var) methods grounded in data-consistent inversion (DCI) theory. The methods extend classical 4D-Var by incorporating a predictability-aware regularization term. The first method formulated is referred to as Data-Consistent 4D-Var (DC-4DVar), which is then enhanced using a Weighted Mean Error (WME) quantity-of-interest map to construct the DC-WME 4D-Var method. While the DC and DC-WME cost functions both involve a predictability-aware regularization term, the DC-WME function includes a modification to the model-data misfit, thereby improving estimation accuracy, robustness, and theoretical consistency in nonlinear and partially observed dynamical systems. Proofs are provided that establish the existence and uniqueness of the minimizer and analyze how a predictability assumption that is common within…

Optimal Experimental Design Criteria for Data-Consistent Inversion

Troy Butler, John Jakeman, Michael Pilosov +2 more

stat.ME · · arXiv ↗ · more like this ·

The ability to design effective experiments is crucial for obtaining data that can substantially reduce the uncertainty in the predictions made using computational models. An optimal experimental design (OED) refers to the choice of a particular experiment that optimizes a particular design criteria, e.g., maximizing a utility function, which measures the information content of the data. However, traditional approaches for optimal experimental design typically require solving a large number of computationally intensive inverse problems to find the data that maximizes the utility function. Here, we introduce two novel OED criteria that are specifically crafted for the data consistent inversion (DCI) framework, but do not require solving inverse problems. DCI is a specific approach for solving a class of stochastic inverse problems by constructing a pullback measure on uncertain…

Sequential Maximal Updated Density Parameter Estimation for Dynamical Systems with Parameter Drift

Carlos del-Castillo-Negrete, Rylan Spence, Troy Butler +1 more

stat.ME · · arXiv ↗ · more like this ·

We present a novel method for generating sequential parameter estimates and quantifying epistemic uncertainty in dynamical systems within a data-consistent (DC) framework. The DC framework differs from traditional Bayesian approaches due to the incorporation of the push-forward of an initial density, which performs selective regularization in parameter directions not informed by the data in the resulting updated density. This extends a previous study that included the linear Gaussian theory within the DC framework and introduced the maximal updated density (MUD) estimate as an alternative to both least squares and maximum a posterior (MAP) estimates. In this work, we introduce algorithms for operational settings of MUD estimation in real or near-real time where spatio-temporal datasets arrive in packets to provide updated estimates of parameters and identify potential parameter drift.…

A Distributions-based Approach for Data-Consistent Inversion

Kirana Bergstrom, Troy Butler, Tim Wildey

math.NA · · arXiv ↗ · more like this ·

We formulate a novel approach to solve a class of stochastic problems, referred to as data-consistent inverse (DCI) problems, which involve the characterization of a probability measure on the parameters of a computational model whose subsequent push-forward matches an observed probability measure on specified quantities of interest (QoI) typically associated with the outputs from the computational model. Whereas prior DCI solution methodologies focused on either constructing non-parametric estimates of the densities or the probabilities of events associated with the pre-image of the QoI map, we develop and analyze a constrained quadratic optimization approach based on estimating push-forward measures using weighted empirical distribution functions. The method proposed here is more suitable for low-data regimes or high-dimensional problems than the density-based method, as well as for…

From Displacements to Distributions: A Machine-Learning Enabled Framework for Quantifying Uncertainties in Parameters of Computational Models

Taylor Roper, Harri Hakula, Troy Butler

stat.ML · · arXiv ↗ · more like this ·

This work presents novel extensions for combining two frameworks for quantifying both aleatoric (i.e., irreducible) and epistemic (i.e., reducible) sources of uncertainties in the modeling of engineered systems. The data-consistent (DC) framework poses an inverse problem and solution for quantifying aleatoric uncertainties in terms of pullback and push-forward measures for a given Quantity of Interest (QoI) map. Unfortunately, a pre-specified QoI map is not always available a priori to the collection of data associated with system outputs. The data themselves are often polluted with measurement errors (i.e., epistemic uncertainties), which complicates the process of specifying a useful QoI. The Learning Uncertain Quantities (LUQ) framework defines a formal three-step machine-learning enabled process for transforming noisy datasets into samples of a learned QoI map to enable DC-based…

Convergence of Probability Densities using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification: Extensions to $L^p$

Troy Butler, Tim Wildey, Wenjuan Zhang

math.PR · · arXiv ↗ · more like this ·

A previous study analyzed the convergence of probability densities for forward and inverse problems when a sequence of approximate maps between model inputs and outputs converges in $L^\infty$. This work generalizes the analysis to cases where the approximate maps converge in $L^p$ for any $1\leq p < \infty$. Specifically, under the assumption that the approximate maps converge in $L^p$, the convergence of probability density functions solving either forward or inverse problems is proven in $L^q$ where the value of $1\leq q<\infty$ may even be greater than $p$ in certain cases. This greatly expands the applicability of the previous results to commonly used methods for approximating models (such as polynomial chaos expansions) that only guarantee $L^p$ convergence for some $1\leq p<\infty$. Several numerical examples are also included along with numerical diagnostics of solutions and…

Quantifying Uncertainty in Material Damage from Vibrational Data

Troy Butler, Antti Huhtala, Mika Juntunen

math.NA · · arXiv ↗ · more like this ·

The response of a vibrating beam to a force depends on many physical parameters including those determined by material properties. Damage caused by fatigue or cracks result in local reductions in stiffness parameters and may drastically alter the response of the beam. Data obtained from the vibrating beam are often subject to uncertainties and/or errors typically modeled using probability densities. The goal of this paper is to estimate and quantify the uncertainty in damage modeled as a local reduction in stiffness using uncertain data. We present various frameworks and methods for solving this parameter determination problem. We also describe a mathematical analysis to determine and compute useful output data for each method. We apply the various methods in a specified sequence that allows us to interface the various inputs and outputs of these methods in order to enhance the…