arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

New this week

New in stat Statistics

394 papers in stat from 6 November to 12 November 2026.

Includes papers cross-listed here; the counts on the field chips are by primary category.

More fields

Whole archives

showing 1–25 of 394, newest first RSS

Sketching Language Models for Context Attribution

Christopher Liaw, Aranyak Mehta, Grigoris Velegkas +1 more

cs.DS · · cited 0× · arXiv ↗ · more like this ·

Context attribution asks how removing parts of a prompt changes a language model's output. We study leave-one-out (LOO) attribution for a prompt of $n$ tokens and a fixed measurement function. Computing all LOO values directly requires $n$ model evaluations. Under a stability assumption, our algorithm estimates all LOO values to error proportional to $\varepsilon$ with constant probability using $O(\sqrt{\log(1/\varepsilon)}/\varepsilon)$ evaluation calls. To complement our upper bound, we prove a matching $Ω(\sqrt{\log(1/\varepsilon)}/\varepsilon)$ lower bound on the number of evaluation calls in an oracle model. Empirically, we verify coefficient decay consistent with stability and evaluate the performance of our sketching algorithm on a small language-model retrieval task. Technically, our result is based on a sketching algorithm for arithmetic circuits whose Taylor coefficients…

Quantifying structural stability of transparent models for general insurance pricing

Félix Côté, Marie-Pier Côté

stat.ML · · cited 0× · arXiv ↗ · more like this ·

The short duration of general insurance contracts leads to rapid distributional shifts in the data, warranting regular model updates. This process may yield a post-update model that differs considerably from the pre-update model in both predictions and structure. Structural stability is upstream of predictive stability, yet existing structural stability metrics are mostly restricted to simple decision trees. Thus, we first introduce the notion of functional transparency, characterising models with a prediction function that can be expressed as a sum of univariate functions for main effects and bivariate functions for pairwise interactions. Then, we propose the Mean Squared Shape function distance, a metric to quantify the structural stability of functionally transparent models, which are particularly relevant in actuarial science. Using three public auto insurance datasets, we present a…

Unequal-probability distributional balance and the Horvitz-Thompson estimator

Blair Robertson, Chris Price, Marco Reale +1 more

stat.ME · · cited 0× · arXiv ↗ · more like this ·

Auxiliary information can improve estimation precision under probability sampling, but the relationship between the study and auxiliary variables may not be known well enough to specify suitable balancing variables. Distributionally balanced designs address this by targeting agreement between sample and population auxiliary distributions. We extend energy-based distributional balance to prescribed unequal inclusion probabilities by comparing the empirical sample distribution with an inclusion-probability-weighted population distribution. Under a regularity condition relating the study values divided by their inclusion probabilities to the auxiliaries, we establish an upper bound on the design variance of the Horvitz-Thompson estimator in terms of the expected energy distance. This bound motivates an algorithm that exchanges units between randomly paired candidate samples without…

Bayesian modeling of predictive stability under generalized Arrhenius non-linear kinetics

Lorenzo Mauri, Samantha Gleich, Michael Johnson +3 more

stat.AP · · cited 0× · arXiv ↗ · more like this ·

Predictive stability modeling is widely used in pharmaceutical development to establish product shelf-life by identifying the kinetic parameters that govern degradation behavior and using these parameters to extrapolate out in time. Recent approaches typically assume linear degradation dynamics and rely on the Arrhenius equation to model temperature-specific reaction rates. However, observed degradation profiles may reflect nonlinear reaction dynamics and more complex temperature-specific reaction rates, potentially leading to reduced accuracy in long-term predictions and motivating a more flexible approach. We propose a novel Bayesian framework which extends predictive stability modeling beyond simple Arrhenius low-order kinetic dynamics and accommodates complex degradation mechanisms. The degradation process is modeled through the Sestak-Berggren kinetic formulation, a flexible…

When Both Sides Adapt: The Challenges of Evaluating Interactive LLM Systems

Hannah Li

stat.ME · · cited 0× · arXiv ↗ · more like this ·

In interactive systems where users engage with LLMs, users are adaptive and, after observing LLM responses, can change their prompting strategy, as well as the type and difficulty of subsequent tasks. Thus model responses can influence the set of prompts on which the model is subsequently evaluated. We study the implications of this user adaptivity and prompt endogeneity for the evaluation of LLMs. We define two classes of estimands for comparing models: the common-distribution effect, which compares model performance on the same distribution of prompts, and the induced-distribution effect, which compares each model on the prompt distribution generated through user interaction. We show that offline benchmark evaluation and live A/B testing target different quantities, with the standard difference-in-means estimators for the two methods converging to the common-distribution effect and…

Linear Regression with Self-Selection Bias in Polynomial Time

Felix Zhou

math.ST · · cited 0× · arXiv ↗ · more like this ·

We revisit the problem of estimating $k$ linear regressors with self-selection bias in $n$ dimensions up to error $\varepsilon$ with the maximum self-selection criterion, as introduced by Cherapanamjeri, Daskalakis, Ilyas, and Zampetakis [CDIZ23, STOC]. Our main result is a $\mathrm{poly}(n,k,1/\varepsilon)$ time algorithm for the unknown-index variant of this problem, thereby improving upon the running times of the best known algorithms due to Gaitonde and Mossel [GM24] and Kalavasis, Mehrotra, and Zhou [KMZ26, COLT] with exponential dependence on $k$. Our algorithm succeeds in the presence of correlated noise between regressors, which captures the related setting of max-affine regression. Consequently, we also give the first polynomial-time algorithm for this problem, improving on the prior works of Ghosh, Pananjady, Guntuboyina, and Ramchandran [GPGR22, IEEE Transactions on…

Combinatorial Bernoulli Factories with Polynomially Many Coins

Renato Paes Leme, Rad Niazadeh

cs.DS · · cited 0× · arXiv ↗ · more like this ·

We provide an efficient implementation of combinatorial Bernoulli factories. Such a factory turns coins of unknown biases $x$ into a random vertex of a polytope $P$ whose mean is exactly $x$. For every affine slice of the cube (the class of polytopes that admit a factory), we give a single algorithm whose expected number of coin flips and running time at every interior $x$ are polynomial in the dimension and in $1/{δ_*}$, where ${δ_*}=\min_i\{x_i,1-x_i\}$ is never supplied to the algorithm. For perfect matchings this gives $O(n^{8}{δ_*}^{-2}\log(n/{δ_*}))$ flips, while the factory of Niazadeh, Paes Leme, and Schneider [STOC 2021] spends at least $n^{2n-1}$ flips in expectation at the uniform doubly stochastic matrix. For other polytopes, our method rounds exactly given a point deep inside $P$ and the promise that $x$ is far from the boundary of $P$.

Introducing Feedback Delays to Non-Delayed Adversarial MDPs: Optimal $\sqrt S$ and $\sqrt K$ Dependencies in Tabular and Linear AMDPs

Aarush Kulkarni, Khang Nguyen, William Chang +1 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

We study regret minimization in episodic Adversarial Markov Decision Processes (AMDPs) with unknown transitions and bandit feedback. In tabular AMDPs with $S$ states, $A$ actions, and horizon $H$, the best known $K$-episode regret is $\tilde O(HS\sqrt{AK})$, whose $\sqrt S$ gap to the $Ω(H\sqrt{SAK})$ lower bound has long remained open. In linear AMDPs with $d$-dimensional features, after a five-year line of improvements starting from $K^{14/15}$, computationally efficient algorithms without a simulator or exploratory assumptions still only attain $\tilde O(K^{3/4})$ regret. A common challenge in both settings is to estimate the Q-function of a changing policy: past data comes from earlier policies that differ from (and are correlated with) the current one, while freezing the policy for future episodes worsens the dependency on $K$. We instead propose a general technique called…

Improving Algorithmic Trading for BESS on Intraday Electricity Markets through Distributional Price Forecasts

Simon Hirsch, David Schaurecker, David Wozabal

q-fin.ST · · cited 0× · arXiv ↗ · more like this ·

Grid-scale battery energy storage systems (BESS) are becoming increasingly important in short-term energy markets, where they help balance fluctuations in variable renewable generation. In many countries, the continuous intraday market is the most important wholesale market for BESS to monetize their flexibility. In this paper, we propose an extension to the myopic rolling intrinsic policy that incorporates intraday price forecasts tailored specifically to the BESS trading problem. While a large literature addresses intraday price forecasting, most existing work focuses on volume-weighted prices during the last hours of trading and consequently fails to capture the features most relevant to BESS trading. Our approach addresses this gap by introducing a novel target variable derived from the limit order book and its dynamics. The resulting forecasts are designed to inform the…

Disentangling Spurious Correlations: How IRM Handles Diverse Shortcuts in Text Classification

Paul Grunenwald, Benoît Crabbé, Guillaume Wisniewski +1 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

In NLP, models trained via Empirical Risk Minimization (ERM) often exploit spurious correlations, such as dialectal markers, at the expense of robust linguistic features, thereby degrading their out-of-distribution (OOD) generalization. Invariant Risk Minimization (IRM) aims to suppress such shortcuts by identifying predictive relationships that remain stable across environments, but its practical utility for NLP remains debated. We use a causality-driven framework to evaluate IRM under three shortcut-generating mechanisms: label-generated features, confounding, and selection bias. Our results show that IRM successfully rejects shortcuts across the evaluated causal and anti-causal structures, including under limited environmental variation and increasing label noise. We then extend our analysis beyond controlled synthetic artifacts to two less constrained settings: gender-profession…

Isotonic least squares is robust to heteroscedasticity, unimodal least squares is not

Yannick Baraud

math.ST · · cited 0× · arXiv ↗ · more like this ·

We compare the least squares estimator (LSE) with the $\ell_{1}$-estimator recently introduced by Baraud and Maillard~\citeyearpar{BM-2026} for estimating a regression function under a fixed design, when the errors are independent but possibly heteroscedastic and heavy-tailed. We show that the two estimators coincide on the class of nondecreasing (or nonincreasing) functions on an interval. As a consequence, the isotonic LSE inherits the non-asymptotic $\ell_{1}$-risk bounds of the $\ell_{1}$-estimator, which only require a moment of order $p\in[1,2]$ on the errors and depend on the average of their $p$-th absolute moments rather than on their maximum. This coincidence no longer holds on the nonconvex class of unimodal functions: we exhibit a heteroscedastic Gaussian example in which the LSE is inconsistent while the $\ell_{1}$-estimator converges at the parametric rate. Finally, we…

GraphInfer: Statistical Inference for Decomposable Graphical Models in R

Rodrigo Labouriau

stat.ME · · cited 0× · arXiv ↗ · more like this ·

Decomposable graphical models combine closed-form maximum likelihood estimation with local model comparison, which makes structure inference practical with many variables. The R package GraphInfer provides one likelihood framework for decomposable models of continuous, discrete and mixed data, the last as conditional Gaussian models. Structure inference ranges from exact minimum forests and stepwise search to stochastic global search. Nested models are compared by likelihood-ratio tests whose null distributions are exact in finite samples: conditionally on the discrete data for edges with a continuous endpoint, and conditionally on the discrete margins of the smaller model for edges between discrete variables. Missing values are handled by EM, by structural EM, which reuses complete-data searches through a weighted pseudo-sample of expected sufficient statistics, and by multiple…

Prevalence Bounds for Edited Watermarked Text: Power Envelopes and Calibration Sensitivity

Kuancheng Ye

stat.ML · · cited 0× · arXiv ↗ · more like this ·

Watermark detectors decide whether one document came from a watermarked language model. Auditors often need a different number: the share of a corpus that did. We study this share for Gumbel-max and green-list (KGW) watermarks when every document may have been edited by an unknown amount. Without restrictions on the edits, the upper end of the identified set is 1. Combining a known least-favourable next-token distribution with a sequential coupling, we derive a power envelope indexed by three budgets: a retention floor, an entropy budget, and a budget for in-place substitutions, which for Gumbel-max make edited positions look less watermarked than human text. The envelope gives an identified set that is sharp for the alternatives it dominates, finite-sample bounds on the realized share of a fixed corpus with either the exact null or a null calibrated on an independent human sample, and…

Clustering professional football players using Gaussian mixture models: A case study of the English Premier League 2024/25

Harry O'Donnell, Antony M. Overstall

stat.AP · · cited 0× · arXiv ↗ · more like this ·

The increasing availability of detailed football performance data has created new opportunities for identifying player archetypes and informing recruitment and tactical decision-making. Most existing clustering approaches assign each player to a single group, despite the reality that many modern footballers perform hybrid roles spanning multiple stylistic categories. Performance data for 314 outfield players from the 2024/25 English Premier League season are analysed using a Gaussian mixture model (GMM) applied to principal component representations of player statistics. Unlike hard-assignment methods such as k-means, the GMM provides probabilistic cluster memberships, allowing uncertainty and role hybridity to be quantified. Seven player archetypes are identified in the full dataset. Posterior membership probabilities reveal a subset of players whose profiles span multiple clusters…

Temporal Regularized Learning: Self-Supervised Learning Local in Space and Time

Davide Wiest

cs.LG · · cited 1× · arXiv ↗ · more like this ·

Layer-local self-supervised objectives remove the backward pass between layers, but almost all still compute their loss over a batch of samples and are therefore local in space but not in time. We introduce Temporal Regularized Learning (TeReL), a spatially and temporally local learning rule for self-supervised representation learning from sequential input streams. The key idea is to instantiate a VICReg-style objective with temporally adjacent positives and non-differentiated running population statistics, yielding a per-neuron online loss with bounded state. The objective is a soft form of Slow Feature Analysis, and its gradient is a Hebbian update of the feedforward weights and an anti-Hebbian update of one lateral matrix per layer. The aim of the experiments is to show that the rule works in a small network, not to compete with backpropagation. On a class-chunked MNIST stream, a…

Control Variates to reduce the variance of the empirical Moment Generating Function: an extreme value perspective

Louison Bocquet-Nouaille, Jérôme Morio, Benjamin Bobbia +1 more

math.ST · · cited 0× · arXiv ↗ · more like this ·

Accurate estimation of Moment Generating Functions is fundamental in many applications, but empirical estimators have high variances. Within a control variate setup, Extreme Value Theory is leveraged to identify how extreme values affect the variance reduction method's optimality.

Sticky Manifold Piecewise Deterministic Monte Carlo for Bayesian Model Averaging

Hirofumi Shiba, Luke Hardcastle, Kengo Kamatani

stat.CO · · cited 0× · arXiv ↗ · more like this ·

Assigning positive prior probability to lower-dimensional submodels enriches the range of uncertainty that Bayesian models can represent. The resulting posterior distributions combine continuous parameter uncertainty with discrete model uncertainty. Efficient movement between these submodels, however, can be difficult to design. We propose the sticky manifold construction as a principled, modular framework for combining piecewise deterministic Markov processes (PDMPs) across different submodels. The integration is rejection-free, requires no additional likelihood evaluations, and retains the non-reversible and ballistic nature of the component PDMP dynamics. We prove that the resulting process leaves the intended mixed-dimensional target invariant. We also develop a manifold PDMP algorithm based on coordinate charts to provide the within-submodel dynamics and a blow-up procedure that…

Entire sig-jump-diffusions, their expected signature and applications to score-based generative modeling

Christa Cuchiero, Francesca Primavera, Sara Svaluto-Ferro

math.PR · · cited 0× · arXiv ↗ · more like this ·

We develop score-based generative models for time series and standard finite-dimensional data, building on the analytical computation of the expected signature of a new class of jump-diffusions, called entire sig-jump-diffusions. These are semimartingales whose characteristics are given by linear combinations of potentially infinitely many components of their own signature. We show that their expected signature can be computed by solving linear ODEs in the extended tensor algebra, providing a tractable foundation for learning procedures. Specifically, the learning of a generalized score function for jump diffusions, a key ingredient of our generative modeling framework, can be reduced to solving linear ODEs and a deterministic optimization problem. We further prove that polynomial jump-diffusions can be embedded into this framework, and that their expected signature reduces to a…

Identifiability and partial identification under spatial confounding in additive risk models

Sheng Pan

stat.ME · · cited 0× · arXiv ↗ · more like this ·

In spatial risk attribution, continuous environmental exposures and unmeasured background factors often co-vary across broad geographic scales, making it difficult to separate true exposure effects from spatial confounding using finite disease counts. Existing remedies typically project out or penalize shared spatial trends, leaving unclear whether estimation instability stems from the overall capacity of the latent random field or from its directional alignment with exposure. By decomposing the Fisher-weighted smoothing operator of an additive Poisson point process model, we show that while effective degrees of freedom measure total smoothing capacity, the relative loss of Fisher information for the exposure coefficient is governed solely by a distinct directional quantity that we call penalized collinear overlap. Rotating the spatial kernel alters this information loss while holding…

Uncertainty-aware quantum machine learning based on Dempster-Shafer theory

Marie Kempkes, Jakob Spiegelberg, Evert van Nieuwenburg +1 more

quant-ph · · cited 0× · arXiv ↗ · more like this ·

A large body of work in quantum machine learning has centered on characterizing the expressivity and performance of quantum models. In contrast, little attention has been paid to the reliability of predictions beyond average performance measures such as accuracy. In this work, we introduce an uncertainty-aware quantum classification framework based on Dempster-Shafer theory. This theory allows to express uncertainty through weights assigned not only to individual classification labels but to sets of labels. We introduce a training strategy that enables parameterized quantum circuits to learn such assignments directly from data. This provides an efficient way to prepare the corresponding quantum states and enables the application of different post-processing strategies. In particular, it offers a practical setting for quantum Dempster-Shafer fusion procedures with polynomial resource…

Stochastic Kernel Mode Decomposition: Information, Uncertainty, and Conditional Regime Inference

Boumediene Hamzi, Houman Owhadi

stat.ML · · cited 0× · arXiv ↗ · more like this ·

When do mode energies preserve regime information as measurement quality changes? Stochastic Kernel Mode Decomposition (sKMD) fits joint regime laws on signed KMD mode coordinates and transfers the reference mode posterior to regime probabilities and conditional reconstructions. For centered Gaussian regimes with independently varying known noise variances, fixed coordinate energies retain the full regime posterior precisely when all classes share their cross-covariances and class variances can differ only at isolated vertices of the covariance graph. We extend the characterization to nonzero means and show that freely varying correlated noise forces a fixed linear log-odds decoder to retain the full quadratic feature span even for two distinct centered regimes. At fixed quality, a three-regime example has no sufficient two-energy basis. Its smallest Bayes log-loss gap over bases of…

TRACE: Target-Trial Relevance Assessment and Compatibility-Guided Evidence Synthesis

Wei Wei, Liangze Ke, Tianzhi Tang +5 more

stat.ME · · cited 0× · arXiv ↗ · more like this ·

External trial evidence can inform oncology trial design, but broad pooling may produce benchmarks poorly aligned with the planned population. We developed TRACE (Target-Trial Relevance Assessment and Compatibility-Guided Evidence Synthesis), combining eligibility screening, Bayesian compatibility assessment using published baseline characteristics, and hierarchical survival modeling. An integrated compatibility score based on the largest standardized difference in jointly reported characteristics identifies compatible external trials. Their reconstructed control-arm survival data are synthesized using a hierarchical beta-Stacy process to generate a predictive survival benchmark. We evaluated TRACE using eleven randomized phase III trials in first-line HER2-negative advanced gastric/gastroesophageal junction adenocarcinoma. With KEYNOTE-859 as the target, three external trials were…

Functional Regression with Interacting Latent Mean and Variance Processes

Ching-Chia Chou, Jeng-Min Chiou

stat.ME · · cited 0× · arXiv ↗ · more like this ·

In many applications, variability itself carries important predictive information beyond the mean, and its association with an outcome may further depend on the underlying mean trajectory. However, existing functional regression approaches primarily rely on mean-based representations of functional predictors, while variability is often ignored or reduced to scalar summaries. We propose a functional regression framework that incorporates latent mean and variance processes as predictors, together with their mean-variance interaction, allowing the predictive contribution of variability to depend on the underlying mean trajectory. We establish consistency and convergence rates for the estimated coefficient functions and interaction surface, accounting for reconstruction errors, increasing observation frequency, and diverging truncation dimensions without requiring independence between the…

A Class of Bayesian Conjugate Distributions on $SE_n(3)$ for Motion Estimation

Shijie Wang, Haichao Gui, Rui Zhong

stat.ME · · cited 0× · arXiv ↗ · more like this ·

This paper proposes a novel class of Bayesian Conjugate Distributions (BCDs) on extended special Euclidean groups SE_n(3) for global motion uncertainty representation and estimation. BCDs are constructed by restricting matrix Gaussian distributions on ambient Euclidean space to SE_n(3), avoiding singularity of local coordinates. The unique feature of BCDs is their conjugacy to a broad class of sampling distributions arising in motion estimation, enabling exact closed-form Bayesian inference. Optimal estimation with respect to BCDs is further investigated for implementing motion estimation. Two means are extracted as random state estimates, which maximize probability and minimize mean squared error, respectively. Moreover, within the BCD class, moment matching is shown to minimize the Kullback-Leibler divergence, and maximum likelihood estimation is also derived, which provide analytical…

Automatic Threshold Selection Leaves Finite-Degree Bias in Network Power-Law Fits

Tiandong Wang

math.ST · · cited 0× · arXiv ↗ · more like this ·

Minimum-distance fitting selects a degree threshold and a power-law exponent from the same network. We study the procedure that fits a continuous Pareto law with the Hill estimator and minimizes the Kolmogorov--Smirnov distance over retained ranks. For homogeneous linear preferential attachment and Norros--Reittu graphs with Pareto weights, we derive the joint limiting law of the selected rank, retained fraction of the threshold tie, and exponent error. The selector retains of order $n^{2/(α+2)}$ of $n$ vertices, where $α$ is the survival exponent. At this rank, integer spacing and finite-degree departures from a Pareto tail have the same order as sampling fluctuations. The exponent estimate is consistent and retains a shift on the scale used for confidence intervals. For integer degree laws whose tail sums have a first-order inverse-degree expansion, adding the retained tie fraction…