Auxiliary information can improve estimation precision under probability sampling, but the relationship between the study and auxiliary variables may not be known well enough to specify suitable balancing variables. Distributionally balanced designs address this by targeting agreement between sample and population auxiliary distributions. We extend energy-based distributional balance to prescribed unequal inclusion probabilities by comparing the empirical sample distribution with an inclusion-probability-weighted population distribution. Under a regularity condition relating the study values divided by their inclusion probabilities to the auxiliaries, we establish an upper bound on the design variance of the Horvitz-Thompson estimator in terms of the expected energy distance. This bound motivates an algorithm that exchanges units between randomly paired candidate samples without…
In interactive systems where users engage with LLMs, users are adaptive and, after observing LLM responses, can change their prompting strategy, as well as the type and difficulty of subsequent tasks. Thus model responses can influence the set of prompts on which the model is subsequently evaluated. We study the implications of this user adaptivity and prompt endogeneity for the evaluation of LLMs. We define two classes of estimands for comparing models: the common-distribution effect, which compares model performance on the same distribution of prompts, and the induced-distribution effect, which compares each model on the prompt distribution generated through user interaction. We show that offline benchmark evaluation and live A/B testing target different quantities, with the standard difference-in-means estimators for the two methods converging to the common-distribution effect and…
Decomposable graphical models combine closed-form maximum likelihood estimation with local model comparison, which makes structure inference practical with many variables. The R package GraphInfer provides one likelihood framework for decomposable models of continuous, discrete and mixed data, the last as conditional Gaussian models. Structure inference ranges from exact minimum forests and stepwise search to stochastic global search. Nested models are compared by likelihood-ratio tests whose null distributions are exact in finite samples: conditionally on the discrete data for edges with a continuous endpoint, and conditionally on the discrete margins of the smaller model for edges between discrete variables. Missing values are handled by EM, by structural EM, which reuses complete-data searches through a weighted pseudo-sample of expected sufficient statistics, and by multiple…
Assigning positive prior probability to lower-dimensional submodels enriches the range of uncertainty that Bayesian models can represent. The resulting posterior distributions combine continuous parameter uncertainty with discrete model uncertainty. Efficient movement between these submodels, however, can be difficult to design. We propose the sticky manifold construction as a principled, modular framework for combining piecewise deterministic Markov processes (PDMPs) across different submodels. The integration is rejection-free, requires no additional likelihood evaluations, and retains the non-reversible and ballistic nature of the component PDMP dynamics. We prove that the resulting process leaves the intended mixed-dimensional target invariant. We also develop a manifold PDMP algorithm based on coordinate charts to provide the within-submodel dynamics and a blow-up procedure that…
In spatial risk attribution, continuous environmental exposures and unmeasured background factors often co-vary across broad geographic scales, making it difficult to separate true exposure effects from spatial confounding using finite disease counts. Existing remedies typically project out or penalize shared spatial trends, leaving unclear whether estimation instability stems from the overall capacity of the latent random field or from its directional alignment with exposure. By decomposing the Fisher-weighted smoothing operator of an additive Poisson point process model, we show that while effective degrees of freedom measure total smoothing capacity, the relative loss of Fisher information for the exposure coefficient is governed solely by a distinct directional quantity that we call penalized collinear overlap. Rotating the spatial kernel alters this information loss while holding…
External trial evidence can inform oncology trial design, but broad pooling may produce benchmarks poorly aligned with the planned population. We developed TRACE (Target-Trial Relevance Assessment and Compatibility-Guided Evidence Synthesis), combining eligibility screening, Bayesian compatibility assessment using published baseline characteristics, and hierarchical survival modeling. An integrated compatibility score based on the largest standardized difference in jointly reported characteristics identifies compatible external trials. Their reconstructed control-arm survival data are synthesized using a hierarchical beta-Stacy process to generate a predictive survival benchmark. We evaluated TRACE using eleven randomized phase III trials in first-line HER2-negative advanced gastric/gastroesophageal junction adenocarcinoma. With KEYNOTE-859 as the target, three external trials were…
In many applications, variability itself carries important predictive information beyond the mean, and its association with an outcome may further depend on the underlying mean trajectory. However, existing functional regression approaches primarily rely on mean-based representations of functional predictors, while variability is often ignored or reduced to scalar summaries. We propose a functional regression framework that incorporates latent mean and variance processes as predictors, together with their mean-variance interaction, allowing the predictive contribution of variability to depend on the underlying mean trajectory. We establish consistency and convergence rates for the estimated coefficient functions and interaction surface, accounting for reconstruction errors, increasing observation frequency, and diverging truncation dimensions without requiring independence between the…
This paper proposes a novel class of Bayesian Conjugate Distributions (BCDs) on extended special Euclidean groups SE_n(3) for global motion uncertainty representation and estimation. BCDs are constructed by restricting matrix Gaussian distributions on ambient Euclidean space to SE_n(3), avoiding singularity of local coordinates. The unique feature of BCDs is their conjugacy to a broad class of sampling distributions arising in motion estimation, enabling exact closed-form Bayesian inference. Optimal estimation with respect to BCDs is further investigated for implementing motion estimation. Two means are extracted as random state estimates, which maximize probability and minimize mean squared error, respectively. Moreover, within the BCD class, moment matching is shown to minimize the Kullback-Leibler divergence, and maximum likelihood estimation is also derived, which provide analytical…
Minimum-distance fitting selects a degree threshold and a power-law exponent from the same network. We study the procedure that fits a continuous Pareto law with the Hill estimator and minimizes the Kolmogorov--Smirnov distance over retained ranks. For homogeneous linear preferential attachment and Norros--Reittu graphs with Pareto weights, we derive the joint limiting law of the selected rank, retained fraction of the threshold tie, and exponent error. The selector retains of order $n^{2/(α+2)}$ of $n$ vertices, where $α$ is the survival exponent. At this rank, integer spacing and finite-degree departures from a Pareto tail have the same order as sampling fluctuations. The exponent estimate is consistent and retains a shift on the scale used for confidence intervals. For integer degree laws whose tail sums have a first-order inverse-degree expansion, adding the retained tie fraction…
AIDA is an R package that provides tools for the analysis of interval-valued data, including construction, visualization, robust estimation, and explainable outlier detection. The package is built around the intData class and is designed to support methodological research and applied workflows involving interval-valued data. AIDA implements methods for symbolic covariance estimation based on the Mallows distance, robust estimation via the Interval Minimum Covariance Determinant estimator, and explainable outlier detection using Shapley values. The package also includes visualization tools to support interpretation of the results and several interval-valued datasets.
Sample distance correlation can remain large between independent random walks. For centred walks with independent, identically distributed increments of finite, positive variance, we prove convergence in distribution to the distance correlation of the joint occupation measure of two independent Brownian paths. This universal limit lies strictly between zero and one almost surely and has full support on the unit interval. We calculate the expected squared distance covariance of the limiting measure and show that ordinary permutation calibration rejects independence with probability tending to one at every fixed nominal level. Gaussian simulations illustrate the persistent dispersion of random-walk correlations and the failure of permutation calibration.
This paper develops a boosting-based framework for estimating nonlinear spatial autoregressive models (SAR and SEM). Functional gradient descent boosting with spline base learners provides automatic selection of covariates and functional forms, while the spatial parameter is estimated by an extension of the closed-form, determinant-free estimator (CFE) of Smirnov (2020): we show that it remains consistent, with the same asymptotic variance formula, for any additive estimator admitting a smoothing-matrix representation, and we prove that the underlying quasi-score is Neyman-orthogonal to the nonlinear nuisance, which makes the flexible, regularized first stage safe. This flexibility, however, exposes the estimator to a spatial confounding problem that must be solved for the framework to deliver structural estimates. The geoadditive smooth of the coordinates, s(u, v), a default ingredient…
Unmeasured confounding factors in observational data may lead to biased estimates of the effect of an exposure on an outcome. Consequently, a central problem in causal inference based on observational data is sensitivity analysis with respect to unmeasured confounding. Existing sensitivity-analysis methods generally focus on worst-case bounds. We propose an exact method for quantifying the significance of confounding, defined here in terms of the complete range of analytical values of the stratification-based Risk Ratio over the set of all joint distributions compatible with the observed characteristics. We refer to the proposed method as Inverse Confounding Analysis (ICA) - it is described in [1]. This paper presents examples of applying ICA to several real-world statistical datasets and examines an important issue that has attracted criticism of the method: the practical feasibility…
We study the localization of mean changes in high-dimensional vector autoregressions (VARs) when the autoregressive dynamics remain common across regimes. We develop a three-step procedure that first obtains preliminary change-point estimates from the raw series ignoring the dependence structure, then estimates a common sparse VAR using observations away from the estimated changes, and finally filters the series to refine the change point locations. For a single change point, we show that the preliminary localization rate depends directly on the strength of temporal dependence, whereas filtering removes this dependence penalty from the oracle rate. With an estimated filter, the refined rate additionally reflects the error in estimating the VAR dynamics and the relation between the change in the stationary mean and the corresponding change in the VAR intercept. We characterize these…
Two-sided marketplace platforms often use randomized experiments to evaluate new features, raising the question of whether to randomize customers or listings. Randomizing the smaller (\emph{short}) side can reduce interference bias due to weaker competition, while randomizing the larger (\emph{long}) side provides a larger nominal sample, potentially reducing variance. On the surface, these competing considerations suggest a bias-variance trade-off in choosing which side to randomize. We investigate this trade-off in a two-sided marketplace with first-come, first-served (FCFS) booking and heterogeneous customer preferences, studying the bias and variance of difference-in-means estimators of the global average treatment effect. Our findings suggest that rather than a bias-variance tradeoff, in fact short-side randomization is generally preferable on {\em both} dimensions. We prove these…
The missing-at-random assumption underlies most analyses of incomplete data. Under nonmonotone missingness, it is especially stringent, imposing pattern-specific restrictions with different conditioning sets. A strictly weaker normalization condition is known to justify maximizing the observed-data likelihood. We show that every law satisfying this condition has a unique missing-at-random counterpart sharing its observed-data and complete-data distributions. Observed-data procedures developed under missing at random for identified functionals, including doubly robust estimators, therefore remain valid, with the same semiparametric efficiency bound. We then prove that the condition holds if and only if filling in the missing values from their conditional distribution under the true full model preserves the complete-data distribution, hence the name completion-invariant missingness. We…
Assessing the external validity of experimental results is a pervasive challenge in causal inference as internally valid findings need not generalize beyond sites in which the experiments were conducted. Since the number of sites is often smaller than the number of site-level variables that moderate causal effects, we develop a partial identification framework that lets practitioners assess external validity under a wide range of assumptions that allow extrapolation across site-level variables. Our optimization-driven approach can accommodate any affine family of parameter restrictions, such as interaction terms being dominated by direct effects (the "effect hierarchy principle"). Since standard estimating-equation arguments do not apply in our setting---underspecified parameter directions responsible for partial identification make the covariance matrix singular---we develop a novel…
This article introduces a novel nonparametric test for conditional mean independence, which formally evaluates whether a random vector X has an additional impact on the mean regression function of a response Y when a conditioning random vector Z is already included. By framing the problem as classical partial effect testing, our approach goes beyond traditional parametric models to provide a highly general and flexible framework. The test statistic is constructed using martingale difference divergence (MDD) after neutralizing the effect of Z on Y via a sieve approximation. The population residual MDD characterizes conditional mean independence under suitable moment conditions. We present a theoretical framework for the test under both a fixed number of basis functions and a growing sieve dimension. We derive the nonstandard and non-pivotal asymptotic null distributions in both regimes.…
We propose Fréchet oblique forests (FOF) for non-Euclidean regression with predictors and responses in metric spaces. An Alexandrov inner-product score defines directional splits in metric predictor spaces and recovers ordinary oblique splits for Euclidean predictors. Candidate splits are evaluated through pairwise response distances, avoiding repeated Fréchet mean computations during split search. Forest predictions minimize a weighted Fréchet criterion obtained by averaging leaf weights across trees. For compatible tree rules, we establish integrated consistency and polynomial risk bounds under explicit approximation and entropy conditions. Simulations with matrices, distributions, spherical data and mixed predictors, together with an application to taxi-flow networks, demonstrate competitive predictive performance.
Directional distributions can have the same normalized mean direction while differing substantially in shape. Comparing them requires a distance whose response to geometric displacement and probability overlap matches the statistical question. We examine ten bounded metrics or metric families for probability measures on the sphere, scaling each to have maximum value one, covering transport, sliced transport, kernel and energy distances, and comparisons based on probability mass. We explain which metrics describe weak convergence, which admit Hilbert-space norm representations, and which pairs attain the maximum distance. Examples and counterexamples show how these distinctions affect empirical comparisons and numerical approximations. A summary table and relationship diagram support the choice of a distance. The discussion separates exact metrics from finite representations, unbiased…
We introduce the Proper Random Walk (PRW) family of spline models with a particular focus on the Second-Order Proper Random Walk (PRW2), a proper stationary alternative to the standard random walk of order 2 (RW2) spline. The PRW2 retains the computational strengths and spline-like smoothing of the RW2 while providing uniform marginal variance and stable uncertainty behavior. The PRW2 model is governed by a range parameter that controls correlation decay: in the infinite-range limit, it recovers RW2. In addition to its discrete representation, we show that the PRW2 model admits a continuous-time formulation as the critically damped Matérn model with smoothness $ν=3/2$, which provides an interpretable parameterization and enables construction through a Galerkin finite-element approximation on general grids. To mitigate edge distortions on bounded domains, we propose a local boundary…
Finite mixture regression models are widely used to capture the heterogeneous effects of covariates on a response variable. Our study, motivated by the analysis of Chiroptera, explores the dynamic effects of various environmental, biological, and human-related covariates on the evolutionary development of bat forearm using finite Gaussian mixture regression (GMR) models. In this paper, we address two key questions: (1) which covariates are associated with the variation in forearm length; and (2) whether the associated covariates have the same effect across all subpopulations. To answer these questions, we propose two stepwise procedures within the finite GMR framework based on the weighted significance test (WEST): (1) a stepwise variable selection procedure to identify relevant influential covariates, and (2) a stepwise effect-type determination procedure to determine each relevant…
Conditional generative models have become the tool of choice for sampling posteriors in scientific inverse problems, where we seek to sample images or signals conditioned on a set of indirect and noisy measurements. Yet they are often overconfident, which is a critical failure in scientific applications where accurate uncertainty quantification is essential. Existing regularizers fall short in complementary ways: differentiable coverage objectives require the model's density and do not identify the posterior, while strictly proper scoring rules such as the energy score need only samples but do not directly enforce coverage. We close this gap by introducing a differentiable loss function based on the expected coverage probability, estimated from samples alone. It applies to any conditional generative model, with no need for tractable densities or architectural changes. We prove that it…
Learning heterogeneity from high-dimensional data has become a fundamental task across many data-driven fields. Cluster analysis is a widely used unsupervised tool for this purpose, and many existing methods have been adapted to high-dimensional settings through sparsity constraints. In contrast to algorithmic approaches, model-based clustering offers clean theoretical guaranties and computational simplicity, but can be restrictive in practice due to its reliance on specific parametric distributions. We propose a novel latent semiparametric mixture model for clustering, in which the observed data follow a Gaussian mixture after latent coordinate-wise monotone transformations. Furthermore, assuming a sparse optimal clustering rule in the latent space, we develop a new method, CESME, tailored for high-dimensional clustering. By allowing unspecified transformations, our framework becomes…
Functional random forests built on a single functional principal component decomposition of the whole domain may dilute features confined to short intervals, whose location is rarely known in advance. We propose two random forests based on window-specific functional principal components. The global-local functional random forest (GL-FRF) is a late-fusion method that stacks a tuned full-curve forest and one forest per window with penalised convex weights; it contains the full-curve forest as a feasible solution, and its weights indicate which parts of the domain drive the prediction. The window-concatenated functional random forest (WC-FRF) is an early-fusion method that trains a single tuned forest on the concatenated window-specific scores. On twenty UCR datasets, GL-FRF improved on a tuned full-curve forest with the same number of trees on 16, with Brier score reductions of up to…