arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Tim Hesterberg

15 papers · 1995–2026

1995: 21996: 01997: 11998: 11999: 22000: 02001: 02002: 02003: 02004: 02005: 02006: 02007: 22008: 12009: 12010: 12011: 12012: 02013: 02014: 12015: 02016: 02017: 02018: 02019: 02020: 02021: 02022: 02023: 02024: 12025: 02026: 1
1995peak 2 in 19952026

Frequent co-authors

Papers

showing 1–15 of 15 RSS

What Teachers Should Know about the Bootstrap: Resampling in the Undergraduate Statistics Curriculum

Tim Hesterberg

stat.OT · · cited 371× · arXiv ↗ · more like this ·

I have three goals in this article: (1) To show the enormous potential of bootstrapping and permutation tests to help students understand statistical concepts including sampling distributions, standard errors, bias, confidence intervals, null distributions, and P-values. (2) To dig deeper, understand why these methods work and when they don't, things to watch out for, and how to deal with these issues when teaching. (3) To change statistical practice---by comparing these methods to common t tests and intervals, we see how inaccurate the latter are; we confirm this with asymptotics. n >= 30 isn't enough---think n >= 5000. Resampling provides diagnostics, and more accurate alternatives. Sadly, the common bootstrap percentile interval badly under-covers in small samples; there are better alternatives. The tone is informal, with a few stories and jokes.

Weighted Average Importance Sampling and Defensive Mixture Distributions

Tim Hesterberg

Statistics and Probability · Technometrics · · cited 315× · DOI ↗ · more like this ·

Importance sampling uses observations from one distribution to estimate for another distribution by weighting the observations. Including the target distribution as one component of a mixture distribution bounds the weights and makes importance sampling more reliable. The usual importance-sampling estimate is a weighted average with weights that do not sum to 1. We discuss simple normalization and other, more efficient normalization methods. These innovations make importance sampling useful in a wider variety of problems. We demonstrate with a case study of oil-inventory reliability at a large utility.

Least angle and $\ell_1$ penalized regression: A review

Tim Hesterberg, Nam Hee Choi, Lukas Meier +1 more

stat.ME · · cited 309× · arXiv ↗ · more like this ·

Least Angle Regression is a promising technique for variable selection applications, offering a nice alternative to stepwise regression. It provides an explanation for the similar behavior of LASSO ($\ell_1$-penalized regression) and forward stagewise regression, and provides a fast implementation of both. The idea has caught on rapidly, and sparked a great deal of research interest. In this paper, we give an overview of Least Angle Regression and the current state of related research.

Matched-Block Bootstrap for Dependent Data

Edward Carlstein, Kim‐Anh Do, Peter Hall +3 more

Statistics and Probability · Bernoulli · · cited 103× · DOI ↗ · more like this ·

SUMMARY The block bootstrap for time series consists in randomly resampling blocks of consecutive values of the given data and aligning these blocks into a bootstrap sample Here we suggest improving the performance of this method by aligning with higher likelihood those blocks which match at their ends\t This is achieved by resampling the blocks according to a Markov chain whose transitions depend on the data\t The matching algorithms we propose take some of the dependence structure of the data into account\t They are based on a kernel estimate of the conditional lag one distribution or on a tted autoregression of small order\t Numerical and theoretical analyses in the case of estimating the variance of the sample mean show that matching reduces bias and perhaps unexpectedly has relatively little eect on variance\t Our theory extends to the case of smooth functions of a vector mean KEY…

Least Angle Regression and LASSO for Large Datasets

Chris Fraley, Tim Hesterberg

Statistics and Probability · Statistical Analysis and Data Mining The ASA Data Science Journal · · cited 37× · DOI ↗ · more like this ·

Abstract Least angle regression and LASSO (ℓ 1 ‐penalized regression) offer a number of advantages in variable selection applications over procedures such as stepwise or ridge regression, including prediction accuracy, stability, and interpretability. We discuss formulations of these algorithms that extend to datasets in which the number of observations could be so large that it would not be possible to access the matrix of predictors as a unit in computations. Our methods require a single pass through the data for orthogonal transformation, effectively reducing the dimension of the computations required to obtain the regression coefficients and residual sum of squares to the number of predictors, rather than the number of observations. Copyright © 2009 Wiley Periodicals, Inc. Statistical Analysis and Data Mining 1: 000‐000, 2009

Tail-Specific Linear Approximations for Efficient Bootstrap Simulations

Tim Hesterberg

Statistics and Probability · Journal of Computational and Graphical Statistics · · cited 8× · DOI ↗ · more like this ·

Abstract Two effective variance-reduction techniques for estimating probabilities and quantiles in the tails of bootstrap distributions—importance sampling and concomitants of order statistics—are based on linear approximations. Although these techniques offer potential asymptotic variance reductions by factors of nine to infinity, in practice the reductions may be only by a factor of two or smaller because of inaccurate linear approximations. We develop tail-specific linear approximations that are more accurate where the accuracy is important, in the tails of distributions. Our methods fall into two categories—influence function methods and regression methods. Both can be applied without problem-specific analytical calculations, and both have tail-specific versions. We apply the tail-specific approximations to importance sampling and concomitants and propose another technique that uses…

Power Analysis for Experiments with Clustered Data, Ratio Metrics, and Regression for Covariate Adjustment

Tim Hesterberg, Ben Knight

stat.ME · · cited 0× · arXiv ↗ · more like this ·

We describe how to calculate standard errors for A/B tests that include clustered data, ratio metrics, and/or covariate adjustment. We may do this for power analysis/sample size calculations prior to running an experiment using historical data, or after an experiment for hypothesis testing and confidence intervals. The different applications have a common framework, using the sample variance of certain residuals. The framework is compatible with modular software, can be plugged into standard tools, doesn't require computing covariance matrices, and is numerically stable. Using this approach we estimate that covariate adjustment gives a median 66% variance reduction for a key metric, reducing experiment run time by 66%.

Web: www.statsci.com/Hesterberg/tiltingLinear Approximations for Functional Statistics in Large-Sample Applications

Tim C. Hesterberg, Stephen J. Ellis, T. C. Hesterberg +1 more

Statistics and Probability · · cited 0× · OpenAlex ↗ · more like this ·

We discuss methods for obtaining linear approximations to a functional statistic, with particular application to bootstrapping medium to large datasets. Existing methods use analytical approximations, nite-di erence derivatives, or linear regression using bootstrap results. Finite-di erence methods require an additional n evaluations of a functional statistic (where n is the number of observations in the data set), and regression methods require that that the number of bootstrap samples B is substantially larger than n. We develop regressiontype methods that allow B to be much smaller, and that require no dedicated bootstrap samples. The method uses a prespeci ed or adaptively chosen design matrix.

Evaluating online ad campaigns in a pipeline: causal models at scale

David Chan, Tim Hesterberg, Rong Ge +3 more

Sociology and Political Science · · cited 0× · OpenAlex ↗ · more like this ·

Display ads proliferate on the web, but are they effective? Or are they irrelevant in light of all the other advertising that people see? We describe a way to answer these questions, quickly and accurately, without randomized experiments, surveys, focus groups or expert data analysts. Doubly robust estimation protects against the selection bias that is inherent in observational data, and a nonparametric test that is based on irrelevant outcomes provides further defense. Simulations based on realistic scenarios show that the resulting estimates are more robust to selection bias than traditional alternatives, such as regression modeling or propensity scoring. Moreover, computations are fast enough that all processing, from data retrieval through estimation, testing, validation and report generation, proceeds in an automated pipeline, without anyone needing to see the raw data.

Simulation and Bootstrapping for Teaching Statistics

Tim Hesterberg

Statistics and Probability · · cited 0× · OpenAlex ↗ · more like this ·

Some key ideas in statistics and probability are hard for students, including sampling distributions. Computer simulation lets students gain experience with and intuition for these concepts. Bootstrapping can reinforce that learning, and provide a way for students (and future practitioners!) to estimate sampling distributions when they have data but do not know the underlying distribution. Bootstrapping also frees us from the requirement to teach inference only for statistics for which simple formulas are available---we can bootstrap robust statistics like the median as easily as the mean. For the promise of simulation and bootstrapping to be realized, they must be available and easy to use in general-purpose statistical software, complete with the exploratory data analysis and inferential capabilities required in teaching and practice. We discuss some of the available software for…

Least-angle regression and Lasso for large datasets. Under review

Chris Fraley, Tim Hesterberg

Statistics and Probability · · cited 0× · OpenAlex ↗ · more like this ·

Least-Angle Regression and the LASSO (ℓ1-penalized regression) offer a number of advantages over procedures such as stepwise or ridge regression in variable selection applications, including prediction accuracy, stability and interpretability. We discuss formulations of these algorithms that extend to datasets in which the number of observations could be so large that it would not be possible to access the predictors as a unit in computations. Our methods require a single pass through the data for orthogonal transformation, effectively reducing the dimension of the computations required to obtain the regression coefficients and residual sums-of-squares.

Bootstrap Tilting Confidence Intervals and Hypothesis Tests

Tim C. Hesterberg

Applied Mathematics · · cited 0× · OpenAlex ↗ · more like this ·

Bootstrap tilting confidence intervals could be the method of choice in many applications for reasons of both speed and accuracy. With the right implementation, tilting intervals are 37 times as fast as bootstrap BC-a limits, in terms of the number of bootstrap samples needed for comparable simulation accuracy. Thus 100 bootstrap samples might suffice instead of 3700. Tilting limits have other desirable properties --- second-order accuracy, transformation invariance, and better finite-sample coverage and/or shorter intervals on average than competing procedures. Key Words: bootstrap, importance sampling. 1 Introduction We begin with a short introduction to the bootstrap; for a more complete introduction see [9]. The original data is X = (x 1 ; x 2 ; : : : ; xn ), a sample from an unknown distribution F , which may be multivariate. Let ` = `(F ) be a real-valued functional parameter of…

Computation of Weighted Functional Statistics Using Software That Does Not Support Weights

Stephen J. Ellis, Tim C. Hesterberg

Statistics and Probability · · cited 0× · OpenAlex ↗ · more like this ·

We discuss methods for calculating statistics for weighted samples using software that does not support weights. Such samples arise in survey sampling with unequal probabilities, importance sampling, and bootstrap tilting. The software might not support weights for reasons of efficiency, simplicity, or because it was quicker to write the software without supporting weights. We discuss several techniques, both deterministic and random, for efficiently approximating the answer that would be obtained if the software supported weights.

Matched-Block Bootstrap for Long Memory Processes

Tim Hesterberg

Law · · cited 0× · OpenAlex ↗ · more like this ·

The block bootstrap for time series consists in randomly resampling blocks of consecutive values of the given data and aligning these blocks into a bootstrap sample. The matchedblock bootstrap (Carlstein et al. (1997)) samples blocks dependently, attempting to follow each block with one that might realistically follow it in the underlying process, to better match the dependence structure of the data. Blocks may bematched using a single value at the end of a block, which is ideal for Markov processes. We investigate other block matching rules, based on linear combinations of observations in the block which forecast the future of the series, and find the new rules to be more suitable for long memory processes.

Polynomial Histograms for Memory-Efficient Representation of Long-tailed System Distributions

Murray Stokely, Tim Hesterberg, Arif Merchant +1 more

cs.DC · · arXiv ↗ · more like this ·

Distributed systems must frequently keep track of many different types of performance metrics across many different computers. For example, the latency distribution of certain operations may be computed for a large combination of computers, users, and operations. These empirical distributions need to be collected at minimal expense on the individual software components, efficiently aggregated across multiple dimensions, and stored in a compact representation for a variety of downstream data analysis applications. We describe an information loss metric for binned data that allows us to optimize cost of information loss from different histogram representations. We explore the use of polynomial histograms where each bin of a histogram is annotated with moments of the underlying distribution in that bin. These polynomial histograms are compared to traditional histograms using the same…