arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Isaiah Andrews

27 papers · 2012–2026

2012: 12013: 02014: 42015: 22016: 22017: 42018: 02019: 12020: 22021: 02022: 32023: 12024: 02025: 22026: 5
2012peak 5 in 20262026

Frequent co-authors

Papers

showing 1–25 of 27 RSS

Identification of and correction for publication bias

Isaiah Andrews, Maximilian Kasy

econ.EM · · cited 363× · arXiv ↗ · more like this ·

Some empirical results are more likely to be published than others. Such selective publication leads to biased estimates and distorted inference. This paper proposes two approaches for identifying the conditional probability of publication as a function of a study's results, the first based on systematic replication studies and the second based on meta-studies. For known conditional publication probabilities, we propose median-unbiased estimators and associated confidence sets that correct for selective publication. We apply our methods to recent large-scale replication studies in experimental economics and psychology, and to meta-studies of the effects of minimum wages and de-worming programs.

Valid Two-Step Identification-Robust Confidence Sets for GMM

Isaiah Andrews

Statistics and Probability · The Review of Economics and Statistics · · cited 94× · DOI ↗ · more like this ·

In models with potentially weak identification, researchers often decide whether to report a robust confidence set based on an initial assessment of model identification. Two-step procedures of this sort can generate large coverage distortions for reported confidence sets, and existing procedures for controlling these distortions are quite limited. This paper introduces a generally applicable approach to detecting weak identification and constructing two-step confidence sets in GMM. This approach controls coverage distortions under weak identification and indicates strong identification, with probability tending to 1 when the model is well identified.

Conditional Linear Combination Tests for Weakly Identified Models

Isaiah Andrews

Statistics and Probability · Econometrica · · cited 72× · DOI ↗ · more like this ·

We introduce the class of conditional linear combination tests, which reject null hypotheses concerning model parameters when a data‐dependent convex combination of two identification‐robust statistics is large. These tests control size under weak identification and have a number of optimality properties in a conditional problem. We show that the conditional likelihood ratio test of Moreira, 2003 is a conditional linear combination test in models with one endogenous regressor, and that the class of conditional linear combination tests is equivalent to a class of quasi‐conditional likelihood ratio tests. We suggest using minimax regret conditional linear combination tests and propose a computationally tractable class of tests that plug in an estimator for a nuisance parameter. These plug‐in tests perform well in simulation and have optimal power in many strongly identified models, thus…

On the Informativeness of Descriptive Statistics for Structural Estimates

Isaiah Andrews, Matthew Gentzkow, Jesse M. Shapiro

Statistics and Probability · Econometrica · · cited 45× · DOI ↗ · more like this ·

We propose a way to formalize the relationship between descriptive analysis and structural estimation. A researcher reports an estimate ĉ of a structural quantity of interest c that is exactly or asymptotically unbiased under some base model. The researcher also reports descriptive statistics<a:math xmlns:a="http://www.w3.org/1998/Math/MathML" display="inline"><a:mover accent="true"><a:mi>γ</a:mi><a:mo>ˆ</a:mo></a:mover></a:math>that estimate features γ of the distribution of the data that are related to c under the base model. A reader entertains a less restrictive model that is local to the base model, under which the estimate ĉ may be biased. We study the reduction in worst‐case bias from a restriction that requires the reader's model to respect the relationship between c and γ specified by the base model. Our main result shows that the proportional reduction in worst‐case bias…

A Geometric Approach to Nonlinear Econometric Models

Isaiah Andrews, Anna Mikusheva

Statistics and Probability · Econometrica · · cited 40× · DOI ↗ · more like this ·

Conventional tests for composite hypotheses in minimum distance models can be unreliable when the relationship between the structural and reduced‐form parameters is highly nonlinear. Such nonlinearity may arise for a variety of reasons, including weak identification. In this note, we begin by studying the problem of testing a “curved null” in a finite‐sample Gaussian model. Using the curvature of the model, we develop new finite‐sample bounds on the distribution of minimum‐distance statistics. These bounds allow us to construct tests for composite hypotheses which are uniformly asymptotically valid over a large class of data generating processes and structural models.

Optimal Decision Rules for Weak GMM

Isaiah Andrews, Anna Mikusheva

econ.EM · · cited 15× · arXiv ↗ · more like this ·

This paper studies optimal decision rules, including estimators and tests, for weakly identified GMM models. We derive the limit experiment for weakly identified GMM, and propose a theoretically-motivated class of priors which give rise to quasi-Bayes decision rules as a limiting case. Together with results in the previous literature, this establishes desirable properties for the quasi-Bayes approach regardless of model identification status, and we recommend quasi-Bayes for settings where identification is a concern. We further propose weighted average power-optimal identification-robust frequentist tests and confidence sets, and prove a Bernstein-von Mises-type result for the quasi-Bayes posterior under weak identification.

Weighting for External Validity

Isaiah Andrews, Emily Oster

Statistics and Probability · SSRN Electronic Journal · · cited 8× · OpenAlex ↗ · more like this ·

External validity is a fundamental challenge in treatment effect estimation. Even when researchers credibly identify average treatment effects – for example through randomized experiments – the results may not extrapolate to the population of interest for a given policy question. If the population and sample differ only in the distribution of observed variables this problem has a well-known solution: reweight the sample to match the population. In many cases, however, the population and sample differ along dimensions unobserved by the researcher. We provide a tractable framework for thinking about external validity in such cases. Our approach relies on the fact that when the sample is drawn from the same support as the population of interest there exist weights which, if known, would allow us to reweight the sample to match the population. These weights are larger in a stochastic sense…

Inference for Losers

Isaiah Andrews, Dillon Bowen, Toru Kitagawa +1 more

Education · AEA Papers and Proceedings · · cited 5× · DOI ↗ · more like this ·

Researchers frequently report league tables ranking units (neighborhoods or firms, for instance) based on estimated coefficients. Since the rankings are formed based on estimates, however, the coefficients reported in league tables suffer from selection bias, with estimates for highly ranked units biased upward and those for low-ranked units biased downward. Further, conventional confidence intervals can undercover. This paper introduces corrected estimators and confidence intervals that address these biases, ensuring that estimates and confidence intervals reported for each position in a league table are median unbiased and have correct coverage, respectively.

Dutch Books for Language Models

Isaiah Andrews, Suproteem Sarkar

econ.GN · · cited 3× · arXiv ↗ · more like this ·

People increasingly use language models to support life decisions. Many such decisions involve a probabilistic forecast: How likely is a major life event, a natural disaster, or an economic outcome? Users of language models may implicitly trust that these forecasts fall out of a coherent world model. In this paper, we evaluate the coherence of language model probabilistic forecasts through a procedure that builds on a theorem due to de Finetti. We elicit forecasts from language models across events generated from stock returns data. We then use linear programs to compute the largest Dutch-book profit - the profit an arbitrageur could guarantee by betting against model-generated probabilities - which we use as a measure of incoherence. Our procedure does not require outcome labels, so we can evaluate coherence even in settings where outcomes are not observed or have not yet resolved. We…

Revealed Rationality: Label-Free Evaluation and Regularization from Representation Theorems

Isaiah Andrews

econ.TH · · cited 3× · arXiv ↗ · more like this ·

Representation theorems in decision theory establish that behavior satisfies certain axioms if and only if it can be rationalized by a well-defined objective. I argue that this ``if and only if'' structure provides a potentially useful foundation for label-free evaluation and regularization of LLMs and other AI systems. Axiom compliance can be checked from the model's own responses to synthetic choice problems, with no external labels or human feedback, and the penalties are readily computable. Because the axioms are necessary and sufficient, the resulting checks exhaust the implications of the relevant rationality standard for the elicited data: a model that passes cannot be rejected on rationality grounds by any further test of the same data. I discuss three instantiations: probabilistic coherence via a theorem of de Finetti, preference rationality via Afriat's theorem, and subjective…

GMM is Inadmissible Under Weak Identification

Isaiah Andrews, Anna Mikusheva

econ.EM · · cited 2× · arXiv ↗ · more like this ·

We consider estimation in moment condition models and show that under any bound on identification strength, asymptotically admissible (i.e. undominated) estimators in a wide class of estimation problems must be uniformly continuous in the sample moment function. GMM estimators are in general discontinuous in the sample moments, and are thus inadmissible. We show, by contrast, that bagged, or bootstrap aggregated, GMM estimators as well as quasi-Bayes posterior means have superior continuity properties, while results in the literature imply that they are equivalent to GMM when identification is strong. In simulations calibrated to published instrumental variables specifications, we find that these alternatives often outperform GMM.

Conditional Inference with a Functional Nuisance Parameter

Isaiah Andrews, Anna Mikusheva

math.ST · · cited 1× · arXiv ↗ · more like this ·

This paper shows that the problem of testing hypotheses in moment condition models without any assumptions about identification may be considered as a problem of testing with an infinite-dimensional nuisance parameter. We introduce a sufficient statistic for this nuisance parameter and propose conditional tests. These conditional tests have uniformly correct asymptotic size for a large class of models and test statistics. We apply our approach to construct tests based on quasi-likelihood ratio statistics, which we show are efficient in strongly identified models and perform well relative to existing alternatives in two examples.

AI in Econometric Theory: An Example

Isaiah Andrews, Anna Mikusheva

econ.EM · · cited 0× · arXiv ↗ · more like this ·

This note contains a story and a paper. The paper is about the admissibility of two-stage least squares with weak instruments, a topic we have worked on together since 2019. The story is about how we (or, rather, our LLMs) wrote the paper, and some thoughts on what this may mean for our field.

The purpose of an estimator is what it does: Misspecification, estimands, and over-identification

Isaiah Andrews, Jiafeng Chen, Otavio Tecchio

econ.EM · · cited 0× · arXiv ↗ · more like this ·

In over-identified models, misspecification -- the norm rather than exception -- fundamentally changes what estimators estimate. Different estimators imply different estimands rather than different efficiency for the same target. A review of recent applications of generalized method of moments in the American Economic Review suggests widespread acceptance of this fact: There is little formal specification testing and widespread use of estimators that would be inefficient were the model correct, including the use of "hand-selected" moments and weighting matrices. Motivated by these observations, we review and synthesize recent results on estimation under model misspecification, providing guidelines for transparent and robust empirical research. We also provide a new theoretical result, showing that Hansen's J-statistic measures, asymptotically, the range of estimates achievable at a…

Harvard Society of Fellows †

Isaiah Andrews, Timothy B. Armstrong

Statistics and Probability · · cited 0× · OpenAlex ↗ · more like this ·

We derive mean-unbiased estimators for the structural parameter in instru-mental variables models where the sign of one or more first stage coefficients is known. In the case with a single instrument, the unbiased estimator is unique. For cases with multiple instruments we propose a class of unbiased estimators and show that an estimator within this class is efficient when the instruments are strong while retaining unbiasedness in finite samples. We show numerically that unbiasedness does not come at a cost of increased dispersion: in the single instru-ment case, the unbiased estimator is less dispersed than the 2SLS estimator. Our finite-sample results apply to normal models with known variance for the reduced-form errors, and imply analogous results under weak instrument asymptotics with an unknown error distribution. ∗Preliminary version

A Geometric Approach to Weakly Identied Econometric Models

Isaiah Andrews, Anna Mikusheva

Statistics and Probability · · cited 0× · OpenAlex ↗ · more like this ·

Many nonlinear Econometric models show evidence of weak identication. In this paper we consider minimum distance statistics and show that in a broad class of models the problem of testing under weak identication is closely related to the problem of testing a curved null in a nite-sample Gaussian model. Using the curvature of the model, we develop new nite-sample bounds on the distribution of minimum-distance statistics, which we show can be used to detect weak identication and to construct tests robust to weak identication. We apply our new method to new Keynesian Phillips curve and DSGE examples and show that it provides a signicant improvement over existing approaches. Key words: weak identification, statistical differential geometry This draft: October, 2013. 1

Maximum Likelihood Inference in

Weakly Identi, Dsge Models, Isaiah Andrews +1 more

Statistics and Probability · · cited 0× · OpenAlex ↗ · more like this ·

This paper examines the problem of weak identi cation in maximum likelihood estimation and inference. The main motivating example is a multi-dimensional, non-linear DSGE model. We suggest a test for a simple hypothesis concerning the full parameter vector robust to weak identi cation. We also suggest a test for a composite hypothesis regarding sub-vector of parameters. The suggested test is shown to be exact when the nuisance parameter is strongly identi ed, and in some cases when nuisance parameter is weakly identi ed. Special attention is drawn to a question of estimating Fisher&amp;apos;s information. We make extensive use of martingale theory. Key words: weak identification, maximum likelihood, score test, C(α) − test

Conditional Linear Combination Tests for Weakly Identi Models, unpublished manuscript

Isaiah Andrews, Victor Chernozhukov, Denis Chetverikov +7 more

Statistics and Probability · · cited 0× · OpenAlex ↗ · more like this ·

We introduce the class of conditional linear combination tests, which reject null hypotheses concerning model parameters when a data-dependent convex combination of two identification-robust statistics is large. These tests control size under weak identification and have a number of optimality properties in a conditional problem. We show that the conditional likelihood ratio test of Moreira (2003) is a conditional linear combination test in models with one en-dogenous regressor, and that the class of conditional linear combination tests is equivalent to a class of quasi-conditional likelihood ratio tests. We suggest using minimax regret conditional linear combination tests and propose a computation-ally tractable class of tests that plug in an estimator for a nuisance parameter. These plug-in tests perform well in simulation and have optimal power in many strongly identified models…

Maximum likelihood inference in weakly identified DSGE models. Working Paper, MIT

Isaiah Andrews, Anna Mikusheva

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

This paper examines the problem of weak identification in maximum likelihood, motivated by problems with estimation and inference a multi-dimensional, non-linear DSGE model. We suggest a test for a simple hypothesis concerning the full parameter vector which is robust to weak identification. We also suggest a test for a composite hypothesis regarding a sub-vector of parameters. The suggested test is shown to be asymptotically exact when the nuisance param-eter is strongly identified, and in some cases when the nuisance parameter is weakly identified. We pay particular attention to the question of how to estimate Fisher&amp;apos;s information, and make extensive use of martingale theory. Key words: weak identification, maximum likelihood, score test, C(α) − test 1

Misspecification-Averse Estimation

Isaiah Andrews, Ricky Li, Yucheng Shang

econ.EM · · arXiv ↗ · more like this ·

We study optimal estimation when the likelihood may be misspecified. Building on tools from the theory of decision-making under uncertainty, we analyze a class of axiomatically grounded optimality criteria which nests several existing misspecification-robust objectives. Within this class, we introduce the constrained multiplier criterion, which allows for flexible misspecification attitudes. We prove a local asymptotic minimax theorem for this criterion, extending a classical efficiency bound to a limit experiment which incorporates moment-constrained misspecification concerns. We characterize asymptotically optimal estimators as Bayes decision rules under a flat prior and an exponentially tilted likelihood that incorporates the moment constraints, and show that feasible plug-in analogs are asymptotically optimal.

True and Pseudo-True Parameters

Isaiah Andrews, Harvey Barnhard, Jacob Carlson

econ.EM · · arXiv ↗ · more like this ·

Parameter estimates in misspecified models converge to pseudo-true parameter values, which minimize a population objective function. Pseudo-true values often differ from quantities of economic interest, raising questions of how, if at all, they are relevant for decision-making. To study this question we consider Bayesian decision-makers facing a linear population minimum distance problem. Within a class of priors motivated by the minimum distance objective, we characterize prior sequences under which posteriors concentrate on the pseudo-true value. This convergence is fragile to small changes in priors, implying that pseudo-true values are relevant for decision-making only in special cases. Constructive results are nevertheless possible in this setting, and we derive simple confidence intervals that guarantee correct average coverage for the true parameter under every prior in the class…

Certified Decisions

Isaiah Andrews, Jiafeng Chen

econ.EM · · arXiv ↗ · more like this ·

Hypothesis tests and confidence sets are ubiquitous in empirical research, yet their connection to subsequent decision-making is often unclear. We view statistical inference as pairing recommended decisions with guarantees of their quality---or certificates---and develop a theory of certified decisions. Specifically, we attach P-certificates---upper bounds on loss that hold with probability at least $1-α$---to recommended actions. We prove that it is without loss to limit attention to P-certificates generated by minimax decisions over confidence sets, or what Manski (2021) terms "as-if decisions with a set estimate." We further show that such certificates allow safe adoption decisions for ambiguity-averse downstream decision-makers. A parallel argument applies to E-certified decisions obtained from e-values in settings with unbounded loss. We illustrate this view of statistical…

Optimal Conditional Inference in Adaptive Experiments

Jiafeng Chen, Isaiah Andrews

stat.ME · · arXiv ↗ · more like this ·

We study batched bandit experiments and consider the problem of inference conditional on the realized stopping time, assignment probabilities, and target parameter, where all of these may be chosen adaptively using information up to the last batch of the experiment. Absent further restrictions on the experiment, we show that inference using only the results of the last batch is optimal. When the adaptive aspects of the experiment are known to be location-invariant, in the sense that they are unchanged when we shift all batch-arm means by a constant, we show that there is additional information in the data, captured by one additional linear function of the batch-arm means. In the more restrictive case where the stopping time, assignment probabilities, and target parameter are known to depend on the data only through a collection of polyhedral events, we derive computationally tractable…

The Transfer Performance of Economic Models

Isaiah Andrews, Drew Fudenberg, Lihua Lei +2 more

econ.TH · · arXiv ↗ · more like this ·

Economists often estimate models using data from a particular domain, e.g. estimating risk preferences in a particular subject pool or for a specific class of lotteries. Whether a model's predictions extrapolate well across domains depends on whether the estimated model has captured generalizable structure. We provide a tractable formulation for this "out-of-domain" prediction problem and define the transfer error of a model based on how well it performs on data from a new domain. We derive finite-sample forecast intervals that are guaranteed to cover realized transfer errors with a user-selected probability when domains are iid, and use these intervals to compare the transferability of economic models and black box algorithms for predicting certainty equivalents. We find that in this application, the black box algorithms we consider outperform standard economic models when estimated…