an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org
Author
245 papers · 1889–2026
showing 1–25 of 245 RSS
Whitney K. Newey, Kenneth D. West
This paper describes a simple method of calculating a heteroskedasticity and autocorrelation consistent covariance matrix that is positive semi-definite by construction. It also establishes consistency of the estimated covariance matrix under fairly general conditions.
Victor Chernozhukov, Denis Chetverikov, Mert Demirer +4 more
We revisit the classic semi‐parametric problem of inference on a low‐dimensional parameter θ0 in the presence of high‐dimensional nuisance parameters η0. We depart from the classical setting by allowing for η0 to be so high‐dimensional that the traditional assumptions (e.g. Donsker properties) that limit complexity of the parameter space for this object break down. To estimate η0, we consider the use of statistical or machine learning (ML) methods, which are particularly well suited to estimation in modern, very high‐dimensional cases. ML methods perform well by employing regularization to reduce variance and trading off regularization bias with overfitting in practice. However, both regularization bias and overfitting in estimating η0 cause a heavy bias in estimators of θ0 that are obtained by naively plugging ML estimators of η0 into estimating equations for θ0. This bias results in…
Whitney K. Newey, Daniel McFadden
Asymptotic distribution theory is the primary method used to examine the properties of econometric estimators and tests. We present conditions for obtaining cosistency and asymptotic normality of a very general class of estimators (extremum estimators). Consistent asymptotic variance estimators are given to enable approximation of the asymptotic distribution. Asymptotic efficiency is another desirable property then considered. Throughout the chapter, the general results are also specialized to common econometric estimators (e.g. MLE and GMM), and in specific examples we work through the conditions for the various results in detail. The results are also extended to two-step estimators (with finite-dimensional parameter estimation in the first step), estimators derived from nonsmooth objective functions, and semiparametric two-step estimators (with nonparametric estimation of an…
Whitney K. Newey, James L. Powell
This paper considers estimation and testing using location measures for regression m odels that are based on an asymmetric least-squares criterion functio n. These estimators have properties that are analogous to regression quantiles, but are easier to calculate, as are the corresponding test statistics. Asymmetric least-squares tests of homoskedasticity and s ymmetry compare quite favorably with other tests of these hypotheses in terms of asymptotic relative efficiency. Consequently, asymmetric least-squares estimation provides a convenient and relatively efficie nt method of characterizing the conditional distributi on of a dependent variable given some regressors. Copyright 1987 by The Econometric Society.
Whitney K. Newey, James L. Powell
In econometrics there are many occasions where knowledge of the structural relationship among dependent variables is required to answer questions of interest. This paper gives identification and estimation results for nonparametric conditional moment restrictions. We characterize identification of structural functions as completeness of certain conditional distributions, and give sufficient identification conditions for exponential families and discrete variables. We also give a consistent, nonparametric estimator of the structural function. The estimator is nonparametric two-stage least squares based on series approximation, which overcomes an ill-posed inverse problem by placing bounds on integrals of higher-order derivatives.
Abstract Semiparametric models are those where the functional form of some components is unknown. Efficiency bounds are of fundamental importance for such models. They provide a guide to estimation methods and give an asymptotic efficiency standard. The purpose of this paper is to provide an introduction to research methods and problems for semiparametric efficiency bounds. The nature of the bounds is discussed, as well as ways of calculating them. Their uses in solving estimation problems are outlined, including construction of semiparametric estimators and calculation of their limiting distribution. The paper includes new results as well as survey material.
Whitney K. Newey, James L. Powell, Francis Vella
This paper presents a simple two-step nonparametric estimator for a triangular simultaneous equation model. Our approach employs series approximations that exploit the additive structure of the model. The first step comprises the nonparametric estimation of the reduced form and the corresponding residuals. The second step is the estimation of the primary equation via nonparametric regression with the reduced form residuals included as a regressor. We derive consistency and asymptotic normality results for our estimator, including optimal convergence rates. Finally we present an empirical example, based on the relationship between the hourly wage rate and annual hours worked, which illustrates the utility of our approach.
Guido W. Imbens, Whitney K. Newey
This paper uses control variables to identify and estimate models with nonseparable, multidimensional disturbances. Triangular simultaneous equations models are considered, with instruments and disturbances that are independent and a reduced form that is strictly monotonic in a scalar disturbance. Here it is shown that the conditional cumulative distribution function of the endogenous variable given the instruments is a control variable. Also, for any control variable, identification results are given for quantile, average, and policy effects. Bounds are given when a common support assumption is not satisfied. Estimators of identified objects and bounds are provided, and a demand analysis empirical example is given.
Victor Chernozhukov, Denis Chetverikov, Mert Demirer +3 more
Chernozhukov, Chetverikov, Demirer, Duflo, Hansen, and Newey (2016) provide a generic double/de-biased machine learning (DML) approach for obtaining valid inferential statements about focal parameters, using Neyman-orthogonal scores and cross-fitting, in settings where nuisance parameters are estimated using a new generation of nonparametric fitting methods for high-dimensional data, called machine learning methods. In this note, we illustrate the application of this method in the context of estimating average treatment effects (ATE) and average treatment effects on the treated (ATTE) using observational data. A more general discussion and references to the existing literature are available in Chernozhukov, Chetverikov, Demirer, Duflo, Hansen, and Newey (2016).
Mitali Das, Whitney K. Newey, Francis Vella
Sample selection models provide an important way of accounting for economic decisions that combine discrete and continuous choices and of correcting for nonrandom sampling. Nonparametric estimators for these models are developed in this paper. These can be used for estimating shapes and important economic quantities, as in standard nonparametric regression. Endogeneity of regressors of interest is allowed for. Series estimators for these models are developed, which are useful for imposing additivity restrictions that arise from selection corrections. Convergence rates and asymptotic normality results are derived. An application to returns to schooling among Australian young females is given.
James M. Robins, Steven D. Mark, Whitney K. Newey
In order to estimate the causal effects of one or more exposures or treatments on an outcome of interest, one has to account for the effect of "confounding factors" which both covary with the exposures or treatments and are independent predictors of the outcome. In this paper we present regression methods which, in contrast to standard methods, adjust for the confounding effect of multiple continuous or discrete covariates by modelling the conditional expectation of the exposures or treatments given the confounders. In the special case of a univariate dichotomous exposure or treatment, this conditional expectation is identical to what Rosenbaum and Rubin have called the propensity score. They have also proposed methods to estimate causal effects by modelling the propensity score. Our methods generalize those of Rosenbaum and Rubin in several ways. First, our approach straightforwardly…
Econometric applications of kernel estimators are proliferating, suggesting the need for convenient variance estimates and conditions for asymptotic normality. This paper develops a general “delta-method” variance estimator for functionals of kernel estimators. Also, regularity conditions for asymptotic normality are given, along with a guide to verify them for particular estimators. The general results are applied to partial means, which are averages of kernel estimators over some of their arguments with other arguments held fixed. Partial means have econometric applications, such as consumer surplus estimation, and are useful for estimation of additive nonparametric models.
James B. McDonald, Whitney K. Newey
This paper considers M-estimators of regression parameters that make use of a generalized functional form for the disturbance distribution. The family of distributions considered is the generalized t (GT), which includes the power exponential or Box-Tiao, normal, Laplace, and t distributions as special cases. The corresponding influence function is bounded and redescending for finite “degrees of freedom.” The regression estimators considered are those that maximize the GT quasi-likelihood, as well as one-step versions. Estimators of the parameters of the GT distribution and the effect of such estimates on the asymptotic efficiency of the regression estimates are discussed. We give a minimum-distance interpretation of the choice of GT parameter estimate that minimizes the asymptotic variance of the regression parameters.
Victor Chernozhukov, Ivan Fernandez-Val, Jinyong Hahn +1 more
Nonseparable panel models are important in a variety of economic settings, including discrete choice. This paper gives identification and estimation results for nonseparable models under time homogeneity conditions that are like "time is randomly assigned" or "time is an instrument." Partial identification results for average and quantile effects are given for discrete regressors, under static or dynamic conditions, in fully nonparametric and in semiparametric models, with time effects. It is shown that the usual, linear, fixed-effects estimator is not a consistent estimator of the identified average effect, and a consistent estimator is given. A simple estimator of identified quantile treatment effects is given, providing a solution to the important problem of estimating quantile treatment effects from panel data. Bounds for overall effects in static and dynamic models are given. The…
Victor Chernozhukov, Juan Carlos Escanciano, Hidehiko Ichimura +2 more
Many economic and causal parameters depend on nonparametric or high dimensional first steps. We give a general construction of locally robust/orthogonal moment functions for GMM, where moment conditions have zero derivative with respect to first steps. We show that orthogonal moment functions can be constructed by adding to identifying moments the nonparametric influence function for the effect of the first step on identifying moments. Orthogonal moments reduce model selection and regularization bias, as is very important in many applications, especially for machine learning first steps. We give debiased machine learning estimators of functionals of high dimensional conditional quantiles and of dynamic discrete choice parameters with high dimensional state variables. We show that adding to identifying moments the nonparametric influence function provides a general construction of…
Sample selection models are important for correcting the effects of non-random sampling. This paper is about semiparametric estimation using a series approximation to the correction term. Regression spline and power series approximations are considered. Asymptotic normality and consistency of an asymptotic variance estimator are shown. Copyright (C) The Author(s). Journal compilation (C) Royal Economic Society 2009
Christian Hansen, Jerry A. Hausman, Whitney K. Newey
Using many valid instrumental variables has the potential to improve efficiency but makes the usual inference procedures inaccurate. We give corrected standard errors, an extension of Bekker to nonnormal disturbances, that adjust for many instruments. We find that this adjustment is useful in empirical work, simulations, and in the asymptotic theory. Use of the corrected standard errors in t-ratios leads to an asymptotic approximation order that is the same when the number of instrumental variables grows as when the number of instruments is fixed. We also give a version of the Kleibergen weak instrument statistic that is robust to many instruments.
Whitney K. Newey, James R. Robins
There are many interesting and widely used estimators of a functional with finite semiparametric variance bound that depend on nonparametric estimators of nuisance functions. We use cross-fitting (i.e. sample splitting) to construct novel estimators with fast remainder rates. We give cross-fit doubly robust estimators that use separate subsamples to estimate different nuisance functions. We obtain general, precise results for regression spline estimation of average linear functionals of conditional expectations with a finite semiparametric variance bound. We show that a cross-fit doubly robust spline regression estimator of the expected conditional covariance is semiparametric efficient under minimal conditions. Cross-fit doubly robust estimators of other average linear functionals of a conditional expectation are shown to have the fastest known remainder rates for the Haar basis or…
Victor Chernozhukov, Whitney K Newey, Rahul Singh
Many causal and structural effects depend on regressions. Examples include policy effects, average derivatives, regression decompositions, average treatment effects, causal mediation, and parameters of economic structural models. The regressions may be high dimensional, making machine learning useful. Plugging machine learners into identifying equations can lead to poor inference due to bias from regularization and/or model selection. This paper gives automatic debiasing for linear and nonlinear functions of regressions. The debiasing is automatic in using Lasso and the function of interest without the full form of the bias correction. The debiasing can be applied to any regression learner, including neural nets, random forests, Lasso, boosting, and other high dimensional methods. In addition to providing the bias correction we give standard errors that are robust to misspecification…
Victor Chernozhukov, Denis Chetverikov, Mert Demirer +4 more
Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal parameters. Examples of such parameters include individual regression coefficients, average treatment effects, average lifts, and demand or supply elasticities. In fact, estimates of such causal parameters obtained via naively plugging ML estimators into estimating equations for such parameters can behave very poorly due to the regularization bias. Fortunately, this regularization bias can be removed by solving auxiliary prediction problems via ML tools. Specifically, we can form an orthogonal score for the target low-dimensional parameter by combining auxiliary and main ML predictions. The score is then used to build a de-biased estimator of the target…
Bryan W. Brown, Whitney K. Newey
Generalized method of moments (GMM) has been an important innovation in econometrics. Its usefulness has motivated a search for good inference procedures based on GMM. This article presents a novel method of bootstrapping for GMM based on resampling from the empirical likelihood distribution that imposes the moment restrictions. We show that this approach yields a large-sample improvement and is efficient, and give examples. We also discuss the development of GMM and other recent work on improved inference.
Whitney K. Newey, James L. Powell
We consider the linear regression model with censored dependent variable, where the disturbance terms are restricted only to have zero conditional median (or other prespecified quantile) given the regressors and the censoring point. Thus, the functional form of the conditional distribution of the disturbances is unrestricted, permitting heteroskedasticity of unknown form. For this model, a lower bound for the asymptotic covariance matrix for regular estimators of the regression coefficients is derived. This lower bound corresponds to the covariance matrix of an optimally weighted censored least absolute deviations estimator, where the optimal weight is the conditional density at zero of the disturbance. We also show how an estimator that attains this lower bound can be constructed, via nonparametric estimation of the conditional density at zero of the disturbance. As a special case our…
Mike Gordon, R. Milner, L. Morris +2 more
Article Free Access Share on A Metalanguage for interactive proof in LCF Authors: M. Gordon University of Edinburgh University of EdinburghView Profile , R. Milner University of Edinburgh University of EdinburghView Profile , L. Morris Syracuse University Syracuse UniversityView Profile , M. Newey Australian National University Australian National UniversityView Profile , C. Wadsworth University of Edinburgh University of EdinburghView Profile Authors Info & Claims POPL '78: Proceedings of the 5th ACM SIGACT-SIGPLAN symposium on Principles of programming languagesJanuary 1978Pages 119–130https://doi.org/10.1145/512760.512773Published:01 January 1978Publication History 55citation684DownloadsMetricsTotal Citations55Total Downloads684Last 12 Months96Last 6 weeks5 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified…
Victor Chernozhukov, Whitney Newey, Rahul Singh
We provide adaptive inference methods, based on $\ell_1$ regularization, for regular (semi-parametric) and non-regular (nonparametric) linear functionals of the conditional expectation function. Examples of regular functionals include average treatment effects, policy effects, and derivatives. Examples of non-regular functionals include average treatment effects, policy effects, and derivatives conditional on a covariate subvector fixed at a point. We construct a Neyman orthogonal equation for the target parameter that is approximately invariant to small perturbations of the nuisance parameters. To achieve this property, we include the Riesz representer for the functional as an additional nuisance parameter. Our analysis yields weak ``double sparsity robustness'': either the approximation to the regression or the approximation to the representer can be ``completely dense'' as long as…
Deborah J. Jones, Rex Forehand, Jessica Cuellar +6 more
Early onset disruptive behavior disorders are overrepresented in low-income families; yet these families are less likely to engage in behavioral parent training (BPT) than other groups. This project aimed to develop and pilot test a technology-enhanced version of one evidence-based BPT program, Helping the Noncompliant Child (HNC). The aim was to increase engagement of low-income families and, in turn, child behavior outcomes, with potential cost-savings associated with greater treatment efficiency. Low-income families of 3- to 8-year-old children with clinically significant disruptive behaviors were randomized to and completed standard HNC (n = 8) or Technology-Enhanced HNC (TE-HNC; n = 7). On average, caregivers were 37 years old; 87% were female, and 80% worked at least part-time. More than half (53%) of the youth were boys; the average age of the sample was 5.67 years. All families…