Author

Kyusang Yu

12 papers · 2006–2026

2006peak 2 in 20232026

Frequent co-authors

Papers

showing 1–12 of 12 RSS

Smooth backfitting in generalized additive models

Kyusang Yu, Byeong U. Park, Enno Mammen

math.ST · 13 Mar 2008 · cited 96× · arXiv ↗ · more like this ·

Generalized additive models have been popular among statisticians and data analysts in multivariate nonparametric regression with non-Gaussian responses including binary and count data. In this paper, a new likelihood approach for fitting generalized additive models is proposed. It aims to maximize a smoothed likelihood. The additive functions are estimated by solving a system of nonlinear integral equations. An iterative algorithm based on smooth backfitting is developed from the Newton--Kantorovich theorem. Asymptotic properties of the estimator and convergence of the algorithm are discussed. It is shown that our proposal based on local linear fit achieves the same bias and variance as the oracle estimator that uses knowledge of the other components. Numerical comparison with the recently proposed two-stage estimator [Ann. Statist. 32 (2004) 2412--2443] is also made.

Additive isotone regression

Enno Mammen, Kyusang Yu

math.ST · 6 Sep 2007 · cited 45× · arXiv ↗ · more like this ·

This paper is about optimal estimation of the additive components of a nonparametric, additive isotone regression model. It is shown that asymptotically up to first order, each additive component can be estimated as well as it could be by a least squares estimator if the other components were known. The algorithm for the calculation of the estimator uses backfitting. Convergence of the algorithm is shown. Finite sample properties are also compared through simulation experiments.

Semi-parametric regression: Efficiency gains from modeling the nonparametric part

Kyusang Yu, Enno Mammen, Byeong U. Park

math.ST · 22 Apr 2011 · cited 40× · arXiv ↗ · more like this ·

It is widely admitted that structured nonparametric modeling that circumvents the curse of dimensionality is important in nonparametric estimation. In this paper we show that the same holds for semi-parametric estimation. We argue that estimation of the parametric component of a semi-parametric model can be improved essentially when more structure is put into the nonparametric part of the model. We illustrate this for the partially linear model, and investigate efficiency gains when the nonparametric part of the model has an additive structure. We present the semi-parametric Fisher information bound for estimating the parametric part of the partially linear additive model and provide semi-parametric efficient estimators for which we use a smooth backfitting technique to deal with the additive nonparametric part. We also present the finite sample performances of the proposed estimators…

Partially Linear Additive Regression with a General Hilbertian Response

Sung-Ho Cho, Jeong Min Jeon, Dong-Woo Kim +2 more

Statistics and Probability · Journal of the American Statistical Association · 28 Nov 2022 · cited 7× · DOI ↗ · more like this ·

In this article we develop semiparametric regression techniques for fitting partially linear additive models. The methods are for a general Hilbert-space-valued response. They use a powerful technique of additive regression in profiling out the additive nonparametric components of the models, which necessarily involves additive regression of the nonadditive effects of covariates. We show that the estimators of the parametric components are n-consistent and asymptotically Gaussian under weak conditions. We also prove that the estimators of the nonparametric components, which are random elements taking values in a space of Hilbert-space-valued maps, achieve the univariate rate of convergence regardless of the dimension of covariates. We present some numerical evidence for the success of the proposed method and discuss real data applications. Supplementary materials for this article are…

New closed‐form efficient estimator for multivariate gamma distribution

Yu‐Hyeong Jang, Jun Zhao, Hyoung‐Moon Kim +3 more

Artificial Intelligence · Statistica Neerlandica · 28 Apr 2023 · cited 5× · DOI ↗ · more like this ·

Maximum likelihood estimation is used widely in classical statistics. However, except in a few cases, it does not have a closed form. Furthermore, it takes time to derive the maximum likelihood estimator (MLE) owing to the use of iterative methods such as Newton–Raphson. Nonetheless, this estimation method has several advantages, chief among them being the invariance property and asymptotic normality. Based on the first approximation to the solution of the likelihood equation, we obtain an estimator that has the same asymptotic behavior as the MLE for multivariate gamma distribution. The newly proposed estimator, denoted as , is also in closed form as long as the ‐consistent initial estimator is in the closed form. Hence, we develop some closed‐form ‐consistent estimators for multivariate gamma distribution to improve the small‐sample property. is an alternative to MLE and performs…

Expansion for moments of regression quantiles with applications to nonparametric testing

Enno Mammen, Ingrid Van Keilegom, Kyusang Yu

Statistics and Probability · Bernoulli · 6 Mar 2019 · cited 3× · DOI ↗ · more like this ·

We discuss nonparametric tests for parametric specifications of regression quantiles. The test is based on the comparison of parametric and nonparametric fits of these quantiles. The nonparametric fit is a Nadaraya–Watson quantile smoothing estimator. An asymptotic treatment of the test statistic requires the development of new mathematical arguments. An approach that makes only use of plugging in a Bahadur expansion of the nonparametric estimator is not satisfactory. It requires too strong conditions on the dimension and the choice of the bandwidth. Our alternative mathematical approach requires the calculation of moments of Nadaraya–Watson quantile regression estimators. This calculation is done by application of higher order Edgeworth expansions.

Expansion for moments of regression quantiles with application to nonparametric testing

Enno Mammen, Ingrid Van Keilegom, Kyusang Yu

math.ST · June 2013 · cited 3× · arXiv ↗ · more like this ·

We discuss nonparametric tests for parametric specifications of regression quantiles. The test is based on the comparison of parametric and nonparametric fits of these quantiles. The nonparametric fit is a Nadaraya-Watson quantile smoothing estimator. An asymptotic treatment of the test statistic requires the development of new mathematical arguments. An approach that makes only use of plugging in a Bahadur expansion of the nonparametric estimator is not satisfactory. It requires too strong conditions on the dimension and the choice of the bandwidth. Our alternative mathematical approach requires the calculation of moments of Nadaraya-Watson quantile regression estimators. This calculation is done by application of higher order Edgeworth expansions.

LOCAL POLYNOMIAL QUASI‐LIKELIHOOD REGRESSION ON RANDOM FIELDS

Hye-Jeong Choi, Y. K. Lee, Byeong U. Park +1 more

Statistics and Probability · Australian & New Zealand Journal of Statistics · December 2006 · cited 1× · DOI ↗ · more like this ·

Summary In this paper, local quasi‐likelihood regression is considered for stationary random fields of dependent variables. In the case of independent data, local polynomial quasi‐likelihood regression is known to have several appealing features such as minimax efficiency, design adaptivity and good boundary behaviour. These properties are shown to carry over to the case of random fields. The asymptotic normality of the regression estimator is established and explicit formulae for its asymptotic bias and variance are derived for strongly mixing stationary random fields. The extension to multi‐dimensional covariates is also provided in full generality. Moreover, evaluation of the finite sample performance is made through a simulation study.

An elementary Bernoulli-array route to Gaussian, Poisson, and Lévy-type limits

Kyusang Yu

Statistics and Probability · Communications for Statistical Applications and Methods · 30 Sep 2026 · cited 0× · DOI ↗ · more like this ·

Starting from the binary expansion of a uniform random variable, we consider weighted sums of independent Bernoulli variables in which both the success probabilities and the coefficients may vary with the approximation level.This simple triangular-array framework provides a common view of several familiar limit mechanisms.Many small contributions lead to a Gaussian limit, whereas rare visible contributions lead to Poisson and compound Poisson limits.When jump sizes are placed on a fine grid, their limiting intensity arises directly from a Riemann-sum approximation; allowing infinite activity near the origin leads naturally to first-order compensation and an improper Riemann integral.The resulting construction gives an elementary path from standard Gaussian and Poisson limits to the Gaussian-plus-jump structure underlying Lévy-type limits.

Within-group fairness: A guidance for more sound between-group fairness

Sara Kim, Kyusang Yu, Yongdai Kim

stat.ML · 20 Jan 2023 · cited 0× · arXiv ↗ · more like this ·

As they have a vital effect on social decision-making, AI algorithms not only should be accurate and but also should not pose unfairness against certain sensitive groups (e.g., non-white, women). Various specially designed AI algorithms to ensure trained AI models to be fair between sensitive groups have been developed. In this paper, we raise a new issue that between-group fair AI models could treat individuals in a same sensitive group unfairly. We introduce a new concept of fairness so-called within-group fairness which requires that AI models should be fair for those in a same sensitive group as well as those in different sensitive groups. We materialize the concept of within-group fairness by proposing corresponding mathematical definitions and developing learning algorithms to control within-group fairness and between-group fairness simultaneously. Numerical studies show that the…

Measured Data, J. Carroll, Enno Mammen +1 more

Statistics and Probability · 24 Dec 2014 · cited 0× · OpenAlex ↗ · more like this ·

We develop an easily computed smooth backfitting algorithm for additive model fitting in repeated measures problems. Our methodology easily copes with various settings, such as when some covariates are the same over repeated response measurements. We allow for a working covariance matrix for the regression errors, showing that our method is most efficient when the correct covariance matrix is used. The component functions achieve the known asymptotic variance lower bound for the scalar argument case. Smooth backfitting also leads directly to design-independent biases in the local linear case. Simulations show our estimator has smaller variance than the usual kernel estimator. This is also illustrated by an example from nutritional epidemiology.

Nonparametric additive regression for repeatedly measured data

Raymond J. Carroll, Arnab Maity, Enno Mammen +1 more

Statistics and Probability · Biometrika · 20 May 2009 · cited 0× · DOI ↗ · more like this ·