an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org
Author
80 papers · 1995–2026
showing 1–25 of 80 RSS
Summary Folklore has it that a very simple supervised classification rule, based on the typically false assumption that the predictor variables are independent, can be highly effective, and often more effective than sophisticated rules. We examine the evidence for this, both empirical, as observed in real data applications, and theoretical, summarising explanations for why this simple rule might be effective.
Keming Yu, Zudi Lu, Julian Stander
Summary. Quantile regression offers a more complete statistical model than mean regression and now has widespread applications. Consequently, we provide a review of this technique. We begin with an introduction to and motivation for quantile regression. We then discuss some typical application areas. Next we outline various approaches to estimation. We finish by briefly summarizing some recent research areas.
Abstract In this article we study nonparametric regression quantile estimation by kernel weighted local linear fitting. Two such estimators are considered. One is based on localizing the characterization of a regression quantile as the minimizer of E{pp (Y — a)|X = x}, where ρp is the appropriate “check” function. The other follows by inverting a local linear conditional distribution estimator and involves two smoothing parameters, rather than one. Our aim is to present fully operational versions of both approaches and to show that each works quite well; although either might be used in practice, we have a particular preference for the second. Our automatic smoothing parameter selection method is novel; the main regression quantile smoothing parameters are chosen by rule-of-thumb adaptations of state-of-the-art methods for smoothing parameter selection for regression mean estimation.…
ABSTRACT In this article, a new three-parameter asymmetric Laplace distribution and its extension are introduced. This includes as special case the symmetric Laplace double-exponential distribution. The distribution has established a direct link to estimation of quantile and quantile regression. Properties of the new distribution are presented. Application is made to a flood data modeling example. Keywords: Asymmetric Laplace distributionParameter estimationQuantile Acknowledgments We thank Dr. Alan Watkins and a referee for thoughtful comments which led to a substantial improvement of the article.
Rahim Alhamzawi, Keming Yu, Dries F. Benoit
Recently, variable selection by penalized likelihood has attracted much research interest. In this paper, we propose adaptive Lasso quantile regression (BALQR) from a Bayesian perspective. The method extends the Bayesian Lasso quantile regression by allowing different penalization parameters for different regression coefficients. Inverse gamma prior distributions are placed on the penalty parameters. We treat the hyperparameters of the inverse gamma prior as unknowns and estimate them along with the other parameters. A Gibbs sampler is developed to simulate the parameters from the posterior distributions. Through simulation studies and analysis of a prostate cancer dataset, we compare the performance of the BALQR method proposed with six existing Bayesian and non-Bayesian methods. The simulation studies and the prostate cancer data analysis indicate that the BALQR method performs well…
We consider estimation of mean and variance functions with kernel-weighted local polynomial fitting in a heteroscedastic nonparametric regression model. Our preferred estimators are based on a localized normal likelihood, using a standard local linear form for estimating the mean and a local log-linear form for estimating the variance. It is important to allow two bandwidths in this problem, separate ones for mean and variance estimation. We provide data-based methods for choosing the bandwidths. We also consider asymptotic results, and study and use them. The methodology is compared with a popular competitor and is seen to perform better for small and moderate sample sizes in simulations. A brief example is provided.
Abstract. We consider non‐parametric additive quantile regression estimation by kernel‐weighted local linear fitting. The estimator is based on localizing the characterization of quantile regression as the minimizer of the appropriate ‘check function’. A backfitting algorithm and a heuristic rule for selecting the smoothing parameter are explored. We also study the estimation of average‐derivative quantile regression under the additive model. The techniques are illustrated by a simulated example and a real data set.
Cathy W. S. Chen, David B. Dunson, Craig Reed +1 more
In many applications, interest focuses on assessing relationships between predictors and the quantiles of the distribution of a continuous response. For example, in epidemiology studies, cutoffs to define premature delivery have been based on the 10th percentile of the distribution for gestational age at delivery. Using quantile regression, one can assess how this percentile varies with predictors instead of using a pre-defined cutoff. However, there is typically uncertainty in which of the many candidate predictors should be included. In order to identify important predictors and to build accurate predictive models, Bayesian methods for variable selection and model averaging are very useful. However, such methods are currently not available for quantile regression. This article develops Bayesian methods for variable selection, with a simple and efficient stochastic search variable…
Bing Xing Wang, Keming Yu, M. C. Jones
In this paper, estimation of the parameters of a certain family of two-parameter lifetime \ndistributions based on progressively Type II right censored samples (including ordinary Type II right censoring) is studied. This family, of reverse hazard distributions, includes the Weibull, Gompertz and Lomax distributions. A new type of parameter estimation, named inverse estimation, is introduced for both parameters. Exact confidence intervals for one of the parameters and generalized confidence intervals for the other are explored; inference for the first parameter can be accomplished by our \nmethodology independently of the unknown value of the other parameter in this family of distributions. Derivation of the estimation method uses properties of order statistics. \nA simulation study in the particular context of the Weibull distribution illustrates the accuracy of these…
Due to computational challenges and non-availability of conjugate prior distributions, Bayesian variable selection in quantile regression models is often a difficult task. In this paper, we address these two issues for quantile regression models. In particular, we develop an informative stochastic search variable selection (ISSVS) for quantile regression models that introduces an informative prior distribution. We adopt prior structures which incorporate historical data into the current data by quantifying them with a suitable prior distribution on the model parameters. This allows ISSVS to search more efficiently in the model space and choose the more likely models. In addition, a Gibbs sampler is derived to facilitate the computation of the posterior probabilities. A major advantage of ISSVS is that it avoids instability in the posterior estimates for the Gibbs sampler as well as…
Bing Xing Wang, Keming Yu, Zhuo Sheng
Constant-stress procedures based on parametric lifetime distributions and models are often used for accelerated life testing in product reliability experiments. Maximum likelihood estimation (MLE) is the typical statistical inference method. This paper presents a new inference method, named the random variable transformation (RVT) method, for Weibull constant-stress accelerated life tests with progressively Type-II right censoring (including ordinary Type-II right censoring). A two-parameter Weibull life distribution with a scale parameter that is a log-linear function of stress is used. RVT inference life distribution parameters and the log-linear function coefficients are provided. Exact confidence intervals for these parameters are also explored. Numerical comparisons of RVT-based estimates to MLE show that the proposed RVT inference is promising, in particular for small sample sizes.
Hadeel S. Klakattawi, Veronica Vinciotti, Keming Yu
Regression for count data is widely performed by models such as Poisson, negative binomial (NB) and zero-inflated regression. A challenge often faced by practitioners is the selection of the right model to take into account dispersion, which typically occurs in count datasets. It is highly desirable to have a unified model that can automatically adapt to the underlying dispersion and that can be easily implemented in practice. In this paper, a discrete Weibull regression model is shown to be able to adapt in a simple way to different types of dispersions relative to Poisson regression: overdispersion, underdispersion and covariate-specific dispersion. Maximum likelihood can be used for efficient parameter estimation. The description of the model, parameter inference and model diagnostics is accompanied by simulated and real data analyses.
We introduce a set of new Gibbs sampler for Bayesian analysis of quantile re-gression model. The new algorithm, which partially collapsing an ordinary Gibbs sampler, is called Partially Collapsed Gibbs (PCG) sampler. Although the Metropolis-Hastings algorithm has been employed in Bayesian quantile regression, including \nmedian regression, PCG has superior convergence properties to an ordinary Gibbs sampler. Moreover, Our PCG sampler algorithm, which is based on a theoretic derivation of an asymmetric Laplace as scale mixtures of normal distributions, \nrequires less computation than the ordinary Gibbs sampler and can significantly reduce the computation involved in approximating the Bayes Factor and marginal likelihood. Like the ordinary Gibbs sampler, the PCG sample can also be used \nto calculate any associated marginal and predictive distributions. The quantile…
In this paper, we discuss the regularization in linear-mixed quantile regression. A hierarchical Bayesian model is used to shrink the fixed and random effects towards the common population values by introducing an l1 penalty in the mixed quantile regression check function. A Gibbs sampler is developed to simulate the parameters from the posterior distributions. Through simulation studies and analysis of an age-related macular degeneration (ARMD) data, we assess the performance of the proposed method. The simulation studies and the ARMD data analysis indicate that the proposed method performs well in comparison with the other approaches.
Rong Jiang, Xueping Hu, Keming Yu +1 more
Analysis of massive datasets is challenging owing to limitations of computer primary memory. Composite quantile regression (CQR) is a robust and efficient estimation method. In this paper, we extend CQR to massive datasets and propose a divide-and-conquer CQR method. The basic idea is to split the entire dataset into several blocks, applying the CQR method for data in each block, and finally combining these regression results via weighted average. The proposed approach significantly reduces the required amount of primary memory, and the resulting estimate will be as efficient as if the entire data set is analysed simultaneously. Moreover, to improve the efficiency of CQR, we propose a weighted CQR estimation approach. To achieve sparsity with high-dimensional covariates, we develop a variable selection procedure to select significant parametric components and prove the method possessing…
Keming Yu, Philippe Van Kerm, Zhang Jin
This paper illustrates application of Bayesian inference to quantile regression. Bayesian inference regards unknown parameters as random variables, and we describe an MCMC algorithm to estimate the posterior densities of quantile regression parameters. Parameter uncertainty is taken into account without relying on symptotic approximations. Bayesian inference revealed effective in our application to the wage structure among working males in Britain between 1991 and 2001 using data from the British Household Panel Survey. Looking at different points along the conditional wage distribution uncovered important features of wage returns to education, experience and public sector employment that would be concealed by mean regression.
A Bayesian approach is proposed for coefficient estimation in the Tobit quantile regression model. The proposed approach is based on placing a g-prior distribution depends on the quantile level on the regression coefficients. The prior is generalized by introducing a ridge parameter to address important challenges that may arise with censored data, such as multicollinearity and overfitting problems. Then, a stochastic search variable selection approach is proposed for Tobit quantile regression model based on g-prior. An expression for the hyperparameter g is proposed to calibrate the modified g-prior with a ridge parameter to the corresponding g-prior. Some possible extensions of the proposed approach are discussed, including the continuous and binary responses in quantile regression. The methods are illustrated using several simulation studies and a microarray study. The simulation…
The single-index (SI) regression and single-index quantile (SIQ) estimation methods product linear combinations of all the original predictors. However, it is possible that there are many unimportant predictors within the original predictors. Thus, the precision of parameter estimation as well as the accuracy of prediction will be effected by the existence of those unimportant predictors when the previous methods are used.In this article, an extension of the SIQ method of Wu et al. (2010) has been proposed, which considers Lasso and Adaptive Lasso for estimation and variable selection. Computational algorithms have been developed in order to calculate the penalized SIQ estimates. A simulation study and a real data application have been used to assess the performance of the methods under consideration.
Copyright © 2022 The Author(s). Online updating is an important statistical method for the analysis of big data arriving in streams due to its ability to break the storage barrier and the computational barrier under certain circumstances. The quantile regression, as a widely used regression model in many fields, faces challenges in model fitting and variable selection with big data arriving in streams. Chen et al. (2019, Annals of Statistics) has proposed a quantile regression method for streaming data, but a strong additional condition is required. In this paper, renewable optimized objective functions for regression parameter estimation and variable selection in a quantile regression are proposed. The proposed methods are illustrated using current data and the summary statistics of historical data. Theoretically, the proposed statistics are shown to have the same asymptotic…
Abstract Nowadays, many college students like all kinds of music. Students even form their own bands. Unfortunately, music education is not valued in many schools. Some famous music schools are trying to change the current situation of music education mode. The integration of artificial intelligence technology and education has led to the change of modern music teaching concept. However, the probability of challenge and opportunity brought by AI technology is the same. This paper analyzes the current situation of traditional music education. On this basis, this paper explains the innovation strategy of college music teaching mode led by artificial intelligence. I hope this article can give you some inspiration.
Rong Jiang, Xueping Hu, Keming Yu
Abstract This article develops a single-index approach for modeling the expectile-based value at risk (EVaR). EVaR has an advantage over the conventional quantile-based VaR (QVaR) of being more sensitive to the magnitude of extreme losses. EVaR can also be used for calculating QVaR and expected shortfall (ES) by exploiting the one-to-one mapping from expectiles to quantiles and the relationship between VaR and ES. We develop an asymmetric least squares technique for estimating the unknown regression parameter and link function in a single-index model, and establish the asymptotic normality of the resultant estimators. Simulation studies and real data applications are conducted to illustrate the finite sample performance of the proposed methods.
Alina Peluso, Veronica Vinciotti, Keming Yu
Fertility plans, measured by the number of planned children, have been found to be affected by education and family background via complex tail dependencies. This challenge was previously met with the use of non-parametric jittering approaches. This paper shows how a novel generalized additive model based on a discrete Weibull distribution provides partial effects of the covariates on fertility plans which are comparable to jittering, without the inherent drawback of crossing conditional quantiles. The model has some additional desirable features: both over- and under-dispersed data can be modelled by this distribution, the conditional quantiles have a simple analytic form and the likelihood is the same of that of a continuous Weibull distribution with interval-censored data. The latter means that efficient implementations are already available, in the R package gamlss, for a range of…
Xueping Hu, Jingya Wang, Liuliu Wang +1 more
Functional data, which provides information about curves, surfaces or anything else varying over a continuum, has become a commonly encountered type of data. The k-nearest neighbor (kNN) method, as a nonparametric method, has become one of the most popular supervised machine learning algorithms used to solve both classification and regression problems. This paper is devoted to the k-nearest neighbor (kNN) estimators of the nonparametric functional regression model when the observed variables take values from negatively associated (NA) sequences. The consistent and complete convergence rate for the proposed kNN estimator is first provided. Then, numerical assessments, including simulation study and real data analysis, are conducted to evaluate the performance of the proposed method and compare it with the standard nonparametric kernel approach.
Bing Xing Wang, Xiu Kun Wang, Keming Yu
Many lifetime distribution models have successfully served as population models for risk analysis and reliability mechanisms. The Kumaraswamy distribution is one of these distributions which is particularly useful to many natural phenomena whose outcomes have lower and upper bounds or bounded outcomes in the biomedical and epidemiological research. This article studies point estimation and interval estimation for the Kumaraswamy distribution. The inverse estimators (IEs) for the parameters of the Kumaraswamy distribution are derived. Numerical comparisons with maximum likelihood estimation and biased-corrected methods clearly indicate the proposed IEs are promising. Confidence intervals for the parameters and reliability characteristics of interest are constructed using pivotal or generalized pivotal quantities. Then, the results are extended to the stress–strength model involving two…
Paul H. Garthwaite, Keming Yu, Peter B. Hope
In the Bayesian analysis of a multiple-recapture census, different diffuse prior distributions can lead to markedly different inferences about the population size N. Through consideration of the Fisher information matrix it is shown that the number of captures in each sample typically provides little information about N. This suggests that if there is no prior information about capture probabilities, then knowledge of just the sample sizes and not the number of recaptures should leave the distribution of Nunchanged. A prior model that has this property is identified and the posterior distribution is examined. In particular, asymptotic estimates of the posterior mean and variance are derived. Differences between Bayesian and classical point and interval estimators are illustrated through examples.