Bayesian Parameter Estimation and Variable Selection for Quantile Regression

Abstract

The principal goal of this work is to provide efficient algorithms for implementing the Bayesian approach to quantile regression. There are two major obstacles to overcome in order to achieve this. Firstly, it is necessary to specify a suitable likelihood given that the frequentist approach generally avoids such specifications. Secondly, sampling methods are usually required as analytical expressions for posterior summaries are generally unavailable in closed form regardless of the prior used. The asymmetric Laplace (AL) likelihood is a popular choice and has a direct link to the frequentist procedure of minimising a weighted absolute value loss function that is known to yield the conditional quantile estimates. For any given prior, the Metropolis Hastings algorithm is always available to sample the posterior distribution. However, it requires the specification of a suitable proposal density, limiting it’s potential to be used more widely in applications. It is shown that the Bayesian quantile regression model with the AL likelihood can be converted into a normal regression model conditional on latent parameters.