Abstract
Quantile regression, including median regression, as a more completed statistical model than mean regression, is now well known with its wide spread applications. Bayesian inference on quantile regression or Bayesian quantile regression has attracted much interest recently. Most of the existing researches in Bayesian quantile regression focus on parametric quantile regression, though there are discussions on different ways of modeling the model error by a parametric distribution named asymmetric Laplace distribution or by a nonparametric alternative named scale mixture asymmetric Laplace distribution. This paper discusses Bayesian inference for nonparametric quantile regression. This general approach fits quantile regression curves using piecewise polynomial functions with an unknown number of knots at unknown locations, all treated as parameters to be inferred through reversible jump Markov chain Monte Carlo (RJMCMC) of Green (Biometrika 82:711–732, 1995). Instead of drawing samples from the posterior, we use regression quantiles to create Markov chains for the estimation of the quantile curves. We also use approximate Bayesian factor in the inference. This method extends the work in automatic Bayesian mean curve fitting to quantile regression. Numerical results show that this Bayesian quantile smoothing technique is competitive with quantile regression/smoothing splines of He and Ng (Comput. Stat. 14:315–337, 1999) and P-splines (penalized splines) of Eilers and de Menezes (Bioinformatics 21(7):1146–1153, 2005).
Similar content being viewed by others
References
Chaudhuri, P.: Nonparametric quantile regression. Ann. Stat. 19, 760–777 (1991)
Chen, C.: A finite smoothing algorithm for quantile regression. J. Comput. Graph. Stat. 16, 136–164 (2007)
Chu, C.K., Glad, I.K., Godtliebsen, F., Marron, J.S.: Edge-preserving smoothers for image processing (with discussion). J. Am. Stat. Assoc. 93, 526–541 (1998)
Denison, D., Mallick, B., Smith, A.: Automatic Bayesian curve fitting. J. R. Stat. Soc. Ser. B 60, 333–350 (1998)
DiMatteo, I., Genovese, C.R., Kass, R.E.: Bayesian curve fitting with free-knot splines. Biometrika 88, 1055–1073 (2001)
Eilers, P., de Menezes, R.: Quantile smoothing of array CGH data. Bioinformatics 21(7), 1146–1153 (2005)
Green, P.J.: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 711–732 (1995)
Hansen, M.H., Kooperberg, C.: Spline adaptation in extended linear models (with discussion). Stat. Sci. 17, 2–51 (2002)
He, X., Ng, P.: COBS: Qualitatively constrained smoothing via linear program. Comput. Stat. 14, 315–337 (1999)
Kass, R.E., Wallstrom, G.L.: Comment on: Spline adaptation in extended linear models by Mark H. Hansen and Charles Kooperberg. Stat. Sci. 17, 2–51 (2002)
Koenker, R.: Quantile Regression. Cambridge University Press, Cambridge (2005)
Koenker, R., Bassett, J.G.: Regression quantiles. Econometrica 46, 33–50 (1978)
Koenker, R., Ng, P., Portnoy, S.: Quantiles smoothing splines. Biometrika 81, 673–680 (1994)
Leslie, D.S., Kohn, R., Nott, D.J.: A general approach to heteroscedastic linear regression. Stat. Comput. 17, 131–146 (2007)
Smith, M., Kohn, R.: Nonparametric regression using Bayesian variable selection. J. Econom. 75, 317–343 (1996)
Stone, C.J.: Nonparametric M-regression with free knots. J. Stat. Plan. Inference 130, 183–206 (2005)
Silverman, B.W.: Some aspects of the spline smoothing approach to non-parametric regression curve fitting. J. R. Stat. Soc. Ser. B 47, 1–52 (1985)
Yu, K.: Reversible jump MCMC approach quantile regression. Comput. Stat. Data Anal. 40(2), 303–315 (2002)
Yu, K., Jones, M.C.: Local linear quantile regression. J. Am. Stat. Assoc. 93, 228–238 (1998)
Yu, K., Moyeed, R.A.: Bayesian quantile regression. Stat. Probab. Lett. 54, 437–447 (2001)
Zhou, S., Shen, X.: Spatially adaptive regression splines and accurate knot selection schemes. J. Am. Stat. Assoc. 96, 247–259 (2001)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, C., Yu, K. Automatic Bayesian quantile regression curve fitting. Stat Comput 19, 271–281 (2009). https://doi.org/10.1007/s11222-008-9091-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11222-008-9091-x