Skip to main content
Log in

Automatic Bayesian quantile regression curve fitting

  • Published:
Statistics and Computing Aims and scope Submit manuscript

Abstract

Quantile regression, including median regression, as a more completed statistical model than mean regression, is now well known with its wide spread applications. Bayesian inference on quantile regression or Bayesian quantile regression has attracted much interest recently. Most of the existing researches in Bayesian quantile regression focus on parametric quantile regression, though there are discussions on different ways of modeling the model error by a parametric distribution named asymmetric Laplace distribution or by a nonparametric alternative named scale mixture asymmetric Laplace distribution. This paper discusses Bayesian inference for nonparametric quantile regression. This general approach fits quantile regression curves using piecewise polynomial functions with an unknown number of knots at unknown locations, all treated as parameters to be inferred through reversible jump Markov chain Monte Carlo (RJMCMC) of Green (Biometrika 82:711–732, 1995). Instead of drawing samples from the posterior, we use regression quantiles to create Markov chains for the estimation of the quantile curves. We also use approximate Bayesian factor in the inference. This method extends the work in automatic Bayesian mean curve fitting to quantile regression. Numerical results show that this Bayesian quantile smoothing technique is competitive with quantile regression/smoothing splines of He and Ng (Comput. Stat. 14:315–337, 1999) and P-splines (penalized splines) of Eilers and de Menezes (Bioinformatics 21(7):1146–1153, 2005).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Chaudhuri, P.: Nonparametric quantile regression. Ann. Stat. 19, 760–777 (1991)

    Article  MATH  MathSciNet  Google Scholar 

  • Chen, C.: A finite smoothing algorithm for quantile regression. J. Comput. Graph. Stat. 16, 136–164 (2007)

    Article  Google Scholar 

  • Chu, C.K., Glad, I.K., Godtliebsen, F., Marron, J.S.: Edge-preserving smoothers for image processing (with discussion). J. Am. Stat. Assoc. 93, 526–541 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  • Denison, D., Mallick, B., Smith, A.: Automatic Bayesian curve fitting. J. R. Stat. Soc. Ser. B 60, 333–350 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  • DiMatteo, I., Genovese, C.R., Kass, R.E.: Bayesian curve fitting with free-knot splines. Biometrika 88, 1055–1073 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  • Eilers, P., de Menezes, R.: Quantile smoothing of array CGH data. Bioinformatics 21(7), 1146–1153 (2005)

    Article  Google Scholar 

  • Green, P.J.: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 711–732 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  • Hansen, M.H., Kooperberg, C.: Spline adaptation in extended linear models (with discussion). Stat. Sci. 17, 2–51 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  • He, X., Ng, P.: COBS: Qualitatively constrained smoothing via linear program. Comput. Stat. 14, 315–337 (1999)

    Article  MATH  Google Scholar 

  • Kass, R.E., Wallstrom, G.L.: Comment on: Spline adaptation in extended linear models by Mark H. Hansen and Charles Kooperberg. Stat. Sci. 17, 2–51 (2002)

    Article  Google Scholar 

  • Koenker, R.: Quantile Regression. Cambridge University Press, Cambridge (2005)

    MATH  Google Scholar 

  • Koenker, R., Bassett, J.G.: Regression quantiles. Econometrica 46, 33–50 (1978)

    Article  MATH  MathSciNet  Google Scholar 

  • Koenker, R., Ng, P., Portnoy, S.: Quantiles smoothing splines. Biometrika 81, 673–680 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  • Leslie, D.S., Kohn, R., Nott, D.J.: A general approach to heteroscedastic linear regression. Stat. Comput. 17, 131–146 (2007)

    Article  MathSciNet  Google Scholar 

  • Smith, M., Kohn, R.: Nonparametric regression using Bayesian variable selection. J. Econom. 75, 317–343 (1996)

    Article  MATH  Google Scholar 

  • Stone, C.J.: Nonparametric M-regression with free knots. J. Stat. Plan. Inference 130, 183–206 (2005)

    Article  MATH  Google Scholar 

  • Silverman, B.W.: Some aspects of the spline smoothing approach to non-parametric regression curve fitting. J. R. Stat. Soc. Ser. B 47, 1–52 (1985)

    MATH  Google Scholar 

  • Yu, K.: Reversible jump MCMC approach quantile regression. Comput. Stat. Data Anal. 40(2), 303–315 (2002)

    Article  MATH  Google Scholar 

  • Yu, K., Jones, M.C.: Local linear quantile regression. J. Am. Stat. Assoc. 93, 228–238 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  • Yu, K., Moyeed, R.A.: Bayesian quantile regression. Stat. Probab. Lett. 54, 437–447 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  • Zhou, S., Shen, X.: Spatially adaptive regression splines and accurate knot selection schemes. J. Am. Stat. Assoc. 96, 247–259 (2001)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Colin Chen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, C., Yu, K. Automatic Bayesian quantile regression curve fitting. Stat Comput 19, 271–281 (2009). https://doi.org/10.1007/s11222-008-9091-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11222-008-9091-x

Keywords

Navigation