Skip to main content

2014 | OriginalPaper | Buchkapitel

4. Asymptotic Risk and Bayes Risk of Thresholding and Superefficient Estimates and Optimal Thresholding

verfasst von : Anirban DasGupta, Iain M. Johnstone

Erschienen in: Contemporary Developments in Statistical Theory

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The classic superefficient estimate of Hodges for a one dimensional normal mean and the modern hard thresholding estimates introduced in the works of David Donoho and Iain Johnstone exhibit some well known risk phenomena. They provide quantifiable improvement over the MLE near zero, but also suffer from risk inflation suitably away from zero. Classic work of Le Cam and Hájek has precisely pinned down certain deep and fundamental aspects of these risk phenomena.
In this article, we study risks and Bayes risks of general thresholding estimates. In particular, we show that reversal to the risk of the MLE occurs at one standard deviation from zero, but the global peak occurs in a small lower neighborhood of the thresholding parameter. We give first order limits and various higher order asymptotic expansions to quantify these phenomena. Separately, we identify those priors in a class under which the thresholding estimate would be Bayesianly preferred to the MLE and use the theory of regular variation to pin down the rate at which the difference of their Bayes risks goes to zero.
We also formulate and answer an optimal thresholding question, which asks for the thresholding estimate that minimizes the global maximum of the risk subject to a specified gain at zero.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Banerjee M (2006) Superefficiency, contiguity, LAN University Michigan Lecture Notes Banerjee M (2006) Superefficiency, contiguity, LAN University Michigan Lecture Notes
Zurück zum Zitat Bickel PJ (1983) Minimax estimation of the mean of a normal distribution subject to doing well at a point. In: Recent Advances in Statistics, A Festschrift for H. Chernoff, M. Rizvi, J. Rustagi and D. Siegmund eds., 511-528, Academic Press, NY Bickel PJ (1983) Minimax estimation of the mean of a normal distribution subject to doing well at a point. In: Recent Advances in Statistics, A Festschrift for H. Chernoff, M. Rizvi, J. Rustagi and D. Siegmund eds., 511-528, Academic Press, NY
Zurück zum Zitat DasGupta A (2008) Asymptotic theory of statistics and probability. Springer, New YorkMATH DasGupta A (2008) Asymptotic theory of statistics and probability. Springer, New YorkMATH
Zurück zum Zitat DasGupta A (2011) Probability for statistics and machine learning: fundamentals and advanced topics. Springer, New YorkCrossRef DasGupta A (2011) Probability for statistics and machine learning: fundamentals and advanced topics. Springer, New YorkCrossRef
Zurück zum Zitat Donoho D, Johnstone IM (1994) Ideal spatial adaptation by wavelet shrinkage. Biom 81:425–455MATHMathSciNet Donoho D, Johnstone IM (1994) Ideal spatial adaptation by wavelet shrinkage. Biom 81:425–455MATHMathSciNet
Zurück zum Zitat Hájek J (1970) A characterization of limiting distributions of regular estimates, Z. Wahr verw Geb 14: 323-330 Hájek J (1970) A characterization of limiting distributions of regular estimates, Z. Wahr verw Geb 14: 323-330
Zurück zum Zitat Jeganathan P (1983) Some asymptotic properties of risk functions when the limit of the experiment is mixed normal. Sankhy\(\bar a\) Ser A 45:66–87MATHMathSciNet Jeganathan P (1983) Some asymptotic properties of risk functions when the limit of the experiment is mixed normal. Sankhy\(\bar a\) Ser A 45:66–87MATHMathSciNet
Zurück zum Zitat Johnstone IM (2012) Function estimation and Gaussian sequence models, Cambridge University Press, Forthcomiing Johnstone IM (2012) Function estimation and Gaussian sequence models, Cambridge University Press, Forthcomiing
Zurück zum Zitat Le Cam L (1953) On some asymptotic properties of maximum likelihood estimates and related Bayes estimates. University California Publications 1: 277-330 Le Cam L (1953) On some asymptotic properties of maximum likelihood estimates and related Bayes estimates. University California Publications 1: 277-330
Zurück zum Zitat Le Cam L (1973) Sur les contraintes imposees par les passages a la limite usuels en statistique, Proc. 39th session International Statistical Institute, XLV, 169-177 Le Cam L (1973) Sur les contraintes imposees par les passages a la limite usuels en statistique, Proc. 39th session International Statistical Institute, XLV, 169-177
Zurück zum Zitat Lehmann EL, Romano J (2005) Testing statistical hypotheses, 3rd edn. Springer, New York Lehmann EL, Romano J (2005) Testing statistical hypotheses, 3rd edn. Springer, New York
Zurück zum Zitat van der Vaart A (1997) Superefficiency, in Festschrift for Lucien Le Cam, D. Pollard, E. Torgersen, G. Yang, Eds. Springer, New York van der Vaart A (1997) Superefficiency, in Festschrift for Lucien Le Cam, D. Pollard, E. Torgersen, G. Yang, Eds. Springer, New York
Zurück zum Zitat Wasserman L (2005) All of Nonparametric Statistics. Springer, New York Wasserman L (2005) All of Nonparametric Statistics. Springer, New York
Zurück zum Zitat Wellner J (2012) University Washington Lecture Notes Wellner J (2012) University Washington Lecture Notes
Metadaten
Titel
Asymptotic Risk and Bayes Risk of Thresholding and Superefficient Estimates and Optimal Thresholding
verfasst von
Anirban DasGupta
Iain M. Johnstone
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-02651-0_4