Skip to main content

2014 | OriginalPaper | Buchkapitel

7. High-Dimensional Statistics

verfasst von : Jianqing Fan

Erschienen in: Selected Works of Peter J. Bickel

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Peter J. Bickel has made far-reaching and wide-ranging contributions to many areas of statistics. This short article highlights his marvelous contributions to high-dimensional statistical inference and machine learning, which range from novel methodological developments, deep theoretical analysis, and their applications. The focus is on the review and comments of his six recent papers in four areas, but only three of them are reproduced here due to limit of the space.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Bickel PJ, Ritov Y, Zakai A (2005) Some theory for generalized boosting algorithms. J Mach Learn Res 7:705–732MathSciNet Bickel PJ, Ritov Y, Zakai A (2005) Some theory for generalized boosting algorithms. J Mach Learn Res 7:705–732MathSciNet
Zurück zum Zitat Brand M (2002) Charting a manifold. In: Advances in NIPS, vol 14. MIT Press, Cambridge, MA Brand M (2002) Charting a manifold. In: Advances in NIPS, vol 14. MIT Press, Cambridge, MA
Zurück zum Zitat Cai T, Liu W (2011) Adaptive thresholding for sparse covariance matrix estimation. J Am Stat Assoc 494:672–684CrossRefMathSciNet Cai T, Liu W (2011) Adaptive thresholding for sparse covariance matrix estimation. J Am Stat Assoc 494:672–684CrossRefMathSciNet
Zurück zum Zitat Cai T, Zhou H (2012) Minimax estimation of large covariance matrices under ℓ 1 norm (with discussion). Stat Sin, to appear Cai T, Zhou H (2012) Minimax estimation of large covariance matrices under 1 norm (with discussion). Stat Sin, to appear
Zurück zum Zitat Cai T, Zhang C-H, Zhou H (2010) Optimal rates of convergence for covariance matrix estimation Ann Stat 38:2118–2144MATHMathSciNet Cai T, Zhang C-H, Zhou H (2010) Optimal rates of convergence for covariance matrix estimation Ann Stat 38:2118–2144MATHMathSciNet
Zurück zum Zitat Candes E, Tao T (2007) The Dantzig selector: statistical estimation when p is much larger than n (with discussion). Ann Stat 35:2313–2404CrossRefMATHMathSciNet Candes E, Tao T (2007) The Dantzig selector: statistical estimation when p is much larger than n (with discussion). Ann Stat 35:2313–2404CrossRefMATHMathSciNet
Zurück zum Zitat Donoho DL, Grimes C (2003) Hessian eigenmaps: new locally linear embedding techniques for high-dimensional data. Technical Report TR 2003-08, Department of Statistics, Stanford University, 2003 Donoho DL, Grimes C (2003) Hessian eigenmaps: new locally linear embedding techniques for high-dimensional data. Technical Report TR 2003-08, Department of Statistics, Stanford University, 2003
Zurück zum Zitat El Karoui N (2008) Operator norm consistent estimation of large-dimensional sparse covariance matrices. Ann Stat 36:2717–2756CrossRefMATHMathSciNet El Karoui N (2008) Operator norm consistent estimation of large-dimensional sparse covariance matrices. Ann Stat 36:2717–2756CrossRefMATHMathSciNet
Zurück zum Zitat Fan J, Gijbels I (1996) Local polynomial modelling and its applications. Chapman and Hall, LondonMATH Fan J, Gijbels I (1996) Local polynomial modelling and its applications. Chapman and Hall, LondonMATH
Zurück zum Zitat Fan J, Li R (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 96:1348–1360CrossRefMATHMathSciNet Fan J, Li R (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 96:1348–1360CrossRefMATHMathSciNet
Zurück zum Zitat Fan J, Fan Y, Lv J, (2008) Large dimensional covariance matrix estimation via a factor model. J Econ 147:186–197CrossRefMathSciNet Fan J, Fan Y, Lv J, (2008) Large dimensional covariance matrix estimation via a factor model. J Econ 147:186–197CrossRefMathSciNet
Zurück zum Zitat Fan J, Liao Y, Mincheva M (2011) High dimensional covariance matrix estimation in approximate factor models. Ann Statist 39:3320–3356CrossRefMATHMathSciNet Fan J, Liao Y, Mincheva M (2011) High dimensional covariance matrix estimation in approximate factor models. Ann Statist 39:3320–3356CrossRefMATHMathSciNet
Zurück zum Zitat Freund Y (1990) Boosting a weak learning algorithm by majority. In: Proceedings of the third annual workshop on computational learning theory. Morgan Kaufmann, San Mateo Freund Y (1990) Boosting a weak learning algorithm by majority. In: Proceedings of the third annual workshop on computational learning theory. Morgan Kaufmann, San Mateo
Zurück zum Zitat Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55:119–139CrossRefMATHMathSciNet Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55:119–139CrossRefMATHMathSciNet
Zurück zum Zitat Levina E, Bickel PJ (2005) Maximum likelihood estimation of intrinsic dimension. In: Saul LK, Weiss Y, Bottou L (eds) Advances in NIPS, vol 17. MIT Press, Cambridge, MA Levina E, Bickel PJ (2005) Maximum likelihood estimation of intrinsic dimension. In: Saul LK, Weiss Y, Bottou L (eds) Advances in NIPS, vol 17. MIT Press, Cambridge, MA
Zurück zum Zitat Levina E, Rothman AJ, Zhu J (2008) Sparse estimation of large covariance matrices via a nested lasso penalty. Ann Stat Appl Stat 2:245–263CrossRefMATHMathSciNet Levina E, Rothman AJ, Zhu J (2008) Sparse estimation of large covariance matrices via a nested lasso penalty. Ann Stat Appl Stat 2:245–263CrossRefMATHMathSciNet
Zurück zum Zitat Marčcenko VA, Pastur LA (1967) Distributions of eigenvalues of some sets of random matrices. Math USSR-Sb 1:507–536MathSciNet Marčcenko VA, Pastur LA (1967) Distributions of eigenvalues of some sets of random matrices. Math USSR-Sb 1:507–536MathSciNet
Zurück zum Zitat Rothman AJ, Bickel PJ, Levina E, Zhu J (2008) Sparse permutation invariant covariance estimation. Electron J Stat 2:494–515CrossRefMATHMathSciNet Rothman AJ, Bickel PJ, Levina E, Zhu J (2008) Sparse permutation invariant covariance estimation. Electron J Stat 2:494–515CrossRefMATHMathSciNet
Zurück zum Zitat Rothman AJ, Levina E, Zhu J (2009) Generalized thresholding of large covariance matrices. J Am Stat Assoc 104:177–186CrossRefMathSciNet Rothman AJ, Levina E, Zhu J (2009) Generalized thresholding of large covariance matrices. J Am Stat Assoc 104:177–186CrossRefMathSciNet
Zurück zum Zitat Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326CrossRef
Zurück zum Zitat Schapire R (1990) Strength of weak learnability. Mach Learn 5:197–227 Schapire R (1990) Strength of weak learnability. Mach Learn 5:197–227
Zurück zum Zitat Tenenbaum JB, de Silva V, Landford JC(2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323 Tenenbaum JB, de Silva V, Landford JC(2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323
Zurück zum Zitat Tibshirani R (1996) Regression shrinkage and selection via lasso. J R Stat Soc B 58:267–288MATHMathSciNet Tibshirani R (1996) Regression shrinkage and selection via lasso. J R Stat Soc B 58:267–288MATHMathSciNet
Zurück zum Zitat Verveer P, Duin R (1995) An evaluation of intrinsic dimensionality estimators. IEEE Trans PAMI 17:81–86CrossRef Verveer P, Duin R (1995) An evaluation of intrinsic dimensionality estimators. IEEE Trans PAMI 17:81–86CrossRef
Zurück zum Zitat Zou H (2006) The adaptive Lasso and its oracle properties. J Am Stat Assoc 101:1418–1429CrossRefMATH Zou H (2006) The adaptive Lasso and its oracle properties. J Am Stat Assoc 101:1418–1429CrossRefMATH
Zurück zum Zitat Zou H, Li R (2008) One-step sparse estimates in nonconcave penalized likelihood models (with discussion). Ann Stat 36:1509–1533CrossRefMATHMathSciNet Zou H, Li R (2008) One-step sparse estimates in nonconcave penalized likelihood models (with discussion). Ann Stat 36:1509–1533CrossRefMATHMathSciNet
Metadaten
Titel
High-Dimensional Statistics
verfasst von
Jianqing Fan
Copyright-Jahr
2014
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-5544-8_7