Skip to main content

2015 | OriginalPaper | Buchkapitel

7. Foundations of Statistical Learning and Model Selection

verfasst von : Francesco Camastra, Alessandro Vinciarelli

Erschienen in: Machine Learning for Audio, Image and Video Analysis

Verlag: Springer London

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

What the reader should know to understand this chapter \(\bullet \) Basic notions of machine learning. \(\bullet \) Notions of calculus. \(\bullet \) Chapter 5.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
\(\textit{erf}(u)=\frac{2}{\sqrt{\pi }}\int _{0}^u e^{-u^2} du\).
 
2
Numquam ponenda sine necessitate (W. Occam).
 
3
\(f(\cdot )_+\) stands for the positive part of \(f(\cdot )\).
 
Literatur
1.
Zurück zum Zitat H. Akaike. Statistical predictor identification. Annals of the Institute of Statistical Mathematics, 21:202–217, 1970. H. Akaike. Statistical predictor identification. Annals of the Institute of Statistical Mathematics, 21:202–217, 1970.
2.
Zurück zum Zitat H. Akaike. Information theory and an extension of the maximum likelihood principle. In \(2^{nd}\) International Symposium on Information Theory, pages 267–281, 1973. H. Akaike. Information theory and an extension of the maximum likelihood principle. In \(2^{nd}\) International Symposium on Information Theory, pages 267–281, 1973.
3.
Zurück zum Zitat M. Anthony. Neural Network Learning: Theoretical Foundations. Cambridge University Press, 1999. M. Anthony. Neural Network Learning: Theoretical Foundations. Cambridge University Press, 1999.
4.
Zurück zum Zitat C. M. Bishop. Neural Networks for Pattern Recognition. Cambridge University Press, 1995. C. M. Bishop. Neural Networks for Pattern Recognition. Cambridge University Press, 1995.
5.
Zurück zum Zitat S. Boucheron, G. Lugosi, and S. Massart. A sharp concentration inequality with applications. Random Structures and Algorithms, 16(3):277–292, 2000. S. Boucheron, G. Lugosi, and S. Massart. A sharp concentration inequality with applications. Random Structures and Algorithms, 16(3):277–292, 2000.
6.
Zurück zum Zitat V. Cherkassky and F. Mulier. Learning from Data. John Wiley, 1998. V. Cherkassky and F. Mulier. Learning from Data. John Wiley, 1998.
7.
Zurück zum Zitat H. Chernoff. A measure of asymptotic efficiency of tests of a hypothesis based on the sum of observations. Annals of Mathematical Sciences, 23:493–507, 1952. H. Chernoff. A measure of asymptotic efficiency of tests of a hypothesis based on the sum of observations. Annals of Mathematical Sciences, 23:493–507, 1952.
8.
Zurück zum Zitat P. Craven and G. Wahba. Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized crossvalidation. Numerische Mathematik, 31(4):377–403, 1978. P. Craven and G. Wahba. Smoothing noisy data with spline functions: estimating the correct degree of smoothing by the method of generalized crossvalidation. Numerische Mathematik, 31(4):377–403, 1978.
9.
Zurück zum Zitat L. Devroye, L. Gyorfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition. Springer-Verlag, 1996. L. Devroye, L. Gyorfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition. Springer-Verlag, 1996.
10.
Zurück zum Zitat R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. John Wiley, 2001. R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification. John Wiley, 2001.
11.
Zurück zum Zitat B. Efron and R.J. Tibshirani. An Introduction to the Bootstrap. Chapman & Hall, 1993. B. Efron and R.J. Tibshirani. An Introduction to the Bootstrap. Chapman & Hall, 1993.
12.
Zurück zum Zitat R. A. Fisher. The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7(2):179–188, 1936. R. A. Fisher. The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7(2):179–188, 1936.
13.
Zurück zum Zitat K. Fukunaga. Introduction to Statistical Pattern Recognition. Academic Press, 1990. K. Fukunaga. Introduction to Statistical Pattern Recognition. Academic Press, 1990.
14.
Zurück zum Zitat S. Geman, E. Bienenstock, and R. Doursat. Neural networks and the bias-variance dilemma. Neural Networks, 4(1):1–58, 1992. S. Geman, E. Bienenstock, and R. Doursat. Neural networks and the bias-variance dilemma. Neural Networks, 4(1):1–58, 1992.
15.
Zurück zum Zitat T. Hastie, R.J. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer-Verlag, 2001. T. Hastie, R.J. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer-Verlag, 2001.
16.
Zurück zum Zitat F. Mosteller and J.W. Tukey. Data analysis, including statistics. In Handbook of Social Psychology, pages 80–203. Addison-Wesley, 1968. F. Mosteller and J.W. Tukey. Data analysis, including statistics. In Handbook of Social Psychology, pages 80–203. Addison-Wesley, 1968.
17.
Zurück zum Zitat J. Rissanen. A universal prior for integers and estimation by minimum description length. Annals of Statistics, 11(2):416–431, 1983. J. Rissanen. A universal prior for integers and estimation by minimum description length. Annals of Statistics, 11(2):416–431, 1983.
18.
Zurück zum Zitat B. Schölkopf and A.J. Smola. Learning with Kernels. MIT Press, 2002. B. Schölkopf and A.J. Smola. Learning with Kernels. MIT Press, 2002.
19.
Zurück zum Zitat G. Schwartz. Estimating the dimension of a model. Annals of Statistics, 6(2):461–464, 1978. G. Schwartz. Estimating the dimension of a model. Annals of Statistics, 6(2):461–464, 1978.
20.
Zurück zum Zitat R. Shibata. An optimal selection of regression variables. Biometrika, 68(1):45–54, 1981. R. Shibata. An optimal selection of regression variables. Biometrika, 68(1):45–54, 1981.
21.
Zurück zum Zitat M. Stone. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society, B36:111–147, 1974. M. Stone. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society, B36:111–147, 1974.
22.
Zurück zum Zitat M. Stone. An asymptotic equivalence of choice of model by crossvalidation and akaike’s criterion. Journal of the Royal Statistical Society, B39:44–47, 1977. M. Stone. An asymptotic equivalence of choice of model by crossvalidation and akaike’s criterion. Journal of the Royal Statistical Society, B39:44–47, 1977.
23.
Zurück zum Zitat V.N. Vapnik. Estimation of Dependences based on Empirical Data. Springer-Verlag, 1982. V.N. Vapnik. Estimation of Dependences based on Empirical Data. Springer-Verlag, 1982.
24.
Zurück zum Zitat V.N. Vapnik. The Nature of Statistical Learning Theory. Springer-Verlag, 1995. V.N. Vapnik. The Nature of Statistical Learning Theory. Springer-Verlag, 1995.
25.
Zurück zum Zitat V.N. Vapnik. Statistical Learning Theory. John Wiley, 1998. V.N. Vapnik. Statistical Learning Theory. John Wiley, 1998.
26.
Zurück zum Zitat V.N. Vapnik and A. Ya. Chervonenkis. On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and its Applications, 16(2):264–280, 1971. V.N. Vapnik and A. Ya. Chervonenkis. On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and its Applications, 16(2):264–280, 1971.
27.
Zurück zum Zitat V.N. Vapnik and A. Ya. Chervonenkis. Theory of Pattern Recognition. Nauka, 1974. V.N. Vapnik and A. Ya. Chervonenkis. Theory of Pattern Recognition. Nauka, 1974.
Metadaten
Titel
Foundations of Statistical Learning and Model Selection
verfasst von
Francesco Camastra
Alessandro Vinciarelli
Copyright-Jahr
2015
Verlag
Springer London
DOI
https://doi.org/10.1007/978-1-4471-6735-8_7

Premium Partner