Skip to main content
Top

2013 | OriginalPaper | Chapter

6. On the Relations and Differences Between Popper Dimension, Exclusion Dimension and VC-Dimension

Authors : Yevgeny Seldin, Bernhard Schölkopf

Published in: Empirical Inference

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A high-level relationPopper dimension—( Exclusion dimension—( VC dimension—( between Karl Popper’s ideas on “falsifiability of scientific theories” and the notion of “overfitting”Overfitting in statistical learning theory can be easily traced. However, it was pointed out that at the level of technical details the two concepts are significantly different. One possible explanation that we suggest is that the process of falsification is an active process, whereas statistical learning theory is mainly concerned with supervised learningSupervised learning, which is a passive process of learning from examples arriving from a stationary distribution. We show that concepts that are closer (although still distant) to Karl Popper’s definitions of falsifiability can be found in the domain of learning using membership queries, and derive relations between Popper’s dimension, exclusion dimension, and the VC-dimensionVC dimension.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Corfield, D., Schölkopf, B., Vapnik, V.N.: Falsification and statistical learning theory: comparing the Popper and Vapnik-Chervonenkis dimensions. J. Gen. Philos. Sci. 40, 51–58 (2009)CrossRef Corfield, D., Schölkopf, B., Vapnik, V.N.: Falsification and statistical learning theory: comparing the Popper and Vapnik-Chervonenkis dimensions. J. Gen. Philos. Sci. 40, 51–58 (2009)CrossRef
4.
go back to reference Popper, K.: Logik der Forschung. Mohr Siebeck, Vienna (1934). English translation: The Logic of Scientific Discovery, 1959 Popper, K.: Logik der Forschung. Mohr Siebeck, Vienna (1934). English translation: The Logic of Scientific Discovery, 1959
5.
go back to reference Schölkopf, B., Smola, A.: Learning with Kernels. Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, Cambridge (2002) Schölkopf, B., Smola, A.: Learning with Kernels. Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, Cambridge (2002)
6.
7.
go back to reference Vapnik, V.N.: Statistical Learning Theory. Wiley, New York (1998)MATH Vapnik, V.N.: Statistical Learning Theory. Wiley, New York (1998)MATH
8.
go back to reference Vapnik, V.N., Chervonenkis, A.Y.: On the uniform convergence of relative frequencies of events to their probabilities. Proc. USSR Acad. Sci. 181(4), 781–783 (1968). English translation: Soviet Math. Dokl. 9, 915–918, 1968 Vapnik, V.N., Chervonenkis, A.Y.: On the uniform convergence of relative frequencies of events to their probabilities. Proc. USSR Acad. Sci. 181(4), 781–783 (1968). English translation: Soviet Math. Dokl. 9, 915–918, 1968
9.
go back to reference Vapnik, V.N., Chervonenkis, A.Y.: On the uniform convergence of relative frequencies of events to their probabilities. Theory Prob. Appl. 16(2), 264–281 (1971)MathSciNetCrossRefMATH Vapnik, V.N., Chervonenkis, A.Y.: On the uniform convergence of relative frequencies of events to their probabilities. Theory Prob. Appl. 16(2), 264–281 (1971)MathSciNetCrossRefMATH
10.
go back to reference Vapnik, V.N., Chervonenkis, A.Y.: Theory of pattern recognition. Nauka, Moscow (1974) (in Russian). German translation: W.N. Wapnik, A.Ya. Tschervonenkis (1979), Theorie der Zeichenerkennug, Akademia, Berlin Vapnik, V.N., Chervonenkis, A.Y.: Theory of pattern recognition. Nauka, Moscow (1974) (in Russian). German translation: W.N. Wapnik, A.Ya. Tschervonenkis (1979), Theorie der Zeichenerkennug, Akademia, Berlin
Metadata
Title
On the Relations and Differences Between Popper Dimension, Exclusion Dimension and VC-Dimension
Authors
Yevgeny Seldin
Bernhard Schölkopf
Copyright Year
2013
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-41136-6_6

Premium Partner