Skip to main content
Top

2015 | OriginalPaper | Chapter

3. Similarities: Nearest-Neighbor Classifiers

Author : Miroslav Kubat

Published in: An Introduction to Machine Learning

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Two plants that look very much alike probably represent the same species; likewise, it is quite common that patients complaining of similar symptoms suffer from the same disease. In short, similar objects often belong to the same class—an observation that forms the basis of a popular approach to classification: when asked to determine the class of object x, find the training example most similar to it. Then label x with this example’s class.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
One benefit of these differences being squared, and thus guaranteed to be positive, is that this prevents negative differences, x i y i  < 0, to be subtracted from positive differences, x i y i  > 0.
 
2
Among these, perhaps the best-known are the polar distance, the Minkowski metric, and the Mahalanobis distance.
 
3
The optimal value of k (the one with the minimum error rate) is usually established experimentally.
 
4
It is fair to mention that he used them for somewhat different purposes.
 
Literature
15.
go back to reference Cover, T. M. (1968). Estimation by the nearest neighbor rule. IEEE Transactions on Information Theory, IT-14, 50–55.CrossRef Cover, T. M. (1968). Estimation by the nearest neighbor rule. IEEE Transactions on Information Theory, IT-14, 50–55.CrossRef
16.
go back to reference Cover, T. M., & Hart, P. E. (1967). Nearest neighbor pattern classification. IEEE Transactions on Information Theory, IT-13, 21–27.CrossRef Cover, T. M., & Hart, P. E. (1967). Nearest neighbor pattern classification. IEEE Transactions on Information Theory, IT-13, 21–27.CrossRef
17.
go back to reference Dasarathy, B. V. (1991). Nearest-neighbor classification techniques. Los Alomitos: IEEE Computer Society Press. Dasarathy, B. V. (1991). Nearest-neighbor classification techniques. Los Alomitos: IEEE Computer Society Press.
19.
go back to reference Dudani, S. A. (1975). The distance-weighted k-nearest-neighbor rule. IEEE Transactions on Systems, Man, and Cybernetics, SMC-6, 325–327.CrossRef Dudani, S. A. (1975). The distance-weighted k-nearest-neighbor rule. IEEE Transactions on Systems, Man, and Cybernetics, SMC-6, 325–327.CrossRef
23.
go back to reference Fix, E., & Hodges, J. L. (1951). Discriminatory analysis, non-parametric discrimination. USAF School of Aviation Medicine, Randolph Field, TX, Project 21-49-004, Report 4, Contract AF41(128)-3. Fix, E., & Hodges, J. L. (1951). Discriminatory analysis, non-parametric discrimination. USAF School of Aviation Medicine, Randolph Field, TX, Project 21-49-004, Report 4, Contract AF41(128)-3.
30.
go back to reference Hart, P. E. (1968). The condensed nearest neighbor rule. IEEE Transactions on Information Theory, IT-14, 515–516.CrossRef Hart, P. E. (1968). The condensed nearest neighbor rule. IEEE Transactions on Information Theory, IT-14, 515–516.CrossRef
76.
go back to reference Tomek, I. (1976). Two modifications of CNN. IEEE Transactions on Systems, Man and Communications, SMC-6, 769–772.MathSciNet Tomek, I. (1976). Two modifications of CNN. IEEE Transactions on Systems, Man and Communications, SMC-6, 769–772.MathSciNet
Metadata
Title
Similarities: Nearest-Neighbor Classifiers
Author
Miroslav Kubat
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-20010-1_3

Premium Partner