Skip to main content
Top

2015 | OriginalPaper | Chapter

Evidential Editing K-Nearest Neighbor Classifier

Authors : Lianmeng Jiao, Thierry Denœux, Quan Pan

Published in: Symbolic and Quantitative Approaches to Reasoning with Uncertainty

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

One of the difficulties that arises when using the K-nearest neighbor rule is that each of the labeled training samples is given equal importance in deciding the class of the query pattern to be classified, regardless of their typicality. In this paper, the theory of belief functions is introduced into the K-nearest neighbor rule to develop an evidential editing version of this algorithm. An evidential editing procedure is proposed to reassign the original training samples with new labels represented by an evidential membership structure. With the introduction of the evidential editing procedure, the uncertainty of noisy patterns or samples in overlapping regions can be well characterized. After the evidential editing, a classification procedure is developed to handle the more general situation in which the edited training samples are assigned dependent evidential labels. Two experiments based on synthetic and real data sets were carried out to show the effectiveness of the proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Denœux, T.: A \(k\)-nearest neighbor classification rule based on Dempster-Shafer theory. IEEE Trans. Syst. Man Cybern. 25, 804–813 (1995)CrossRef Denœux, T.: A \(k\)-nearest neighbor classification rule based on Dempster-Shafer theory. IEEE Trans. Syst. Man Cybern. 25, 804–813 (1995)CrossRef
3.
go back to reference Denœux, T.: Conjunctive and disjunctive combination of belief functions induced by nondistinct bodies of evidence. Artif. Intell. 172, 234–264 (2008)MathSciNetCrossRefMATH Denœux, T.: Conjunctive and disjunctive combination of belief functions induced by nondistinct bodies of evidence. Artif. Intell. 172, 234–264 (2008)MathSciNetCrossRefMATH
4.
go back to reference Denœux, T., Smets, P.: Classification using belief functions relationship between case-based and model-based approaches. IEEE Trans. Syst. Man Cybern. Part B Cybern. 36, 1395–1406 (2006)CrossRef Denœux, T., Smets, P.: Classification using belief functions relationship between case-based and model-based approaches. IEEE Trans. Syst. Man Cybern. Part B Cybern. 36, 1395–1406 (2006)CrossRef
5.
go back to reference Denœux, T., Younes, Z., Abdallah, F.: Representing uncertainty on set-valued variables using belief functions. Artif. Intell. 174, 479–499 (2010)MathSciNetCrossRefMATH Denœux, T., Younes, Z., Abdallah, F.: Representing uncertainty on set-valued variables using belief functions. Artif. Intell. 174, 479–499 (2010)MathSciNetCrossRefMATH
6.
go back to reference Fix, E., Hodges, J.: Discriminatory analysis, nonparametric discrimination: consistency properties. Technical report 4, USAF School of Aviation Medicine, Randolph Field, Texas (1951) Fix, E., Hodges, J.: Discriminatory analysis, nonparametric discrimination: consistency properties. Technical report 4, USAF School of Aviation Medicine, Randolph Field, Texas (1951)
8.
go back to reference Jiao, L., Denœux, T., Pan, Q.: Fusion of pairwise nearest-neighbor classifiers based on pairwise-weighted distance metric and Dempster-Shafer theory. In: Proceeding of 17th International Conference on Information Fusion, pp. 1–7 (2014) Jiao, L., Denœux, T., Pan, Q.: Fusion of pairwise nearest-neighbor classifiers based on pairwise-weighted distance metric and Dempster-Shafer theory. In: Proceeding of 17th International Conference on Information Fusion, pp. 1–7 (2014)
9.
go back to reference Kanj, S., Abdallah, F., Denœux, T., Tout, K.: Editing training data for multi-label classification with the \(k\)-nearest neighbor rule. Pattern Analysis and Applications, (2015). doi:10.1007/s10044-015-0452-8 Kanj, S., Abdallah, F., Denœux, T., Tout, K.: Editing training data for multi-label classification with the \(k\)-nearest neighbor rule. Pattern Analysis and Applications, (2015). doi:10.​1007/​s10044-015-0452-8
10.
go back to reference Keller, J.M., Gray, M.R., Givens, J.A.: A fuzzy K-nearest neighbor algorithm. IEEE Trans. Syst. Man Cybern. 15, 580–585 (1985)CrossRef Keller, J.M., Gray, M.R., Givens, J.A.: A fuzzy K-nearest neighbor algorithm. IEEE Trans. Syst. Man Cybern. 15, 580–585 (1985)CrossRef
11.
go back to reference Koplowitz, J., Brown, T.A.: On the relation of performance to editing in nearest neighbor rules. Pattern Recogn. 13, 251–255 (1981)CrossRef Koplowitz, J., Brown, T.A.: On the relation of performance to editing in nearest neighbor rules. Pattern Recogn. 13, 251–255 (1981)CrossRef
12.
go back to reference Liu, Z., Pan, Q., Dezert, J.: A new belief-based \(k\)-nearest neighbor classification method. Pattern Recogn. 46, 834–844 (2013)CrossRef Liu, Z., Pan, Q., Dezert, J.: A new belief-based \(k\)-nearest neighbor classification method. Pattern Recogn. 46, 834–844 (2013)CrossRef
14.
go back to reference Shafer, G.: A Mathematical Theory of Evidence. Princeton University Press, Princeton, NJ (1976)MATH Shafer, G.: A Mathematical Theory of Evidence. Princeton University Press, Princeton, NJ (1976)MATH
15.
go back to reference Smets, P.: Decision making in the TBM: the necessity of the pignistic transformation. Int. J. Approximate Reasoning 38, 133–147 (2005)MathSciNetCrossRefMATH Smets, P.: Decision making in the TBM: the necessity of the pignistic transformation. Int. J. Approximate Reasoning 38, 133–147 (2005)MathSciNetCrossRefMATH
16.
go back to reference Wilson, D.L.: Asymptotic properties of nearest neighbor rules using edited data sets. IEEE Trans. Syst. Man Cybern. 2, 408–421 (1972)CrossRefMATH Wilson, D.L.: Asymptotic properties of nearest neighbor rules using edited data sets. IEEE Trans. Syst. Man Cybern. 2, 408–421 (1972)CrossRefMATH
Metadata
Title
Evidential Editing K-Nearest Neighbor Classifier
Authors
Lianmeng Jiao
Thierry Denœux
Quan Pan
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-20807-7_42

Premium Partner