Skip to main content
Erschienen in: Neural Computing and Applications 7/2012

01.10.2012 | Original Article

DDC: distance-based decision classifier

verfasst von: Javad Hamidzadeh, Reza Monsefi, Hadi Sadoghi Yazdi

Erschienen in: Neural Computing and Applications | Ausgabe 7/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a new classification method utilizing distance-based decision surface with nearest neighbor projection approach, called DDC. Kernel type of DDC has been extended to take into account the effective nonlinear structure of the data. DDC has some properties: (1) does not need conventional learning procedure (as k-NN algorithm), (2) does not need searching time to locate the k-nearest neighbors, and (3) does not need optimization process unlike some classification methods such as Support Vector Machine (SVM). In DDC, we compute the weighted average of distances to all the training samples. Unclassified sample will be classified as belonging to a class that has the minimum obtained distance. As a result, by such a rule we can derive a formula that can be used as the decision surface. DDC is tested on both synthetic and real-world data sets from the UCI repository, and the results were compared with k-NN, RBF Network, and SVM. The experimental results indicate DDC outperforms k-NN in the most experiments and the results are comparable to or better than SVM with some data sets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Laguia M, Castro JL (2008) Local distance-based classification. Knowl Based Syst 21:692–703CrossRef Laguia M, Castro JL (2008) Local distance-based classification. Knowl Based Syst 21:692–703CrossRef
2.
Zurück zum Zitat Bow ST (2002) Pattern recognition and image preprocessing, 2nd edn. Marcel Dekker, New YorkCrossRef Bow ST (2002) Pattern recognition and image preprocessing, 2nd edn. Marcel Dekker, New YorkCrossRef
3.
Zurück zum Zitat Senda S, et al. (1995) A fast algorithm for the minimum distance classifier and its application to kanji character recognition. In: Proceedings of the third international conference on document analysis and recognition, vol 1, pp 283–286 Senda S, et al. (1995) A fast algorithm for the minimum distance classifier and its application to kanji character recognition. In: Proceedings of the third international conference on document analysis and recognition, vol 1, pp 283–286
4.
Zurück zum Zitat Cover TM, Hart PE (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13:21–27MATHCrossRef Cover TM, Hart PE (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13:21–27MATHCrossRef
5.
Zurück zum Zitat Aha DW et al (1991) Instance-based learning algorithms. Mach Lear 6:37–66 Aha DW et al (1991) Instance-based learning algorithms. Mach Lear 6:37–66
6.
Zurück zum Zitat Duda RO et al (2001) Pattern classification. Wiley Interscience Publication, New YorkMATH Duda RO et al (2001) Pattern classification. Wiley Interscience Publication, New YorkMATH
7.
Zurück zum Zitat Domeniconi C et al (2002) Locally adaptive metric nearest-neighbor classification. IEEE Trans Pattern Mach Intell 24:1281–1285CrossRef Domeniconi C et al (2002) Locally adaptive metric nearest-neighbor classification. IEEE Trans Pattern Mach Intell 24:1281–1285CrossRef
8.
Zurück zum Zitat Vincent P, Bengio Y (2002) K-local hyperplane and convex distance nearest neighbor algorithms, vol 14. The MIT Press, Cambridge Vincent P, Bengio Y (2002) K-local hyperplane and convex distance nearest neighbor algorithms, vol 14. The MIT Press, Cambridge
9.
Zurück zum Zitat Dasarathy BV (1991) Nearest neighbor (NN) norms: NN pattern classification techniques. IEEE Computer Society Press, Los Alamitos Dasarathy BV (1991) Nearest neighbor (NN) norms: NN pattern classification techniques. IEEE Computer Society Press, Los Alamitos
10.
Zurück zum Zitat Shakhnarovich G, et al. (2006) (eds) Nearest-neighbor methods in learning and vision: theory and practice. MIT press, Cambridge Shakhnarovich G, et al. (2006) (eds) Nearest-neighbor methods in learning and vision: theory and practice. MIT press, Cambridge
11.
Zurück zum Zitat Lam W et al (2002) Discovering useful concept prototypes for classification based on filtering and abstraction. IEEE Trans Pattern Mach Intell 24:1075–1090CrossRef Lam W et al (2002) Discovering useful concept prototypes for classification based on filtering and abstraction. IEEE Trans Pattern Mach Intell 24:1075–1090CrossRef
12.
Zurück zum Zitat Veenman CJ, Reinders MJT (2005) The nearest subclass classifier: a compromise between the nearest mean and nearest neighbor classifier. IEEE Trans Pattern Mach Intell 27:1417–1429CrossRef Veenman CJ, Reinders MJT (2005) The nearest subclass classifier: a compromise between the nearest mean and nearest neighbor classifier. IEEE Trans Pattern Mach Intell 27:1417–1429CrossRef
13.
Zurück zum Zitat Olvera-Lo′pez JA et al (2010) A new fast prototype selection method based on clustering. Pattern Anal Appl 13(2):131–141MathSciNetCrossRef Olvera-Lo′pez JA et al (2010) A new fast prototype selection method based on clustering. Pattern Anal Appl 13(2):131–141MathSciNetCrossRef
14.
Zurück zum Zitat Herrero JR, Navarro JJ (2007) Exploiting computer resources for fast nearest neighbor classification. Pattern Anal Appl 10:265–275MathSciNetCrossRef Herrero JR, Navarro JJ (2007) Exploiting computer resources for fast nearest neighbor classification. Pattern Anal Appl 10:265–275MathSciNetCrossRef
15.
Zurück zum Zitat Dudani SA (1976) The distance-weighted k-nearest-neighbor rule. IEEE Trans Syst Man Cybern 6:325–327CrossRef Dudani SA (1976) The distance-weighted k-nearest-neighbor rule. IEEE Trans Syst Man Cybern 6:325–327CrossRef
16.
Zurück zum Zitat Zuo W et al (2008) On kernel difference-weighted k-nearest neighbor classification. Pattern Anal Appl 11:247–257MathSciNetCrossRef Zuo W et al (2008) On kernel difference-weighted k-nearest neighbor classification. Pattern Anal Appl 11:247–257MathSciNetCrossRef
17.
Zurück zum Zitat Bommanna KR et al (2010) Texture pattern analysis of kidney tissues for disorder identification and classification using dominant Gabor wavelet. Mach Vis Appl 21:287–300CrossRef Bommanna KR et al (2010) Texture pattern analysis of kidney tissues for disorder identification and classification using dominant Gabor wavelet. Mach Vis Appl 21:287–300CrossRef
18.
Zurück zum Zitat Takada Y et al (1994) A geometric algorithm finding set of linear decision boundaries. IEEE Trans Signal Process 42:1887–1891CrossRef Takada Y et al (1994) A geometric algorithm finding set of linear decision boundaries. IEEE Trans Signal Process 42:1887–1891CrossRef
19.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector network. Mach Learn 20:273–297MATH Cortes C, Vapnik V (1995) Support-vector network. Mach Learn 20:273–297MATH
20.
Zurück zum Zitat Kai Y et al (2002) Kernel nearest neighbor algorithm. Neural Process Letters 15:147–156MATHCrossRef Kai Y et al (2002) Kernel nearest neighbor algorithm. Neural Process Letters 15:147–156MATHCrossRef
21.
Zurück zum Zitat Luxburg UV, Bousquet O (2004) Distance-based classification with Lipschitz functions. J Mach Lear Res 5:669–695MATH Luxburg UV, Bousquet O (2004) Distance-based classification with Lipschitz functions. J Mach Lear Res 5:669–695MATH
22.
Zurück zum Zitat Kosinov S, Pun T (2008) Distance-based discriminant analysis method and its applications. Pattern Anal Appl 11:227–246MathSciNetCrossRef Kosinov S, Pun T (2008) Distance-based discriminant analysis method and its applications. Pattern Anal Appl 11:227–246MathSciNetCrossRef
23.
Zurück zum Zitat Gaitanis N, et al. (1993) (eds) Pattern classification using a generalized hamming distance metric. International conference on neural networks Gaitanis N, et al. (1993) (eds) Pattern classification using a generalized hamming distance metric. International conference on neural networks
24.
Zurück zum Zitat Pekalska E, Hassdonk B (2009) Kernel discriminant analysis for positive definite and indefinite kernels. IEEE Trans Pattern Mach Intell 31:1017–1031CrossRef Pekalska E, Hassdonk B (2009) Kernel discriminant analysis for positive definite and indefinite kernels. IEEE Trans Pattern Mach Intell 31:1017–1031CrossRef
25.
Zurück zum Zitat Li X et al (2009) Kernel-based nonlinear dimensionality reduction for electrocardiogram recognition. Neural Comput Appl 18:1013–1020CrossRef Li X et al (2009) Kernel-based nonlinear dimensionality reduction for electrocardiogram recognition. Neural Comput Appl 18:1013–1020CrossRef
26.
Zurück zum Zitat Ruiz A, Lopez-de-Teruel PE (2001) Nonlinear kernel-based statistical pattern analysis. IEEE Trans Neural Netw 12:16–32CrossRef Ruiz A, Lopez-de-Teruel PE (2001) Nonlinear kernel-based statistical pattern analysis. IEEE Trans Neural Netw 12:16–32CrossRef
27.
Zurück zum Zitat Downs T et al (2001) Exact simplification of support vector solutions. J Mach Learn 2:293–297 Downs T et al (2001) Exact simplification of support vector solutions. J Mach Learn 2:293–297
28.
Zurück zum Zitat Nefedov A et al (2009) Experimental study of support vector machines based on linear and quadratic optimization criteria. DIMACS Technical Report, no. 2009–18, June 2009 Nefedov A et al (2009) Experimental study of support vector machines based on linear and quadratic optimization criteria. DIMACS Technical Report, no. 2009–18, June 2009
29.
Zurück zum Zitat Orr MJL (1996) Introduction to radial basis function networks. Center Cognitive Science University Edinburgh, UK, Edinburgh Orr MJL (1996) Introduction to radial basis function networks. Center Cognitive Science University Edinburgh, UK, Edinburgh
32.
Zurück zum Zitat Tax DMJ, Duin RPW (2005) Using two-class classifiers for multiclass classification. Pattern Recognition Group, Faculty of Applied Science, Delft University of Technology, Delft Tax DMJ, Duin RPW (2005) Using two-class classifiers for multiclass classification. Pattern Recognition Group, Faculty of Applied Science, Delft University of Technology, Delft
Metadaten
Titel
DDC: distance-based decision classifier
verfasst von
Javad Hamidzadeh
Reza Monsefi
Hadi Sadoghi Yazdi
Publikationsdatum
01.10.2012
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 7/2012
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-011-0762-8

Weitere Artikel der Ausgabe 7/2012

Neural Computing and Applications 7/2012 Zur Ausgabe

Premium Partner