Skip to main content
Erschienen in: Neural Computing and Applications 2/2008

01.03.2008 | BIC-TA 2006

A new learning schema based on support vector for multi-classification

verfasst von: Ling Ping, Zhou Chun-Guang

Erschienen in: Neural Computing and Applications | Ausgabe 2/2008

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A novel learning schema SVCMR based on support vector is proposed in this paper to address M-class classification issue. It creates a tree-shaped decision frame where M/2 nodes are constructed with the three-separation model as the basic classifier. A class selection rule is defined to ensure basic classifiers be trained in turn on pair of classes with maximum feature distance. Class contours are extracted as data representatives to reduce training set size. Another point is that parameters involved in SVCMR are learned from data neighborhood, which brings adaptation to various datasets and avoids pricy cost spent on searching parameter spaces. Experiments on real datasets demonstrate the performance of SVCMR can be competitive to those state-of-the-art classifiers but with the higher effectiveness than them.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press, London Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press, London
2.
Zurück zum Zitat Hastie TJ, Tibshirani RJ (1998) Classification by pairwise coupling. In: Jordan MI, Kearns MJ, Solla SA (eds) Advances in neural information processing systems, vol 10. MIT Press, Cambridge, pp 507–513 Hastie TJ, Tibshirani RJ (1998) Classification by pairwise coupling. In: Jordan MI, Kearns MJ, Solla SA (eds) Advances in neural information processing systems, vol 10. MIT Press, Cambridge, pp 507–513
3.
Zurück zum Zitat Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH
4.
Zurück zum Zitat Platt J, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multi-class classification. Advances in neural information processing systems, vol 12. MIT Press, Cambridge, pp 547–553 Platt J, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multi-class classification. Advances in neural information processing systems, vol 12. MIT Press, Cambridge, pp 547–553
5.
Zurück zum Zitat Crammer K, Singer Y (2002) On the learn ability and design of output codes for multi-class problems. Mach Learn 47:201–233MATHCrossRef Crammer K, Singer Y (2002) On the learn ability and design of output codes for multi-class problems. Mach Learn 47:201–233MATHCrossRef
6.
Zurück zum Zitat Angulo C, Parra X, Catala A (2003) K-SVCR, a support vector machine for multi-class classification. Neurocomputing 55:57–77CrossRef Angulo C, Parra X, Catala A (2003) K-SVCR, a support vector machine for multi-class classification. Neurocomputing 55:57–77CrossRef
8.
Zurück zum Zitat Ben-Hur A, Horn D, Siegelmann HT (2001) Support vector clustering. In: Journal of Machine Learning Research, pp 125–137 Ben-Hur A, Horn D, Siegelmann HT (2001) Support vector clustering. In: Journal of Machine Learning Research, pp 125–137
9.
Zurück zum Zitat Daniel B, Dongwei C (2004) Training support vector machine using adaptive clustering. In: SIAM International Conference on Data Mining, pp 126–137 Daniel B, Dongwei C (2004) Training support vector machine using adaptive clustering. In: SIAM International Conference on Data Mining, pp 126–137
10.
Zurück zum Zitat Wang LP (ed) (2005) Support vector machines: theory and application. Springer, Berlin Wang LP (ed) (2005) Support vector machines: theory and application. Springer, Berlin
11.
Zurück zum Zitat Lyhyaoui A, Martinez M, Mora I (1999) Sample selection via clustering to construct support vector-like classifiers. IEEE Trans Neural Netw 10(6):1474–1481CrossRef Lyhyaoui A, Martinez M, Mora I (1999) Sample selection via clustering to construct support vector-like classifiers. IEEE Trans Neural Netw 10(6):1474–1481CrossRef
12.
Zurück zum Zitat Shin HJ, Cho SZ (2002) Pattern selection for support vector classifiers. In: Proceedings of the 3rd International Conference on Intelligent Data Engineering and Automated Learning. Manchester, UK, pp 469–474 Shin HJ, Cho SZ (2002) Pattern selection for support vector classifiers. In: Proceedings of the 3rd International Conference on Intelligent Data Engineering and Automated Learning. Manchester, UK, pp 469–474
13.
Zurück zum Zitat Frauke F, Christian I (2005) Evolutionary tuning of multiple SVM parameters. Neurocomputing 64(C):107–117 Frauke F, Christian I (2005) Evolutionary tuning of multiple SVM parameters. Neurocomputing 64(C):107–117
14.
Zurück zum Zitat Kaibo D, Sathiya KS, Aun NP (2003) A new evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing (51):41–59 Kaibo D, Sathiya KS, Aun NP (2003) A new evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing (51):41–59
15.
Zurück zum Zitat Chin CH, Chih W, Shih C et al (2006) Dynamically optimizing parameters in support vector regression: an application of electricity load forecasting. In: Proceedings of the 39th Hawaii International Conference on System Sciences Chin CH, Chih W, Shih C et al (2006) Dynamically optimizing parameters in support vector regression: an application of electricity load forecasting. In: Proceedings of the 39th Hawaii International Conference on System Sciences
16.
Zurück zum Zitat Mackay D (1991) Bayesian modeling and neural networks. Ph.D. Thesis, California Institute of Technology Pasadena, CA Mackay D (1991) Bayesian modeling and neural networks. Ph.D. Thesis, California Institute of Technology Pasadena, CA
18.
Zurück zum Zitat Murata N, Yoshizawa S, Amari S (1994) Network information criterion-determining the number of hidden units for artificial neural network models. IEEE Trans Neural Netw 5:865–872CrossRef Murata N, Yoshizawa S, Amari S (1994) Network information criterion-determining the number of hidden units for artificial neural network models. IEEE Trans Neural Netw 5:865–872CrossRef
20.
Zurück zum Zitat Weston J, Watkins C (1998) Multi-class support vector machines. CSD-TR-98-04 Royal Holloway, University of London, UK Weston J, Watkins C (1998) Multi-class support vector machines. CSD-TR-98-04 Royal Holloway, University of London, UK
Metadaten
Titel
A new learning schema based on support vector for multi-classification
verfasst von
Ling Ping
Zhou Chun-Guang
Publikationsdatum
01.03.2008
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 2/2008
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-007-0097-7

Weitere Artikel der Ausgabe 2/2008

Neural Computing and Applications 2/2008 Zur Ausgabe

Premium Partner