Skip to main content
Top
Published in: Neural Computing and Applications 2/2008

01-03-2008 | BIC-TA 2006

A new learning schema based on support vector for multi-classification

Authors: Ling Ping, Zhou Chun-Guang

Published in: Neural Computing and Applications | Issue 2/2008

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A novel learning schema SVCMR based on support vector is proposed in this paper to address M-class classification issue. It creates a tree-shaped decision frame where M/2 nodes are constructed with the three-separation model as the basic classifier. A class selection rule is defined to ensure basic classifiers be trained in turn on pair of classes with maximum feature distance. Class contours are extracted as data representatives to reduce training set size. Another point is that parameters involved in SVCMR are learned from data neighborhood, which brings adaptation to various datasets and avoids pricy cost spent on searching parameter spaces. Experiments on real datasets demonstrate the performance of SVCMR can be competitive to those state-of-the-art classifiers but with the higher effectiveness than them.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press, London Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines. Cambridge University Press, London
2.
go back to reference Hastie TJ, Tibshirani RJ (1998) Classification by pairwise coupling. In: Jordan MI, Kearns MJ, Solla SA (eds) Advances in neural information processing systems, vol 10. MIT Press, Cambridge, pp 507–513 Hastie TJ, Tibshirani RJ (1998) Classification by pairwise coupling. In: Jordan MI, Kearns MJ, Solla SA (eds) Advances in neural information processing systems, vol 10. MIT Press, Cambridge, pp 507–513
3.
go back to reference Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik V (1998) Statistical learning theory. Wiley, New YorkMATH
4.
go back to reference Platt J, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multi-class classification. Advances in neural information processing systems, vol 12. MIT Press, Cambridge, pp 547–553 Platt J, Cristianini N, Shawe-Taylor J (2000) Large margin DAGs for multi-class classification. Advances in neural information processing systems, vol 12. MIT Press, Cambridge, pp 547–553
5.
go back to reference Crammer K, Singer Y (2002) On the learn ability and design of output codes for multi-class problems. Mach Learn 47:201–233MATHCrossRef Crammer K, Singer Y (2002) On the learn ability and design of output codes for multi-class problems. Mach Learn 47:201–233MATHCrossRef
6.
go back to reference Angulo C, Parra X, Catala A (2003) K-SVCR, a support vector machine for multi-class classification. Neurocomputing 55:57–77CrossRef Angulo C, Parra X, Catala A (2003) K-SVCR, a support vector machine for multi-class classification. Neurocomputing 55:57–77CrossRef
8.
go back to reference Ben-Hur A, Horn D, Siegelmann HT (2001) Support vector clustering. In: Journal of Machine Learning Research, pp 125–137 Ben-Hur A, Horn D, Siegelmann HT (2001) Support vector clustering. In: Journal of Machine Learning Research, pp 125–137
9.
go back to reference Daniel B, Dongwei C (2004) Training support vector machine using adaptive clustering. In: SIAM International Conference on Data Mining, pp 126–137 Daniel B, Dongwei C (2004) Training support vector machine using adaptive clustering. In: SIAM International Conference on Data Mining, pp 126–137
10.
go back to reference Wang LP (ed) (2005) Support vector machines: theory and application. Springer, Berlin Wang LP (ed) (2005) Support vector machines: theory and application. Springer, Berlin
11.
go back to reference Lyhyaoui A, Martinez M, Mora I (1999) Sample selection via clustering to construct support vector-like classifiers. IEEE Trans Neural Netw 10(6):1474–1481CrossRef Lyhyaoui A, Martinez M, Mora I (1999) Sample selection via clustering to construct support vector-like classifiers. IEEE Trans Neural Netw 10(6):1474–1481CrossRef
12.
go back to reference Shin HJ, Cho SZ (2002) Pattern selection for support vector classifiers. In: Proceedings of the 3rd International Conference on Intelligent Data Engineering and Automated Learning. Manchester, UK, pp 469–474 Shin HJ, Cho SZ (2002) Pattern selection for support vector classifiers. In: Proceedings of the 3rd International Conference on Intelligent Data Engineering and Automated Learning. Manchester, UK, pp 469–474
13.
go back to reference Frauke F, Christian I (2005) Evolutionary tuning of multiple SVM parameters. Neurocomputing 64(C):107–117 Frauke F, Christian I (2005) Evolutionary tuning of multiple SVM parameters. Neurocomputing 64(C):107–117
14.
go back to reference Kaibo D, Sathiya KS, Aun NP (2003) A new evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing (51):41–59 Kaibo D, Sathiya KS, Aun NP (2003) A new evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing (51):41–59
15.
go back to reference Chin CH, Chih W, Shih C et al (2006) Dynamically optimizing parameters in support vector regression: an application of electricity load forecasting. In: Proceedings of the 39th Hawaii International Conference on System Sciences Chin CH, Chih W, Shih C et al (2006) Dynamically optimizing parameters in support vector regression: an application of electricity load forecasting. In: Proceedings of the 39th Hawaii International Conference on System Sciences
16.
go back to reference Mackay D (1991) Bayesian modeling and neural networks. Ph.D. Thesis, California Institute of Technology Pasadena, CA Mackay D (1991) Bayesian modeling and neural networks. Ph.D. Thesis, California Institute of Technology Pasadena, CA
18.
go back to reference Murata N, Yoshizawa S, Amari S (1994) Network information criterion-determining the number of hidden units for artificial neural network models. IEEE Trans Neural Netw 5:865–872CrossRef Murata N, Yoshizawa S, Amari S (1994) Network information criterion-determining the number of hidden units for artificial neural network models. IEEE Trans Neural Netw 5:865–872CrossRef
20.
go back to reference Weston J, Watkins C (1998) Multi-class support vector machines. CSD-TR-98-04 Royal Holloway, University of London, UK Weston J, Watkins C (1998) Multi-class support vector machines. CSD-TR-98-04 Royal Holloway, University of London, UK
Metadata
Title
A new learning schema based on support vector for multi-classification
Authors
Ling Ping
Zhou Chun-Guang
Publication date
01-03-2008
Publisher
Springer-Verlag
Published in
Neural Computing and Applications / Issue 2/2008
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-007-0097-7

Other articles of this Issue 2/2008

Neural Computing and Applications 2/2008 Go to the issue

Premium Partner