Skip to main content
Erschienen in: Neural Processing Letters 1/2021

03.01.2021

Multi-class support vector machine based on the minimization of class variance

verfasst von: Zhiqiang Zhang, Zeqian Xu, Junyan Tan, Hui Zou

Erschienen in: Neural Processing Letters | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Since the existing methods can not balance the sufficient use of information and the scale of the optimization problem, a new method for multi class classification problem is proposed, which is called multi-class support vector machine based on the minimization of class variance (MCVMSVM for short). MCVMSVM adopts the idea of semi-supervised learning and transfers the K-class problem to K(K − 1)/2 binary classification problems. For each binary classification problem, a new SVM with a mixed regularization term which considers the margin and the distribution of examples is proposed. MCVMSVM can utilize the information of all examples without increasing the scale of the optimization problem. The performance of MCVMSVM on UCI and NDC datasets is the best compared with other methods, that means MCVMSVM is more effective.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector network. Mach Learn 20:273–297MATH Cortes C, Vapnik V (1995) Support-vector network. Mach Learn 20:273–297MATH
2.
Zurück zum Zitat Vapnik V (1998) The nature of statistical learning, 2nd edn. Springer, New YorkMATH Vapnik V (1998) The nature of statistical learning, 2nd edn. Springer, New YorkMATH
3.
Zurück zum Zitat Bennett KP (1999) Combining support vector and mathematical programming methods for classification. In: Schälkopf B, Burges CJC, Smola AJ (eds) Advances in Kernel methods: support vector learning. MIT Press, Cambridge, MA, pp 307–326 Bennett KP (1999) Combining support vector and mathematical programming methods for classification. In: Schälkopf B, Burges CJC, Smola AJ (eds) Advances in Kernel methods: support vector learning. MIT Press, Cambridge, MA, pp 307–326
4.
Zurück zum Zitat Lee Y, Lin Y, Wahba G (2001) Multicategory support vector machines. Comput Sci Stat 33:498–512 Lee Y, Lin Y, Wahba G (2001) Multicategory support vector machines. Comput Sci Stat 33:498–512
5.
Zurück zum Zitat Weston J, Watkins C (1998) Multi-class support vector machines, CSD-TR-98-04 Royal Holloway. University of London, Egham, UK Weston J, Watkins C (1998) Multi-class support vector machines, CSD-TR-98-04 Royal Holloway. University of London, Egham, UK
6.
Zurück zum Zitat Graepel T, et al (1999) Classification on proximity data with LP-machines, In: Ninth International Conference on Artifical Neural Networks IEEE, London: Conference Publications, pp. 304–309. Graepel T, et al (1999) Classification on proximity data with LP-machines, In: Ninth International Conference on Artifical Neural Networks IEEE, London: Conference Publications, pp. 304–309.
7.
Zurück zum Zitat Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vector machine for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vector machine for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910CrossRef
8.
Zurück zum Zitat Crammer K, Singer Y (2002) On the algorithmic implementation of multiclass kernel-based vector machines. J Mach Learn Res 2:265–292MATH Crammer K, Singer Y (2002) On the algorithmic implementation of multiclass kernel-based vector machines. J Mach Learn Res 2:265–292MATH
9.
Zurück zum Zitat Bottou L, Cortes C, Denker JS, Drucher H, Guyon I, Jackel LD, LeCun Y, Muller UA, Sackinger E, Simard P, Vapnik V (1994) Comparison of classifier methods: a case study in handwriting digit recognition. In: International Conference on Pattern Recognition, Vol 2-conference B: Computer Vision & Image Processing Bottou L, Cortes C, Denker JS, Drucher H, Guyon I, Jackel LD, LeCun Y, Muller UA, Sackinger E, Simard P, Vapnik V (1994) Comparison of classifier methods: a case study in handwriting digit recognition. In: International Conference on Pattern Recognition, Vol 2-conference B: Computer Vision & Image Processing
10.
Zurück zum Zitat Kreb U (1999) Pairwise classification and support vector machines. In: Scholkopf B, Burges CJC, Smola AJ (eds) Advances in Kernel methods: support vector learning. MIT Press, Cambridge, pp 255–268 Kreb U (1999) Pairwise classification and support vector machines. In: Scholkopf B, Burges CJC, Smola AJ (eds) Advances in Kernel methods: support vector learning. MIT Press, Cambridge, pp 255–268
11.
Zurück zum Zitat Angulo C, Parra X, Catala A (2003) K-SVCR. A support vector machine for multi-class classification. Nurocomputing 55(1):57–77CrossRef Angulo C, Parra X, Catala A (2003) K-SVCR. A support vector machine for multi-class classification. Nurocomputing 55(1):57–77CrossRef
12.
Zurück zum Zitat Yang X, Shao YH (2013) Multiple birth support vector machine for multi-class classification. Neural Comput Appl 22(Suppl 1):S153–S216MathSciNetCrossRef Yang X, Shao YH (2013) Multiple birth support vector machine for multi-class classification. Neural Comput Appl 22(Suppl 1):S153–S216MathSciNetCrossRef
13.
Zurück zum Zitat Deng NY, Tian YJ (2012) Support vector machines: optimization based theory, algorithms, and extensions. CRC Press, Boca RatonCrossRef Deng NY, Tian YJ (2012) Support vector machines: optimization based theory, algorithms, and extensions. CRC Press, Boca RatonCrossRef
14.
Zurück zum Zitat Kotsia I, Zafeiriou S, Pitas I (2009) Novel multiclass classifiers based on the minimization of the within class variance. IEEE Trans Neural Netw 20(1):14–34CrossRef Kotsia I, Zafeiriou S, Pitas I (2009) Novel multiclass classifiers based on the minimization of the within class variance. IEEE Trans Neural Netw 20(1):14–34CrossRef
16.
Zurück zum Zitat Lu J, Xuan JY, Zhang GP (2018) Structural property-aware multilayer network embedding for latent factor analysis. Pattern Recognit 76:228–241 CrossRef Lu J, Xuan JY, Zhang GP (2018) Structural property-aware multilayer network embedding for latent factor analysis. Pattern Recognit 76:228–241 CrossRef
17.
Zurück zum Zitat Sun B, Wen SP, Wang SB (2019) Quantized synchronization of memristor-based neural networks via super twisting algorithm. Neurocomputing 380:133–140CrossRef Sun B, Wen SP, Wang SB (2019) Quantized synchronization of memristor-based neural networks via super twisting algorithm. Neurocomputing 380:133–140CrossRef
18.
Zurück zum Zitat Sun B, Cao YT, Guo ZY (2020) Synchronization of discrete-time recurrent neural networks with time-varying delays via quantized sliding mode control. Appl Math Comput 375:125093MathSciNet Sun B, Cao YT, Guo ZY (2020) Synchronization of discrete-time recurrent neural networks with time-varying delays via quantized sliding mode control. Appl Math Comput 375:125093MathSciNet
Metadaten
Titel
Multi-class support vector machine based on the minimization of class variance
verfasst von
Zhiqiang Zhang
Zeqian Xu
Junyan Tan
Hui Zou
Publikationsdatum
03.01.2021
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2021
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10393-7

Weitere Artikel der Ausgabe 1/2021

Neural Processing Letters 1/2021 Zur Ausgabe

Neuer Inhalt