Skip to main content

2016 | OriginalPaper | Buchkapitel

Combining One-Versus-One and One-Versus-All Strategies to Improve Multiclass SVM Classifier

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Support Vector Machine (SVM) is a binary classifier, but most of the problems we find in the real-life applications are multiclass. There are many methods of decomposition such a task into the set of smaller classification problems involving two classes only. Two of the widely known are one-versus-one and one-versus-rest strategies. There are several papers dealing with these methods, improving and comparing them. In this paper, we try to combine theses strategies to exploit their strong aspects to achieve better performance. As the performance we understand both recognition ratio and the speed of the proposed algorithm. We used SVM classifier on several different databases to test our solution. The results show that we obtain better recognition ratio on all tested databases. Moreover, the proposed method turns out to be much more efficient than the original one-versus-one strategy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Allwein, E., Schapire, R., Singer, Y.: Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res. 1, 113–141 (2001)MathSciNetMATH Allwein, E., Schapire, R., Singer, Y.: Reducing multiclass to binary: a unifying approach for margin classifiers. J. Mach. Learn. Res. 1, 113–141 (2001)MathSciNetMATH
3.
Zurück zum Zitat Chen, D.R., Wu, Q., Ying, Y., Zhou, D.X.: Support vector machine soft margin classifiers: error analysis. J. Mach. Learn. Res. 5, 1143–1175 (2004)MathSciNetMATH Chen, D.R., Wu, Q., Ying, Y., Zhou, D.X.: Support vector machine soft margin classifiers: error analysis. J. Mach. Learn. Res. 5, 1143–1175 (2004)MathSciNetMATH
4.
Zurück zum Zitat Chmielnicki, W., Stapor, K.: Protein fold recognition with combined SVM-RDA classifier. Lect. Notes Artif. Intell. 6076, 162–169 (2010) Chmielnicki, W., Stapor, K.: Protein fold recognition with combined SVM-RDA classifier. Lect. Notes Artif. Intell. 6076, 162–169 (2010)
5.
Zurück zum Zitat Chmielnicki, W., Stapor, K.: A hybrid discriminative/generative approach to protein fold recognition. Neurocomputing 75(1), 194–198 (2012)CrossRef Chmielnicki, W., Stapor, K.: A hybrid discriminative/generative approach to protein fold recognition. Neurocomputing 75(1), 194–198 (2012)CrossRef
6.
Zurück zum Zitat Chmielnicki, W., Stapor, K.: A modification of the pairwise coupling algorithm to solve multi-class problem. In: Proceedings of XLIII Conference on Mathematics Applications, in Polish (2014) Chmielnicki, W., Stapor, K.: A modification of the pairwise coupling algorithm to solve multi-class problem. In: Proceedings of XLIII Conference on Mathematics Applications, in Polish (2014)
7.
Zurück zum Zitat Chmielnicki, W., Roterman-Konieczna, I., Stapor, K.: An improved protein fold recognition with support vector machines. Expert Syst. 20(2), 200–211 (2012) Chmielnicki, W., Roterman-Konieczna, I., Stapor, K.: An improved protein fold recognition with support vector machines. Expert Syst. 20(2), 200–211 (2012)
8.
Zurück zum Zitat Ding, C.H., Dubchak, I.: Multi-class protein fold recognition using support vector machines and neural networks. Bioinformatics 17, 349–358 (2001)CrossRef Ding, C.H., Dubchak, I.: Multi-class protein fold recognition using support vector machines and neural networks. Bioinformatics 17, 349–358 (2001)CrossRef
9.
Zurück zum Zitat Dietterich, T.G., Bakiri, G.: Solving multiclass problems via error-correcting output codes. J. Artif. Intell. Res. 2, 263–286 (1995)MATH Dietterich, T.G., Bakiri, G.: Solving multiclass problems via error-correcting output codes. J. Artif. Intell. Res. 2, 263–286 (1995)MATH
10.
Zurück zum Zitat Dubchak, I., Muchnik, I., Holbrook, S.R., Kim, S.H.: Prediction of protein folding class using global description of amino acid sequence. Proc. Natl. Acad. Sci. USA 92, 8700–8704 (1995)CrossRef Dubchak, I., Muchnik, I., Holbrook, S.R., Kim, S.H.: Prediction of protein folding class using global description of amino acid sequence. Proc. Natl. Acad. Sci. USA 92, 8700–8704 (1995)CrossRef
11.
Zurück zum Zitat Fei, B., Liu, J.: Binary tree of SVM: a new fast multiclass training and classification algorithm. IEEE Trans. Neural Netw. 17(3), 696–704 (2006)CrossRef Fei, B., Liu, J.: Binary tree of SVM: a new fast multiclass training and classification algorithm. IEEE Trans. Neural Netw. 17(3), 696–704 (2006)CrossRef
12.
Zurück zum Zitat Friedman, J.H.: Another approach to polychotomous classification. Stanford Department of Statistics (1996) Friedman, J.H.: Another approach to polychotomous classification. Stanford Department of Statistics (1996)
13.
Zurück zum Zitat Galar, M., Fernandez, A., Tartas, E.B., Sola, B., Herrera, F.: Dynamic classifier selection for one-vs-one strategy: avoiding non-competent classifiers. Pattern Recognit. 46(12), 3412–3424 (2013)CrossRef Galar, M., Fernandez, A., Tartas, E.B., Sola, B., Herrera, F.: Dynamic classifier selection for one-vs-one strategy: avoiding non-competent classifiers. Pattern Recognit. 46(12), 3412–3424 (2013)CrossRef
14.
Zurück zum Zitat Glomb, P., Romaszewski, M., Opozda, S., Sochan, A.: Choosing and modeling hand gesture database for natural user interface. In: Proceedings of the 9th International Conference on Gesture and Sign Language in Human-Computer Interaction and Embodied Communication, pp. 24–35 (2011) Glomb, P., Romaszewski, M., Opozda, S., Sochan, A.: Choosing and modeling hand gesture database for natural user interface. In: Proceedings of the 9th International Conference on Gesture and Sign Language in Human-Computer Interaction and Embodied Communication, pp. 24–35 (2011)
16.
Zurück zum Zitat He, H., Garcia, E.A.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009)CrossRef He, H., Garcia, E.A.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009)CrossRef
17.
Zurück zum Zitat Hobohm, U., Scharf, M., Schneider, R., Sander, C.: Selection of a representative set of structures from the Brookhaven protein bank. Protein Sci. 1, 409–417 (1992)CrossRef Hobohm, U., Scharf, M., Schneider, R., Sander, C.: Selection of a representative set of structures from the Brookhaven protein bank. Protein Sci. 1, 409–417 (1992)CrossRef
18.
Zurück zum Zitat Kijsirikul, B., Ussivakul, N.: Multiclass support vector machines using adaptive directed acyclic graph. In: Proceedings of the International Joint Conference on Neural Networks, pp. 980–985 (2002) Kijsirikul, B., Ussivakul, N.: Multiclass support vector machines using adaptive directed acyclic graph. In: Proceedings of the International Joint Conference on Neural Networks, pp. 980–985 (2002)
19.
Zurück zum Zitat Kotsiantis, S., Kanellopoulos, D., Pintelas, P.: Handling imbalanced datasets: a review. GESTS Int. Trans. Comput. Sci. Eng. 30(1), 25–36 (2006) Kotsiantis, S., Kanellopoulos, D., Pintelas, P.: Handling imbalanced datasets: a review. GESTS Int. Trans. Comput. Sci. Eng. 30(1), 25–36 (2006)
20.
Zurück zum Zitat Krawczyk, B., Wozniak, M., Cyganek, B.: Clustering-based ensembles for one-class classification. Inf. Sci. 264, 182–195 (2014)MathSciNetCrossRef Krawczyk, B., Wozniak, M., Cyganek, B.: Clustering-based ensembles for one-class classification. Inf. Sci. 264, 182–195 (2014)MathSciNetCrossRef
21.
Zurück zum Zitat Lorena, A.C., Carvalho, A.C., Gama, J.M.: A review on the combination of binary classifiers in multiclass problems. Artif. Intell. Rev. 30(1–4), 19–37 (2008)CrossRef Lorena, A.C., Carvalho, A.C., Gama, J.M.: A review on the combination of binary classifiers in multiclass problems. Artif. Intell. Rev. 30(1–4), 19–37 (2008)CrossRef
22.
Zurück zum Zitat Lorena, A.C., Carvalho, A.C.: Building binary-tree-based multiclass classifiers using separability measures. Neurocomputing 73(16–18), 2837–2845 (2010)CrossRef Lorena, A.C., Carvalho, A.C.: Building binary-tree-based multiclass classifiers using separability measures. Neurocomputing 73(16–18), 2837–2845 (2010)CrossRef
23.
Zurück zum Zitat Moreira, M., Mayoraz, E.: Improved pairwise coupling classification with correcting classifiers. In: Proceedings of Tenth European Conference on Machine Learning ECML, Chemmitz, Germany, pp. 160–171 (1998) Moreira, M., Mayoraz, E.: Improved pairwise coupling classification with correcting classifiers. In: Proceedings of Tenth European Conference on Machine Learning ECML, Chemmitz, Germany, pp. 160–171 (1998)
24.
Zurück zum Zitat Platt, J.C., Cristianini, N., Shawe-Taylor, J.: Large margin DAGs for multiclass classification. In: Proceedings of Neural Information Processing Systems, pp. 547–553 (2000) Platt, J.C., Cristianini, N., Shawe-Taylor, J.: Large margin DAGs for multiclass classification. In: Proceedings of Neural Information Processing Systems, pp. 547–553 (2000)
25.
Zurück zum Zitat Sáez, J.A., Galar, M., Luengo, J., Herrera, F.: A first study on decomposition strategies with data with class noise using decision trees. In: Proceedings of the 7th International Conference on Hybrid Artificial Intelligent Systems—Volume Part II, pp. 25–35 (2012) Sáez, J.A., Galar, M., Luengo, J., Herrera, F.: A first study on decomposition strategies with data with class noise using decision trees. In: Proceedings of the 7th International Conference on Hybrid Artificial Intelligent Systems—Volume Part II, pp. 25–35 (2012)
26.
Zurück zum Zitat Silva, P.F.B., Marcal, A.R.S., Almeida da Silva, R.M.: Evaluation of Features for Leaf Discrimination. Springer Lecture Notes in Computer Science, vol. 7950, pp. 197–204. Springer, Heidelberg (2013) Silva, P.F.B., Marcal, A.R.S., Almeida da Silva, R.M.: Evaluation of Features for Leaf Discrimination. Springer Lecture Notes in Computer Science, vol. 7950, pp. 197–204. Springer, Heidelberg (2013)
28.
29.
Zurück zum Zitat Vural, V., Dy, J.G.: A hierarchical method for multi-class support vector machines. In: Proceedings of the XXI ICML, pp. 831–838 (2004) Vural, V., Dy, J.G.: A hierarchical method for multi-class support vector machines. In: Proceedings of the XXI ICML, pp. 831–838 (2004)
30.
Zurück zum Zitat Windeatt, T., Ghaderi, R.: Coding and decoding for multiclass learning problems. Inf. Fusion 4(1), 11–21 (2003)CrossRef Windeatt, T., Ghaderi, R.: Coding and decoding for multiclass learning problems. Inf. Fusion 4(1), 11–21 (2003)CrossRef
Metadaten
Titel
Combining One-Versus-One and One-Versus-All Strategies to Improve Multiclass SVM Classifier
verfasst von
Wiesław Chmielnicki
Katarzyna Sta̧por
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-26227-7_4