Skip to main content

2018 | OriginalPaper | Buchkapitel

A Modification of Solution Optimization in Support Vector Machine Simplification for Classification

verfasst von : Pham Quoc Thang, Nguyen Thanh Thuy, Hoang Thi Lam

Erschienen in: Information Systems Design and Intelligent Applications

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The efficient classification ability of support vector machine (SVM) has been shown in many practical applications, but currently it is significantly slower in testing phase than other classification approaches due to large number of support vectors included in the solution. Among different approaches, simplification of support vector machine (SimpSVM) accelerates the test phase by replacing original SVM with a simplified SVM that uses significantly fewer support vectors. Nevertheless, the final aim of the simplification is to try keeping the simplified solution as similar as possible to the original one. To ameliorate this similarity, in this paper, we present a modification of solution optimization in SimpSVM. The proposed approach is based on stochastic optimization. Experiments on benchmark and sign language datasets show improved results by our modification.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Burges, C.J.C.: Simplified Support Vector Decision Rules. In: Proceedings 13th International Conference on Machine Learning. Bari, Italy (1996) 71–77 Burges, C.J.C.: Simplified Support Vector Decision Rules. In: Proceedings 13th International Conference on Machine Learning. Bari, Italy (1996) 71–77
3.
Zurück zum Zitat Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 2: 121 (1998) 121–167 Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 2: 121 (1998) 121–167
4.
Zurück zum Zitat Burges, C.J.C., Schoelkopf, B.: Improving the Accuracy and Speed of Support Vector Learning Machines. In: Advances in Neural Information Processing Systems 9. Cambridge, MA: MIT Press (1997) 375–381 Burges, C.J.C., Schoelkopf, B.: Improving the Accuracy and Speed of Support Vector Learning Machines. In: Advances in Neural Information Processing Systems 9. Cambridge, MA: MIT Press (1997) 375–381
5.
Zurück zum Zitat Liu, C., Nakashima, K., Sako, H.: Handwritten Digit Recognition: Benchmarking of State-of-the-art Techniques. Pattern Recognition, 36 (2003) 2271–2285 Liu, C., Nakashima, K., Sako, H.: Handwritten Digit Recognition: Benchmarking of State-of-the-art Techniques. Pattern Recognition, 36 (2003) 2271–2285
6.
Zurück zum Zitat Schlkopf, B., Mika, S., Burges, C.J.C., Knirsch, P., Mller, K.R., Rtsch, G., Smola, A.: Input Space vs. Feature Space in Kernel-Based Methods. IEEE Trans. Neural Networks 10 (1999) 1000–1017 Schlkopf, B., Mika, S., Burges, C.J.C., Knirsch, P., Mller, K.R., Rtsch, G., Smola, A.: Input Space vs. Feature Space in Kernel-Based Methods. IEEE Trans. Neural Networks 10 (1999) 1000–1017
7.
Zurück zum Zitat Tang, B., Mazzoni, D.: Multiclass Reduced-set Support Vector Machines. In: Proc. Int’l Conf. Machine Learning. ICML’06, ACM, New York, USA (2006) 921–928 Tang, B., Mazzoni, D.: Multiclass Reduced-set Support Vector Machines. In: Proc. Int’l Conf. Machine Learning. ICML’06, ACM, New York, USA (2006) 921–928
8.
Zurück zum Zitat Nguyen, D.D., Ho, T.B.: An Efficient Method for Simplifying Support Vector Machines. In: Proceedings of the 22nd International Conference on Machine Learning, ICML 2005, Bonn, Germany, Vol. 119. ACM, New York, USA (2005) 617–624 Nguyen, D.D., Ho, T.B.: An Efficient Method for Simplifying Support Vector Machines. In: Proceedings of the 22nd International Conference on Machine Learning, ICML 2005, Bonn, Germany, Vol. 119. ACM, New York, USA (2005) 617–624
9.
Zurück zum Zitat Nguyen, D.D, Kazunori, M., Kazuo, H., Yasuhiro, T., Daichi, T., Masahiro, T.: Multi-class Support Vector Machine Simplification. In: Proceedings of the 10th Pacific Rim International Conference on Artificial Intelligence. Trends in Artificial Intelligence, PRICAI 2008, Hanoi, Vietnam (2008) 799–808 Nguyen, D.D, Kazunori, M., Kazuo, H., Yasuhiro, T., Daichi, T., Masahiro, T.: Multi-class Support Vector Machine Simplification. In: Proceedings of the 10th Pacific Rim International Conference on Artificial Intelligence. Trends in Artificial Intelligence, PRICAI 2008, Hanoi, Vietnam (2008) 799–808
11.
Zurück zum Zitat Kadous, M.W.: Temporal Classification: Extending the Classification Paradigm to Multivariate Time Series. In: PhD Thesis. The UNSW (2002) Kadous, M.W.: Temporal Classification: Extending the Classification Paradigm to Multivariate Time Series. In: PhD Thesis. The UNSW (2002)
12.
Zurück zum Zitat Pham, Q.T., Nguyen, D.D., Nguyen, T.T.: A Comparison of SimpSVM and RVM for Sign Language Recognition. In: Proceedings of the 2017 International Conference on Machine Learning and Soft Computing, ICMLSC’17, Ho Chi Minh City, Vietnam, January 13–16, 2017. ACM, New York, USA (2017) 98–104 Pham, Q.T., Nguyen, D.D., Nguyen, T.T.: A Comparison of SimpSVM and RVM for Sign Language Recognition. In: Proceedings of the 2017 International Conference on Machine Learning and Soft Computing, ICMLSC’17, Ho Chi Minh City, Vietnam, January 13–16, 2017. ACM, New York, USA (2017) 98–104
13.
Zurück zum Zitat Kadous, M.W, Claude, S.: Constructive Induction for Classifying Time Series. In: European Conference on Machine Learning (ECML) (2004) Kadous, M.W, Claude, S.: Constructive Induction for Classifying Time Series. In: European Conference on Machine Learning (ECML) (2004)
14.
Zurück zum Zitat Kadous, M.W, Claude, S.: Classification of Multivariate Time Series and Structured Data using Constructive Induction. Machine Learning Journal, 58 (2005) Kadous, M.W, Claude, S.: Classification of Multivariate Time Series and Structured Data using Constructive Induction. Machine Learning Journal, 58 (2005)
15.
Zurück zum Zitat Yale, S., Ying, Y.: Sign Language Recognition. In: 6.867 Machine Learning Term Paper (2008) Yale, S., Ying, Y.: Sign Language Recognition. In: 6.867 Machine Learning Term Paper (2008)
16.
Zurück zum Zitat Juan, J.R., Carlos, J.A., Henrik, B.: Learning First Order Logic Time Series Classifiers: Rules and Boosting. Principles of Data Mining and Knowledge Discovery. Lecture Notes in Computer Science, Volume 1910 (2000) 299–308 Juan, J.R., Carlos, J.A., Henrik, B.: Learning First Order Logic Time Series Classifiers: Rules and Boosting. Principles of Data Mining and Knowledge Discovery. Lecture Notes in Computer Science, Volume 1910 (2000) 299–308
17.
Zurück zum Zitat Juan, J.R., Carlos, J.A.: Building RBF Networks for Time Series Classification by Boosting. Pattern Recognition and String Matching Combinatorial Optimization, Volume 13 (2002) 135–153 Juan, J.R., Carlos, J.A.: Building RBF Networks for Time Series Classification by Boosting. Pattern Recognition and String Matching Combinatorial Optimization, Volume 13 (2002) 135–153
Metadaten
Titel
A Modification of Solution Optimization in Support Vector Machine Simplification for Classification
verfasst von
Pham Quoc Thang
Nguyen Thanh Thuy
Hoang Thi Lam
Copyright-Jahr
2018
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-7512-4_15