Skip to main content
Erschienen in: Cluster Computing 3/2019

17.01.2018

A novel online incremental and decremental learning algorithm based on variable support vector machine

verfasst von: Yuantao Chen, Jie Xiong, Weihong Xu, Jingwen Zuo

Erschienen in: Cluster Computing | Sonderheft 3/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In view of the long execution time and low execution efficiency of Support Vector Machine in large-scale training samples, the paper has proposed the online incremental and decremental learning algorithm based on variable support vector machine (VSVM). In deep understanding of the operation mechanism and correlation algorithms for VSVM, each sample has increased training datasets changes and it needs to update the classifier of learning algorithm. Firstly, they are given the online growth amount of learning algorithm taken full advantage of the incremental pre-calculated information, and doesn’t require retraining for the new incremental training datasets. Secondly, the incremental matrix inverse calculation process had greatly reduced the running time of algorithm, and it is given in order to verify out the validity of the online learning algorithm. Finally, the nine groups of datasets in the standard library have been selected in the pattern classification experiment. The experimental results are shown that the online learning algorithm given in the case to ensure the correct classification rates and effective training’s speed. With the implementation of the incremental process, training meetings, the need for large-scale data storage space, result in slow training, the online learning algorithm based on VSVM can solve the problem.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ratsaby, J.: Incremental learning with sample queries. IEEE Trans. Pattern Anal. Mach. Intell. 20(8), 883–888 (1998)CrossRef Ratsaby, J.: Incremental learning with sample queries. IEEE Trans. Pattern Anal. Mach. Intell. 20(8), 883–888 (1998)CrossRef
3.
Zurück zum Zitat Syed, N.A., Liu, H., Sung, K.K.: Incremental learning with support vector machines. In: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI-99) (1999) Syed, N.A., Liu, H., Sung, K.K.: Incremental learning with support vector machines. In: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI-99) (1999)
4.
Zurück zum Zitat Cauwenberghs, G., Paggio, T.: Incremental and decremental support vector machine learning. In: Proceedings of Advanced Neural Information Processing, MIT Press (2001) Cauwenberghs, G., Paggio, T.: Incremental and decremental support vector machine learning. In: Proceedings of Advanced Neural Information Processing, MIT Press (2001)
5.
Zurück zum Zitat Ralaivola, L., D’Alche-Buc, F.: Inremental support vector machine learning: a local approach. In: Proceedings of International Conference on Artificial Neural Networks, ICANN’2001, Vienne, Autriche (2001)CrossRef Ralaivola, L., D’Alche-Buc, F.: Inremental support vector machine learning: a local approach. In: Proceedings of International Conference on Artificial Neural Networks, ICANN’2001, Vienne, Autriche (2001)CrossRef
6.
Zurück zum Zitat Mangasarian, O.L., Solodov, M.V.: Nonlinear complementarity as unconstrained and constrained minimization. Math. Progr. Ser. B 62, 277–297 (1993)MathSciNetCrossRef Mangasarian, O.L., Solodov, M.V.: Nonlinear complementarity as unconstrained and constrained minimization. Math. Progr. Ser. B 62, 277–297 (1993)MathSciNetCrossRef
7.
Zurück zum Zitat Mangasarian, O.L., Musicant, D.R.: Active support vector machines classification. In: Advances in Neural Information Processing Systems (NIPS 2000) (2000) Mangasarian, O.L., Musicant, D.R.: Active support vector machines classification. In: Advances in Neural Information Processing Systems (NIPS 2000) (2000)
8.
Zurück zum Zitat Mangasarian, O.L., Musicant, D.R.: Successive overrelaxation for support vector machines. IEEE Trans. Neural Netw. 10, 1032–1037 (1999)CrossRef Mangasarian, O.L., Musicant, D.R.: Successive overrelaxation for support vector machines. IEEE Trans. Neural Netw. 10, 1032–1037 (1999)CrossRef
9.
Zurück zum Zitat Liu, H.P., Liu, Y.P., Sun, F.C.: Robust exemplar extraction using structured sparse coding. IEEE Trans. Neural Netw. Learn. Syst. 26(8), 1816–1821 (2015)MathSciNetCrossRef Liu, H.P., Liu, Y.P., Sun, F.C.: Robust exemplar extraction using structured sparse coding. IEEE Trans. Neural Netw. Learn. Syst. 26(8), 1816–1821 (2015)MathSciNetCrossRef
10.
Zurück zum Zitat Zhou, Y.C., Wang, X.H., Wang, T., Liu, B.Y., Sun, W.X.: Fault-tolerant multi-path routing protocol for WSN based on HEED. Int. J. Sens. Netw. 20(1), 37–44 (2016)CrossRef Zhou, Y.C., Wang, X.H., Wang, T., Liu, B.Y., Sun, W.X.: Fault-tolerant multi-path routing protocol for WSN based on HEED. Int. J. Sens. Netw. 20(1), 37–44 (2016)CrossRef
11.
Zurück zum Zitat Liu, H.P., Sun, F.C., Fang, B., Zhang, X.Y.: Robotic room-level localization using multiple sets of sonar measurements. IEEE Trans. Instrum. Meas. 66(1), 2–13 (2017)CrossRef Liu, H.P., Sun, F.C., Fang, B., Zhang, X.Y.: Robotic room-level localization using multiple sets of sonar measurements. IEEE Trans. Instrum. Meas. 66(1), 2–13 (2017)CrossRef
12.
Zurück zum Zitat Zhou, Y.C., Wang, T., Wang, Y.F.: A novel WSN key pre-distribution scheme based on group-deployment. Int. J. Sens. Netw. 15(3), 143–148 (2014)MathSciNetCrossRef Zhou, Y.C., Wang, T., Wang, Y.F.: A novel WSN key pre-distribution scheme based on group-deployment. Int. J. Sens. Netw. 15(3), 143–148 (2014)MathSciNetCrossRef
13.
Zurück zum Zitat Liu, H.P., Guo, D., Sun, F.C.: Object recognition using tactile measurements: kernel sparse coding methods. IEEE Trans. Instrum. Meas. 65(3), 656–665 (2016)CrossRef Liu, H.P., Guo, D., Sun, F.C.: Object recognition using tactile measurements: kernel sparse coding methods. IEEE Trans. Instrum. Meas. 65(3), 656–665 (2016)CrossRef
14.
Zurück zum Zitat Cai, Q.F., Hao, Z.F., Yang, X.W.: Gaussian kernel-based fuzzy inference systems for high dimensional regression. Neurocomputing 77(1), 197–204 (2012)CrossRef Cai, Q.F., Hao, Z.F., Yang, X.W.: Gaussian kernel-based fuzzy inference systems for high dimensional regression. Neurocomputing 77(1), 197–204 (2012)CrossRef
15.
Zurück zum Zitat Yang, X.W., Yu, Q.Z., He, L.F.: The one-against-all partition based binary tree support vector machine algorithms for multi-class classification. Neurocomputing 77(2), 307–314 (2012) Yang, X.W., Yu, Q.Z., He, L.F.: The one-against-all partition based binary tree support vector machine algorithms for multi-class classification. Neurocomputing 77(2), 307–314 (2012)
16.
Zurück zum Zitat He, L.F., Hao, Z.F., Yang, X.W., Xiao, F.Z., Lv, H.R.: An optimal grid-clustering based decision tree support vector machine algorithm for large-scale classification problems. Neurocomputing 77(3), 507–514 (2012) He, L.F., Hao, Z.F., Yang, X.W., Xiao, F.Z., Lv, H.R.: An optimal grid-clustering based decision tree support vector machine algorithm for large-scale classification problems. Neurocomputing 77(3), 507–514 (2012)
17.
Zurück zum Zitat Lee, Y.J., Mangasarian, O.L.: SSVM: a smooth support vector machines for classification. Comput. Optim. Appl. 20(1), 5–22 (2000)MathSciNetCrossRef Lee, Y.J., Mangasarian, O.L.: SSVM: a smooth support vector machines for classification. Comput. Optim. Appl. 20(1), 5–22 (2000)MathSciNetCrossRef
20.
Zurück zum Zitat Itti, L., Baldi, P.: Bayesian surprise attracts human attention. Vis. Res. 49(10), 1295–1306 (2009)CrossRef Itti, L., Baldi, P.: Bayesian surprise attracts human attention. Vis. Res. 49(10), 1295–1306 (2009)CrossRef
21.
Zurück zum Zitat Itti, L., Kouch, C.: Computational modeling of visual attention. Nat. Rev. Neurosci. 2(3), 194–230 (2001)CrossRef Itti, L., Kouch, C.: Computational modeling of visual attention. Nat. Rev. Neurosci. 2(3), 194–230 (2001)CrossRef
22.
Zurück zum Zitat Judd, T., Ehinger, K., Durand, F. et al.: Learning to predict where humans look. In: Proceedings of IEEE International Conference on Computer Vision, pp. 230–242 (2009) Judd, T., Ehinger, K., Durand, F. et al.: Learning to predict where humans look. In: Proceedings of IEEE International Conference on Computer Vision, pp. 230–242 (2009)
23.
Zurück zum Zitat Hou, X.D., Harel, J., Koch, C.: Image signature: highlighting sparse salient regions. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 194–201 (2012)CrossRef Hou, X.D., Harel, J., Koch, C.: Image signature: highlighting sparse salient regions. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 194–201 (2012)CrossRef
Metadaten
Titel
A novel online incremental and decremental learning algorithm based on variable support vector machine
verfasst von
Yuantao Chen
Jie Xiong
Weihong Xu
Jingwen Zuo
Publikationsdatum
17.01.2018
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe Sonderheft 3/2019
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-018-1772-4

Weitere Artikel der Sonderheft 3/2019

Cluster Computing 3/2019 Zur Ausgabe

Premium Partner