Skip to main content
Erschienen in: Evolutionary Intelligence 2/2019

02.02.2019 | Review Article

Incremental supervised learning: algorithms and applications in pattern recognition

verfasst von: Aida Chefrour

Erschienen in: Evolutionary Intelligence | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The most effective well-known methods in the context of static machine learning offer no alternative to evolution and dynamic adaptation to integrate new data or to restructure problems already partially learned. In this area, the incremental learning represents an interesting alternative and constitutes an open research field, becoming one of the major concerns of the machine learning and classification community. In this paper, we study incremental supervised learning techniques and their applications, especially in the field of pattern recognition. This article presents an overview of the main concepts and supervised algorithms of incremental learning, including a synthesis of research studies done in this field and focusing on neural networks, decision trees and support vector machines.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Almaksour A (2011) Incremental learning of evolving fuzzy inference systems: application to handwritten gesture recognition. Ph.D. thesis, INSA de Rennes Almaksour A (2011) Incremental learning of evolving fuzzy inference systems: application to handwritten gesture recognition. Ph.D. thesis, INSA de Rennes
2.
Zurück zum Zitat Bai X, Ren P, Zhang H, Zhou J (2015) An incremental structured part model for object recognition. Neurocomputing 154:189–199CrossRef Bai X, Ren P, Zhang H, Zhou J (2015) An incremental structured part model for object recognition. Neurocomputing 154:189–199CrossRef
3.
Zurück zum Zitat Cauwenberghs G, Poggio T (2001) Incremental and decremental support vector machine learning. In: Advances in neural information processing systems, pp 409–415 Cauwenberghs G, Poggio T (2001) Incremental and decremental support vector machine learning. In: Advances in neural information processing systems, pp 409–415
4.
Zurück zum Zitat Chefrour A, Souici-Meslati L (2013) Un panorama de méthodes d’apprentissage incrémental. In: International conference on extraction and knowledge management, Toulouse, France, pp 57–70 Chefrour A, Souici-Meslati L (2013) Un panorama de méthodes d’apprentissage incrémental. In: International conference on extraction and knowledge management, Toulouse, France, pp 57–70
5.
Zurück zum Zitat Déniz O, Castrillón M, Lorenzo J, Hernández M (2002) An incremental learning algorithm for face recognition. International workshop on biometric authentication. Springer, New York, pp 1–9MATH Déniz O, Castrillón M, Lorenzo J, Hernández M (2002) An incremental learning algorithm for face recognition. International workshop on biometric authentication. Springer, New York, pp 1–9MATH
6.
Zurück zum Zitat Diehl CP, Cauwenberghs G (2003) SVM incremental learning adaptation and optimization. In: Proceedings of neural networks conference, vol 4, pp 2685–2690 Diehl CP, Cauwenberghs G (2003) SVM incremental learning adaptation and optimization. In: Proceedings of neural networks conference, vol 4, pp 2685–2690
7.
Zurück zum Zitat Erdem Z, Polikar R, Gurgen F, Yumusak N (2005) Ensemble of SVMs for incremental learning. In: Proceedings of international workshop on multiple classifier systems. Springer, New York, pp 246–256 Erdem Z, Polikar R, Gurgen F, Yumusak N (2005) Ensemble of SVMs for incremental learning. In: Proceedings of international workshop on multiple classifier systems. Springer, New York, pp 246–256
8.
Zurück zum Zitat Fung G, Mangasarian OL (2002) Incremental support vector machine classification. In: Proceedings of the international conference on data mining (SIAM). Society for Industrial and Applied Mathematics, pp 247–260 Fung G, Mangasarian OL (2002) Incremental support vector machine classification. In: Proceedings of the international conference on data mining (SIAM). Society for Industrial and Applied Mathematics, pp 247–260
9.
Zurück zum Zitat Ghassabeh YA, Moghaddam HA (2007) A face recognition system using neural networks with incremental learning ability.In: Proceedings of the international symposium on computational intelligence in robotics and automation, pp 291–296 Ghassabeh YA, Moghaddam HA (2007) A face recognition system using neural networks with incremental learning ability.In: Proceedings of the international symposium on computational intelligence in robotics and automation, pp 291–296
10.
Zurück zum Zitat Gurney KR, Baker D, Rayner P, Denning S (2008) Interannual variations in continental-scale net carbon exchange and sensitivity to observing networks estimated from atmospheric CO2 inversions for the period 1980 to 2005. Global Biogeochem Cycles 22(3):1–17CrossRef Gurney KR, Baker D, Rayner P, Denning S (2008) Interannual variations in continental-scale net carbon exchange and sensitivity to observing networks estimated from atmospheric CO2 inversions for the period 1980 to 2005. Global Biogeochem Cycles 22(3):1–17CrossRef
11.
Zurück zum Zitat Hacene G, Gripon V, Farrugia N, Arzel M, Jezequel M (2017) Incremental learning with pretrained convolutional neural networks and binary associative memories Hacene G, Gripon V, Farrugia N, Arzel M, Jezequel M (2017) Incremental learning with pretrained convolutional neural networks and binary associative memories
12.
Zurück zum Zitat Han S, Meng Z, Khan AS, Tong Y (2016) Incremental boosting convolutional neural network for facial action unit recognition. In: Advances in neural information processing systems, pp 109–117 Han S, Meng Z, Khan AS, Tong Y (2016) Incremental boosting convolutional neural network for facial action unit recognition. In: Advances in neural information processing systems, pp 109–117
13.
Zurück zum Zitat Huang C, Ai H, Yamashita T, Lao S, Kawade M (2007) Incremental learning of boosted face detector. In: Proceedings of the 11th on computer vision IEEE, pp 1–8 Huang C, Ai H, Yamashita T, Lao S, Kawade M (2007) Incremental learning of boosted face detector. In: Proceedings of the 11th on computer vision IEEE, pp 1–8
14.
15.
Zurück zum Zitat Joshi P, Kulkarni P (2012) Incremental learning: areas and methods-a survey. Int J Data Min Knowl Manag Process 2(5):43CrossRef Joshi P, Kulkarni P (2012) Incremental learning: areas and methods-a survey. Int J Data Min Knowl Manag Process 2(5):43CrossRef
16.
Zurück zum Zitat Kawewong A, Pimup R, Hasegawa O (2013) Incremental learning framework for indoor scene recognition. In: AAAI, pp 1–7 Kawewong A, Pimup R, Hasegawa O (2013) Incremental learning framework for indoor scene recognition. In: AAAI, pp 1–7
17.
Zurück zum Zitat Lawal IA, Abdulkarim SA (2017) Adaptive svm for data stream classification, S Afr Comput J 29(1):27–42 Lawal IA, Abdulkarim SA (2017) Adaptive svm for data stream classification, S Afr Comput J 29(1):27–42
18.
Zurück zum Zitat Liu Y (2015) Incremental learning in deep neural networks. Master of Science Thesis, Tampere University of Technology Liu Y (2015) Incremental learning in deep neural networks. Master of Science Thesis, Tampere University of Technology
19.
Zurück zum Zitat Loosli G (2010) Méthodes à noyaux pour la détection de contexte. Academic editions E Loosli G (2010) Méthodes à noyaux pour la détection de contexte. Academic editions E
20.
Zurück zum Zitat Lu Y, Boukharouba K, Boonært J, Fleury A, Lecoeuche S (2014) Application of an incremental svm algorithm for on-line human recognition from video surveillance using texture and color features. Neurocomputing 126:132–140CrossRef Lu Y, Boukharouba K, Boonært J, Fleury A, Lecoeuche S (2014) Application of an incremental svm algorithm for on-line human recognition from video surveillance using texture and color features. Neurocomputing 126:132–140CrossRef
21.
Zurück zum Zitat Luo J, Pronobis A, Caputo B, Jensfelt P (2007) Incremental learning for place recognition in dynamic environments. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, pp 721–728 Luo J, Pronobis A, Caputo B, Jensfelt P (2007) Incremental learning for place recognition in dynamic environments. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, pp 721–728
22.
Zurück zum Zitat Mańdziuk J, Shastri L (2002) Incremental class learning approach and its application to handwritten digit recognition. Inf Sci 141(3–4):193–217.CrossRefMATH Mańdziuk J, Shastri L (2002) Incremental class learning approach and its application to handwritten digit recognition. Inf Sci 141(3–4):193–217.CrossRefMATH
23.
Zurück zum Zitat Mohemmed A, Lu G, Kasabov N (2012) Evaluating span incremental learning for handwritten digit recognition. International conference on neural information processing. Springer, New York, pp 670–677 Mohemmed A, Lu G, Kasabov N (2012) Evaluating span incremental learning for handwritten digit recognition. International conference on neural information processing. Springer, New York, pp 670–677
24.
Zurück zum Zitat Molina JFG, Zheng L, Sertdemir M, Dinter DJ, Schönberg S, Rädle M (2014) Incremental learning with svm for multimodal classification of prostatic adenocarcinoma, PLoS One 9(4):e93600CrossRef Molina JFG, Zheng L, Sertdemir M, Dinter DJ, Schönberg S, Rädle M (2014) Incremental learning with svm for multimodal classification of prostatic adenocarcinoma, PLoS One 9(4):e93600CrossRef
25.
Zurück zum Zitat Ozawa S, Pang S, Kasabov N (2008) Incremental learning of chunk data for online pattern classification systems. IEEE Trans Neural Netw 19(6):1061–1074CrossRef Ozawa S, Pang S, Kasabov N (2008) Incremental learning of chunk data for online pattern classification systems. IEEE Trans Neural Netw 19(6):1061–1074CrossRef
26.
Zurück zum Zitat Ozawa S, Toh SL, Abe S, Pang S, Kasabov N (2005) Incremental learning of feature space and classifier for face recognition. Neural Netw 18(5–6):575–584CrossRef Ozawa S, Toh SL, Abe S, Pang S, Kasabov N (2005) Incremental learning of feature space and classifier for face recognition. Neural Netw 18(5–6):575–584CrossRef
27.
Zurück zum Zitat Polikar R, Upda L, Upda SS, Honavar V (2001) Learn++: an incremental learning algorithm for supervised neural networks. IEEE Trans Syst Man Cybern Part C 31(4):497–508CrossRef Polikar R, Upda L, Upda SS, Honavar V (2001) Learn++: an incremental learning algorithm for supervised neural networks. IEEE Trans Syst Man Cybern Part C 31(4):497–508CrossRef
28.
Zurück zum Zitat Prudent Y (2006) Système d’apprentissage incrémental et hybride. PhD thesis, INSA University, Rouen Prudent Y (2006) Système d’apprentissage incrémental et hybride. PhD thesis, INSA University, Rouen
29.
Zurück zum Zitat Ralaivola L, dAlché Buc F (2001) Incremental support vector machine learning: A local approach. In: Proceedings of the international conference on artificial neural networks. Springer, New York, pp 322–330 Ralaivola L, dAlché Buc F (2001) Incremental support vector machine learning: A local approach. In: Proceedings of the international conference on artificial neural networks. Springer, New York, pp 322–330
30.
Zurück zum Zitat Reddy KK, Liu J, Shah M (2009) Incremental action recognition using feature-tree. In: Proceedings of the 12th international conference on computer vision IEEE, pp 1010–1017 Reddy KK, Liu J, Shah M (2009) Incremental action recognition using feature-tree. In: Proceedings of the 12th international conference on computer vision IEEE, pp 1010–1017
31.
Zurück zum Zitat Ruping S (2001) Incremental learning with support vector machines. In: Proceedings of the international conference on Data Mining IEEE, pp 641–642 Ruping S (2001) Incremental learning with support vector machines. In: Proceedings of the international conference on Data Mining IEEE, pp 641–642
32.
Zurück zum Zitat Salperwyck C, Lemaire V, de Bois DUDP (2010) Classification incrémentale supervisée: un panel introductif. In: AAFD, pp 121–148 Salperwyck C, Lemaire V, de Bois DUDP (2010) Classification incrémentale supervisée: un panel introductif. In: AAFD, pp 121–148
33.
Zurück zum Zitat Sarwar SS, Ankit A, Roy K (2017) Incremental learning in deep convolutional neural networks using partial network sharing. arXiv:1712.02719 Sarwar SS, Ankit A, Roy K (2017) Incremental learning in deep convolutional neural networks using partial network sharing. arXiv:1712.02719
34.
Zurück zum Zitat Schlimmer JC, Fisher D (1986) A case study of incremental concept induction. AAAI 86, pp 496–501 Schlimmer JC, Fisher D (1986) A case study of incremental concept induction. AAAI 86, pp 496–501
35.
Zurück zum Zitat Syed NA, Liu H, Sung KK (1999) Handling concept drifts in incremental learning with support vector machines. In: Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, pp 317–321 Syed NA, Liu H, Sung KK (1999) Handling concept drifts in incremental learning with support vector machines. In: Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, pp 317–321
36.
Zurück zum Zitat Toh SL, Ozawa S (2003) A face recognition system using neural networks with incremental learning ability. In: Proceedings of the 8th Australian and New Zealand Conference on intelligent information systems, Citeseer, pp 389–394 Toh SL, Ozawa S (2003) A face recognition system using neural networks with incremental learning ability. In: Proceedings of the 8th Australian and New Zealand Conference on intelligent information systems, Citeseer, pp 389–394
37.
Zurück zum Zitat Utgoff PE (1989) Incremental induction of decision trees. Mach Learn 4(2):161–186CrossRef Utgoff PE (1989) Incremental induction of decision trees. Mach Learn 4(2):161–186CrossRef
38.
Zurück zum Zitat Zhao H, Yuen PC, Kwok JT (2006) A novel incremental principal component analysis and its application for face recognition. IEEE Trans Syst Man Cybern Part B 36(4):873–886CrossRef Zhao H, Yuen PC, Kwok JT (2006) A novel incremental principal component analysis and its application for face recognition. IEEE Trans Syst Man Cybern Part B 36(4):873–886CrossRef
39.
Zurück zum Zitat Zou L, Zhang T, Cao Z (2009) An incremental learning algorithm based on Support Vector Machine for pattern recognition. In: Proceedings of the International Society for Optics and Photonics, vol 7496 Zou L, Zhang T, Cao Z (2009) An incremental learning algorithm based on Support Vector Machine for pattern recognition. In: Proceedings of the International Society for Optics and Photonics, vol 7496
40.
Zurück zum Zitat Zribi M, Boujelbene Y (2016) The neural networks with an incremental learning algorithm approach for mass classification in breast cancer. Biomed Data Min 5(118):2 Zribi M, Boujelbene Y (2016) The neural networks with an incremental learning algorithm approach for mass classification in breast cancer. Biomed Data Min 5(118):2
Metadaten
Titel
Incremental supervised learning: algorithms and applications in pattern recognition
verfasst von
Aida Chefrour
Publikationsdatum
02.02.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Evolutionary Intelligence / Ausgabe 2/2019
Print ISSN: 1864-5909
Elektronische ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-019-00203-y

Weitere Artikel der Ausgabe 2/2019

Evolutionary Intelligence 2/2019 Zur Ausgabe