Skip to main content
Erschienen in: Neural Computing and Applications 7/2011

01.10.2011 | Original Article

An incremental online semi-supervised active learning algorithm based on self-organizing incremental neural network

verfasst von: Furao Shen, Hui Yu, Keisuke Sakurai, Osamu Hasegawa

Erschienen in: Neural Computing and Applications | Ausgabe 7/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

An incremental online semi-supervised active learning algorithm, which is based on a self-organizing incremental neural network (SOINN), is proposed. This paper describes improvement of the two-layer SOINN to a single-layer SOINN to represent the topological structure of input data and to separate the generated nodes into different groups and subclusters. We then actively label some teacher nodes and use such teacher nodes to label all unlabeled nodes. The proposed method can learn from both labeled and unlabeled samples. It can query the labels of some important samples rather than selecting the labeled samples randomly. It requires neither prior knowledge, such as the number of nodes, nor the number of classes. It can automatically learn the number of nodes and teacher vectors required for a current task. Moreover, it can realize online incremental learning. Experiments using artificial data and real-world data show that the proposed method performs effectively and efficiently.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cohen I, Cozman FG, Sebe N, Cirelo MC, Huang TS (2004) Semisupervised learning of classifiers: theory, algorithms, and their application to human-computer interaction. IEEE Trans Pattern Anal Mach Intell 26(12):1553–1566CrossRef Cohen I, Cozman FG, Sebe N, Cirelo MC, Huang TS (2004) Semisupervised learning of classifiers: theory, algorithms, and their application to human-computer interaction. IEEE Trans Pattern Anal Mach Intell 26(12):1553–1566CrossRef
2.
Zurück zum Zitat Baraldi A, Bruzzone L, Blonda P (2006) A multiscale expectation-maximization semisupervised classifier suitable for badly posed image classification. IEEE Trans Image Process 15(8):2208–2225CrossRef Baraldi A, Bruzzone L, Blonda P (2006) A multiscale expectation-maximization semisupervised classifier suitable for badly posed image classification. IEEE Trans Image Process 15(8):2208–2225CrossRef
3.
Zurück zum Zitat Yeung D-Y, Chang H (2007) A kernel approach for semisupervised metric learning. IEEE Trans Neural Netw 18(1):141–149CrossRef Yeung D-Y, Chang H (2007) A kernel approach for semisupervised metric learning. IEEE Trans Neural Netw 18(1):141–149CrossRef
4.
Zurück zum Zitat Zaki SM, Yin H (2008) A semi-supersized learning algorithm for growing neural gas in face recognition. J Math Model Algorithms 7:425–435CrossRefMATH Zaki SM, Yin H (2008) A semi-supersized learning algorithm for growing neural gas in face recognition. J Math Model Algorithms 7:425–435CrossRefMATH
5.
Zurück zum Zitat Freund Y, Seung H, Shamir E, Tishby N (1997) Selective sampling using the query by committee algorithm. Mach Learn 28:133–168CrossRefMATH Freund Y, Seung H, Shamir E, Tishby N (1997) Selective sampling using the query by committee algorithm. Mach Learn 28:133–168CrossRefMATH
6.
Zurück zum Zitat Muslea I, Minston S, Knoblock C (2000) Selective sampling with redundant views. In: Proceedings of the national conference on artificial intelligence, pp 621–626 Muslea I, Minston S, Knoblock C (2000) Selective sampling with redundant views. In: Proceedings of the national conference on artificial intelligence, pp 621–626
7.
Zurück zum Zitat Kothari R, Jain V (2003) Learning from labeled and unlabeled data using a minimal number of queries. IEEE Trans Neural Netw 14(6):1496–1505CrossRef Kothari R, Jain V (2003) Learning from labeled and unlabeled data using a minimal number of queries. IEEE Trans Neural Netw 14(6):1496–1505CrossRef
8.
Zurück zum Zitat Mingkun L, Sethi IK (2006) Confidence-based active learning. IEEE Trans Pattern Anal Mach Intell 28(8):1251–1261CrossRef Mingkun L, Sethi IK (2006) Confidence-based active learning. IEEE Trans Pattern Anal Mach Intell 28(8):1251–1261CrossRef
9.
Zurück zum Zitat Muslea I, Minston S, Knoblock C (2002) Active + semi-supervised learning = robust multi-view learning. In: Proceedings of ICML-02, 19th international conference on machine learning, pp 435–442 Muslea I, Minston S, Knoblock C (2002) Active + semi-supervised learning = robust multi-view learning. In: Proceedings of ICML-02, 19th international conference on machine learning, pp 435–442
10.
Zurück zum Zitat Nigam K, McCallum AK, Thrum S, Mitchell T (2000) Text classification from labeled and unlabeled documents using em. Mach Learn 39:103–134CrossRefMATH Nigam K, McCallum AK, Thrum S, Mitchell T (2000) Text classification from labeled and unlabeled documents using em. Mach Learn 39:103–134CrossRefMATH
11.
Zurück zum Zitat Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. In: Proceedings of the conference on computational learning theory, pp 92–100 Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. In: Proceedings of the conference on computational learning theory, pp 92–100
12.
Zurück zum Zitat Bennett K, Demiriz A (1999) Semi-supervised support vector machines. Adv Neural Inf Process Syst 11:368–374 Bennett K, Demiriz A (1999) Semi-supervised support vector machines. Adv Neural Inf Process Syst 11:368–374
13.
Zurück zum Zitat Zhu X, Ghahramani Z, Lafferty J (2003) Semi-supervised learning using gaussian fields and harmonic functions. In: ICML-03, 20th international conference on machine learning, pp 912–919 Zhu X, Ghahramani Z, Lafferty J (2003) Semi-supervised learning using gaussian fields and harmonic functions. In: ICML-03, 20th international conference on machine learning, pp 912–919
14.
Zurück zum Zitat Zhu X, Lafferty J, Ghahramani Z (2003) Combining active learning and semi-supervised learning using gaussian fields and harmonic functions. In: ICML 2003 workshop on the continuum from labeled to unlabeled data in machine learning and data mining, pp 58–65 Zhu X, Lafferty J, Ghahramani Z (2003) Combining active learning and semi-supervised learning using gaussian fields and harmonic functions. In: ICML 2003 workshop on the continuum from labeled to unlabeled data in machine learning and data mining, pp 58–65
15.
Zurück zum Zitat Wang Z, Song Y, Zhang C (2009) Efficient active learning with boosting. In: SDM 2009, pp 1230–1241 Wang Z, Song Y, Zhang C (2009) Efficient active learning with boosting. In: SDM 2009, pp 1230–1241
16.
Zurück zum Zitat Huang R, Lam W (2009) An active learning framework for semi-supervised document clustering with language modeling. Data Knowl Eng 68(1):49–67CrossRef Huang R, Lam W (2009) An active learning framework for semi-supervised document clustering with language modeling. Data Knowl Eng 68(1):49–67CrossRef
17.
Zurück zum Zitat Hoi SCH, Jin R, Zhu J, Lyu MR (2009) Semi-supervised SVM batch mode active learning with applications to image retrieval. ACM Trans Inf Syst 27(3):16:1–16:29CrossRef Hoi SCH, Jin R, Zhu J, Lyu MR (2009) Semi-supervised SVM batch mode active learning with applications to image retrieval. ACM Trans Inf Syst 27(3):16:1–16:29CrossRef
18.
Zurück zum Zitat Carpenter GA, Grossberg S (1988) The art of adaptive pattern recognition by a self-organizing neural network. IEEE Comput 21:77–88 Carpenter GA, Grossberg S (1988) The art of adaptive pattern recognition by a self-organizing neural network. IEEE Comput 21:77–88
19.
Zurück zum Zitat Shen F, Hasegawa O (2006) An incremental network for on-line unsupervised classification and topology learning. Neural Netw 19:90–106CrossRefMATH Shen F, Hasegawa O (2006) An incremental network for on-line unsupervised classification and topology learning. Neural Netw 19:90–106CrossRefMATH
20.
Zurück zum Zitat Kamiya Y, Shen F, Hasegawa O (2007) An incremental neural network for online supervised learning and topology learning. J Adv Comput Intell Intell Inform 11(1):87–95 Kamiya Y, Shen F, Hasegawa O (2007) An incremental neural network for online supervised learning and topology learning. J Adv Comput Intell Intell Inform 11(1):87–95
21.
Zurück zum Zitat Shen F, Hasegawa O (2008) A fast nearest neighbor classifier based on self-organizing incremental neural network. Neural Netw 21:1537–1547CrossRef Shen F, Hasegawa O (2008) A fast nearest neighbor classifier based on self-organizing incremental neural network. Neural Netw 21:1537–1547CrossRef
22.
Zurück zum Zitat Sudo A, Sato A, Hasegawa O (2007) Associative memory for online incremental learning ina noisy environment. In: The 2007 international joint conference on neural networks Sudo A, Sato A, Hasegawa O (2007) Associative memory for online incremental learning ina noisy environment. In: The 2007 international joint conference on neural networks
23.
Zurück zum Zitat Shen F, Sudo A, Hasegawa O (2010) An online incremental learning pattern-based reasoning system. Neural Netw 23(1):135–143CrossRef Shen F, Sudo A, Hasegawa O (2010) An online incremental learning pattern-based reasoning system. Neural Netw 23(1):135–143CrossRef
24.
Zurück zum Zitat Shen F, Ogura T, Hasegawa O (2007) An enhanced self-organizing incremental neural network for online unsupervised learning. Neural Netw 20:893–903CrossRefMATH Shen F, Ogura T, Hasegawa O (2007) An enhanced self-organizing incremental neural network for online unsupervised learning. Neural Netw 20:893–903CrossRefMATH
25.
Zurück zum Zitat He X, Kojima R, Hasegawa O (2007) Developmental word grounding through a growing neural network with a humanoid robot. IEEE Trans Syst Man Cybern B 37(2):451–462CrossRef He X, Kojima R, Hasegawa O (2007) Developmental word grounding through a growing neural network with a humanoid robot. IEEE Trans Syst Man Cybern B 37(2):451–462CrossRef
26.
Zurück zum Zitat He X, Ogura T, Satou A, Hasegawa O (2007) Developmental word acquisition and grammar learning by humanoid robots through a self-organizing incremental neural network. IEEE Trans Syst Man Cybern B 37(5):1357–1372CrossRef He X, Ogura T, Satou A, Hasegawa O (2007) Developmental word acquisition and grammar learning by humanoid robots through a self-organizing incremental neural network. IEEE Trans Syst Man Cybern B 37(5):1357–1372CrossRef
27.
Zurück zum Zitat Merz C, Murphy M (1996) Uci repository of machine learning database. University of California Department of Information, Irvine Merz C, Murphy M (1996) Uci repository of machine learning database. University of California Department of Information, Irvine
29.
Zurück zum Zitat Fritzke B (1995) A growing neural gas network learns topology. In: Advances in neural information processing systems 7. MIT, Cambridge Fritzke B (1995) A growing neural gas network learns topology. In: Advances in neural information processing systems 7. MIT, Cambridge
Metadaten
Titel
An incremental online semi-supervised active learning algorithm based on self-organizing incremental neural network
verfasst von
Furao Shen
Hui Yu
Keisuke Sakurai
Osamu Hasegawa
Publikationsdatum
01.10.2011
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 7/2011
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-010-0428-y

Weitere Artikel der Ausgabe 7/2011

Neural Computing and Applications 7/2011 Zur Ausgabe

Premium Partner