Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 2/2017

21.03.2015 | Original Article

Unsupervised extreme learning machine with representational features

verfasst von: Shifei Ding, Nan Zhang, Jian Zhang, Xinzheng Xu, Zhongzhi Shi

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Extreme learning machine (ELM) is not only an effective classifier but also a useful cluster. Unsupervised extreme learning machine (US-ELM) gives favorable performance compared to state-of-the-art clustering algorithms. Extreme learning machine as an auto encoder (ELM-AE) can obtain principal components which represent original samples. The proposed unsupervised extreme learning machine based on embedded features of ELM-AE (US-EF-ELM) algorithm applies ELM-AE to US-ELM. US-EF-ELM regards embedded features of ELM-AE as the outputs of US-ELM hidden layer, and uses US-ELM to obtain the embedded matrix of US-ELM. US-EF-ELM can handle the multi-cluster clustering. The learning capability and computational efficiency of US-EF-ELM are as same as US-ELM. By experiments on UCI data sets, we compared US-EF-ELM k-means algorithm with k-means algorithm, spectral clustering algorithm, and US-ELM k-means algorithm in accuracy and efficiency.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of the international joint conference on neural networks (IJCNN’2004). IEEE Press, Budapest, pp 25–29 Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of the international joint conference on neural networks (IJCNN’2004). IEEE Press, Budapest, pp 25–29
2.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501CrossRef Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501CrossRef
3.
Zurück zum Zitat Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef
4.
Zurück zum Zitat Cambria E, Huang GB, Kasun LLC, Zhou HM, Vong CM, Lin J, Yin JP, Cai ZP, Liu Q, Li K, Leung VCM, Feng L, Ong YS, Lim MH, Akusok A, Lendasse A, Corona F, Nian R, Miche Y, Gastaldo P, Zunino R, Decherchi S, Yang XF, Mao KZ, Oh BS, Jeon J, Toh KA, Beng A, Teoh J, Kim J, Yu HC, Chen YQ, Liu JF (2013) Extreme learning machines [trends & controversies]. IEEE Intell Syst 28(6):30–59CrossRef Cambria E, Huang GB, Kasun LLC, Zhou HM, Vong CM, Lin J, Yin JP, Cai ZP, Liu Q, Li K, Leung VCM, Feng L, Ong YS, Lim MH, Akusok A, Lendasse A, Corona F, Nian R, Miche Y, Gastaldo P, Zunino R, Decherchi S, Yang XF, Mao KZ, Oh BS, Jeon J, Toh KA, Beng A, Teoh J, Kim J, Yu HC, Chen YQ, Liu JF (2013) Extreme learning machines [trends & controversies]. IEEE Intell Syst 28(6):30–59CrossRef
5.
Zurück zum Zitat Huang GB (2014) An Insight into extreme learning machines: random neurons, random features and kernels. Cogn Comput 6(3):376–390MathSciNetCrossRef Huang GB (2014) An Insight into extreme learning machines: random neurons, random features and kernels. Cogn Comput 6(3):376–390MathSciNetCrossRef
6.
Zurück zum Zitat Ding SF, Xu XZ, Nie R (2014) Extreme learning machine and its applications. Neural Comput Appl 25(3):549–556CrossRef Ding SF, Xu XZ, Nie R (2014) Extreme learning machine and its applications. Neural Comput Appl 25(3):549–556CrossRef
7.
Zurück zum Zitat Deng WY, Zheng QH, Chen L, Xu XB (2010) Research on extreme learning of neural networks. Chin J Comput 33(2):279–287MathSciNetCrossRef Deng WY, Zheng QH, Chen L, Xu XB (2010) Research on extreme learning of neural networks. Chin J Comput 33(2):279–287MathSciNetCrossRef
8.
Zurück zum Zitat Zong WW, Huang GB, Chen YQ (2013) Weighted extreme learning machine for imbalance learning. Neurocomputing 101:229–242CrossRef Zong WW, Huang GB, Chen YQ (2013) Weighted extreme learning machine for imbalance learning. Neurocomputing 101:229–242CrossRef
10.
Zurück zum Zitat Chen H, Peng JT, Zhou YC, Li LQ, Pan ZB (2014) Extreme learning machine for ranking: generalization analysis and applications. Neural Networks 53:119–126CrossRefMATH Chen H, Peng JT, Zhou YC, Li LQ, Pan ZB (2014) Extreme learning machine for ranking: generalization analysis and applications. Neural Networks 53:119–126CrossRefMATH
11.
Zurück zum Zitat Lin SB, Liu X, Fang J, Xu ZB (2015) Is extreme learning machine feasible? A theoretical assessment (part II). IEEE Trans Neural Networks Learn Syst 26(1):21–34MathSciNetCrossRef Lin SB, Liu X, Fang J, Xu ZB (2015) Is extreme learning machine feasible? A theoretical assessment (part II). IEEE Trans Neural Networks Learn Syst 26(1):21–34MathSciNetCrossRef
12.
Zurück zum Zitat He Q, Jin X, Du CY, Zhuang FZ, Shi ZZ (2014) Clustering in extreme learning machine feature space. Neurocomputing 128:88–95CrossRef He Q, Jin X, Du CY, Zhuang FZ, Shi ZZ (2014) Clustering in extreme learning machine feature space. Neurocomputing 128:88–95CrossRef
13.
Zurück zum Zitat Huang G, Song SJ, Gupta JND, Wu C (2014) Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern 44(12):2405–2417CrossRef Huang G, Song SJ, Gupta JND, Wu C (2014) Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern 44(12):2405–2417CrossRef
16.
Zurück zum Zitat Zhang L, Zhang XH, Yang JW, Wang XQ, Li FZ (2012) Cascaded cluster ensembles. Int J Mach Learn Cybern 3(4):335–343CrossRef Zhang L, Zhang XH, Yang JW, Wang XQ, Li FZ (2012) Cascaded cluster ensembles. Int J Mach Learn Cybern 3(4):335–343CrossRef
17.
Zurück zum Zitat Ester M, Kriegel HP, Sander J, Xu X (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of 2nd international conference on KDD. AAAI Press, Menlo Park, pp 226–231 Ester M, Kriegel HP, Sander J, Xu X (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of 2nd international conference on KDD. AAAI Press, Menlo Park, pp 226–231
18.
Zurück zum Zitat Xu X (2013) Enhancing gene expression clustering analysis using tangent transformation. Int J Mach Learn Cybern 4(1):75–83CrossRef Xu X (2013) Enhancing gene expression clustering analysis using tangent transformation. Int J Mach Learn Cybern 4(1):75–83CrossRef
20.
Zurück zum Zitat Liu N, Chen F, Lu MY (2013) Spectral co-clustering documents and words using fuzzy K-harmonic means. Int J Mach Learn Cybern 4(1):31–40CrossRef Liu N, Chen F, Lu MY (2013) Spectral co-clustering documents and words using fuzzy K-harmonic means. Int J Mach Learn Cybern 4(1):31–40CrossRef
21.
Zurück zum Zitat Kasun LLC, Zhou HM, Huang GB, Vong CM (2013) Representational learning with extreme learning machine for big data. IEEE Intell Syst 28(6):31–34 Kasun LLC, Zhou HM, Huang GB, Vong CM (2013) Representational learning with extreme learning machine for big data. IEEE Intell Syst 28(6):31–34
22.
Zurück zum Zitat Ding SF, Jia HJ, Shi ZZ (2014) Spectral clustering algorithm based on adaptive Nyström sampling for big data analysis. J Softw 25(9):2037–2049MATH Ding SF, Jia HJ, Shi ZZ (2014) Spectral clustering algorithm based on adaptive Nyström sampling for big data analysis. J Softw 25(9):2037–2049MATH
23.
Zurück zum Zitat Papadimitriou CH, Steiglitz K (1998) Combinatorial optimization: algorithms and complexity. Courier Dover Publications, MineolaMATH Papadimitriou CH, Steiglitz K (1998) Combinatorial optimization: algorithms and complexity. Courier Dover Publications, MineolaMATH
Metadaten
Titel
Unsupervised extreme learning machine with representational features
verfasst von
Shifei Ding
Nan Zhang
Jian Zhang
Xinzheng Xu
Zhongzhi Shi
Publikationsdatum
21.03.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 2/2017
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-015-0351-8

Weitere Artikel der Ausgabe 2/2017

International Journal of Machine Learning and Cybernetics 2/2017 Zur Ausgabe