nach oben

Soft Computing

Erschienen in:

01.09.2012 | Focus

A study on random weights between input and hidden layers in extreme learning machine

verfasst von: Ran Wang, Sam Kwong, Xizhao Wang

Erschienen in: Soft Computing | Ausgabe 9/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Extreme learning machine (ELM), as an emergent technique for training feed-forward neural networks, has shown good performances on various learning domains. This paper investigates the impact of random weights during the training of ELM. It focuses on the randomness of weights between input and hidden layers, and the dimension change from input layer to hidden layer. The direct motivation is to verify as to whether during the training of ELM, the randomly assigned weights exert some positive effects. Experimentally we show that for many classification and regression problems, the dimension increase caused by random weights in ELM has a performance better than the dimension increase caused by some kernel mappings. We assume that via the random transformation, output-samples are more concentrate than input-samples which will make the learning more efficient.

Vorheriger Artikel Editorial

Nächster Artikel Variable activation function extreme learning machine based on residual prediction compensation

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Nur mit Berechtigung zugänglich

Chacko B, Vimal Krishnan V, Raju G, Babu Anto P (2011) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern. doi:10.1007/s13042-011-0049-5

Chen C, Zhang J, He X, Zhou Z (2011) Non-parametric kernel leanring with robust pairwise constraints. Int J Mach Learn Cybern. doi:10.1007/s13042-011-0048-6

Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetMATH

Feng G, Huang G, Lin Q, Gay R (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. Neural Netw IEEE Transact 20(8):1352–1357CrossRef

Haykin S (1999) Neural networks: a comprehensive foundation. Prentice hall, New Jersey

Huang G, Chen L (2007) Convex incremental extreme learning machine. Neurocomputing 70(16–18):3056–3062CrossRef

Huang G, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71(16):3460–3468CrossRef

Huang G, Chen L, Siew C (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. Neural Netw IEEE Transact 17(4):879–892CrossRef

Huang G-B, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74(1-3):155–163CrossRef

Huang G, Siew C (2004) Extreme learning machine: Rbf network case. In: Eighth IEEE Control, Automation, Robotics and Vision Conference (ICARCV 2004), vol 2, pp 1029–1036

Huang G, Wang D, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef

Huang G, Zhou H, Ding X, Zhang R (2010) Extreme learning machine for regression and multiclass classification. Syst Man Cybern Part B Cybern IEEE Transact 99:1–17

Huang G, Zhu Q, Siew C (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of IEEE International Joint Conference on Neural Networks. vol 2, pp 985–990

Huang G, Zhu Q, Siew C (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef

Jun W, Shitong W, Chung F (2011) Positive and negative fuzzy rule system, extreme learning machine and image classification. Int J Mach Learn Cybern 2(4):261–271CrossRef

Li M, Huang G, Saratchandran P, Sundararajan N (2005) Fully complex extreme learning machine. Neurocomputing 68:306–314CrossRef

Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A (2010) Op-elm: optimally pruned extreme learning machine. Neural Netw IEEE Transact 21(1):158–162CrossRef

Michell T (1997) Machine learning. McGrawHill, USA

Nigrin A (1993) Neural networks for pattern recognition. The MIT press, Cambridge

Rong H, Huang G, Sundararajan N, Saratchandran P (2009) Online sequential fuzzy extreme learning machine for function approximation and classification problems. Syst Man Cybern Part B Cybern IEEE Transact 39(4):1067–1072CrossRef

Rumelhart D, Hintont G, Williams R (1986) Learning representations by back-propagating errors. Nature 323(6088):533–536CrossRef

Schölkopf B, Smola A (2002) Learning with kernels. The MIT Press, Cambridge

Tang X, Han M (2009) Partial lanczos extreme learning machine for single-output regression problems. Neurocomputing 72(13):3066–3076CrossRef

Vapnik V (2000) The nature of statistical learning theory. Springer, Berlin

Wang D, Huang G (2005) Protein sequence classification using extreme learning machine. In: Proceedings of IEEE International Joint Conference on Neural Networks (IJCNN’05). vol 3, pp 1406–1411

Wang W, Chen A, Feng H (2011) Upper integral network with extreme learning mechanism. Neurocomputing 74(16):2520–2525CrossRef

Zhu Q, Qin A, Suganthan P, Huang G (2005) Evolutionary extreme learning machine. Pattern Recognit 38(10):1759–1763MATHCrossRef

Titel: A study on random weights between input and hidden layers in extreme learning machine
verfasst von: Ran Wang
Sam Kwong
Xizhao Wang
Publikationsdatum: 01.09.2012
Verlag: Springer-Verlag
Erschienen in: Soft Computing / Ausgabe 9/2012
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI: https://doi.org/10.1007/s00500-012-0829-1

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 9/2012

Generalized extreme learning machine acting on a metric space

Computational localization of transcription factor binding sites using extreme learning machines

Editorial

Face recognition with lattice independent component analysis and extreme learning machines

Dynamic ensemble extreme learning machine based on sample entropy

Face recognition via local preserving average neighborhood margin maximization and extreme learning machine