Skip to main content
Erschienen in: Neural Computing and Applications 9/2019

19.07.2018 | S.I. : Emergence in Human-like Intelligence towards Cyber-Physical Systems

A new method of online extreme learning machine based on hybrid kernel function

verfasst von: Senyue Zhang, Wenan Tan, Qingjun Wang, Nan Wang

Erschienen in: Neural Computing and Applications | Ausgabe 9/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Computational complexity and sample selection are two main factors that limited the performance of online sequential extreme learning machines (OS-ELMs). This paper proposes a new model that introduces the concept of hybrid kernel and sample selection method based on an online learning model using a membership function. In other words, an online sequential extreme learning machine based on a hybrid kernel function (HKOS-ELM) is presented. The algorithm only calculates the kernel function to determine the final output function, mostly solving the computational complexity of the algorithm. The hybrid kernel function proposed in this paper has the advantages of strong learning ability and good generalization performance of single kernel function. Based on the classification essence of the OS-ELM classification, the membership function is introduced into the sample selection to remove the noise point and the outlier point. The experimental results showed that the HKOS-ELM algorithm adding the membership degree with mixed kernel functions preserves the advantages of kernel functions and online learning and improves the classification performance of the system.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural network. In: Proceedings of international joint conference on neural networks (IJCNN’04), 2004, pp 985–501 Huang GB, Zhu QY, Siew CK (2004) Extreme learning machine: a new learning scheme of feedforward neural network. In: Proceedings of international joint conference on neural networks (IJCNN’04), 2004, pp 985–501
2.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neural Comput 70:489–501 Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neural Comput 70:489–501
3.
Zurück zum Zitat Liang NY, Huang GB (2006) A fast accurate online sequential learning algorithm for feed forward networks. IEEE Trans Neural Netw 17:1411–1423CrossRef Liang NY, Huang GB (2006) A fast accurate online sequential learning algorithm for feed forward networks. IEEE Trans Neural Netw 17:1411–1423CrossRef
4.
Zurück zum Zitat Le Y, Lei Y (2013) Online sequence ELM model based on the kernel function. Basic Sci J Text Univ 26(4):516–520 Le Y, Lei Y (2013) Online sequence ELM model based on the kernel function. Basic Sci J Text Univ 26(4):516–520
5.
Zurück zum Zitat Zhang G, Xie XS, Huang Y, Wang C (2014) An online multi-kernel learning algorithm for big data. CAAI Trans Intell Syst 9(3):355–363 Zhang G, Xie XS, Huang Y, Wang C (2014) An online multi-kernel learning algorithm for big data. CAAI Trans Intell Syst 9(3):355–363
6.
Zurück zum Zitat Wang JG, Wu LM, Zhang WX, Jiang X (2014) Online support vector machine based on hybrid kernel function and its application in methanol synthesis. Mach Des Manuf (8):217–219 Wang JG, Wu LM, Zhang WX, Jiang X (2014) Online support vector machine based on hybrid kernel function and its application in methanol synthesis. Mach Des Manuf (8):217–219
7.
Zurück zum Zitat Simone S, Danilo C, Michele S, Aurelio U (2015) Online sequential extreme learning machine with kernels. IEEE Trans Neural Netw Learn Syst 26(9):2214–2220MathSciNetCrossRef Simone S, Danilo C, Michele S, Aurelio U (2015) Online sequential extreme learning machine with kernels. IEEE Trans Neural Netw Learn Syst 26(9):2214–2220MathSciNetCrossRef
9.
Zurück zum Zitat Chao MA, Zhang YT, Li ZN, Yin G (2014) Hydraulic pump characteristic parameters online prediction based on kernel extreme learning machine. Comput Simul 31(5):351–354 Chao MA, Zhang YT, Li ZN, Yin G (2014) Hydraulic pump characteristic parameters online prediction based on kernel extreme learning machine. Comput Simul 31(5):351–354
10.
Zurück zum Zitat Ding SF, Zhang YN, Xu XZ, Bao L (2013) A novel extreme learning machine based on hybrid kernel function. JCP 8(8):2110–2116 Ding SF, Zhang YN, Xu XZ, Bao L (2013) A novel extreme learning machine based on hybrid kernel function. JCP 8(8):2110–2116
11.
Zurück zum Zitat Mo YB, Xu SH (2010) Application of SVM based on hybrid kernel function in heart disease diagnoses. In: 2010 International conference on intelligent computing and cognitive informatics Mo YB, Xu SH (2010) Application of SVM based on hybrid kernel function in heart disease diagnoses. In: 2010 International conference on intelligent computing and cognitive informatics
12.
Zurück zum Zitat Cai DL, Guo H (2014) Protein-protein interaction prediction method based on SVM with hybrid kernel function. J Fuzhou Univ (Nat Sci Edn) 42(6):006 Cai DL, Guo H (2014) Protein-protein interaction prediction method based on SVM with hybrid kernel function. J Fuzhou Univ (Nat Sci Edn) 42(6):006
13.
Zurück zum Zitat Liu CW, Luo JX (2014) A PSO-SVM classifier bases on hybrid kernel function. J East China Univ Sci Technol (Nat Sci Edn) 40(1):96–101 Liu CW, Luo JX (2014) A PSO-SVM classifier bases on hybrid kernel function. J East China Univ Sci Technol (Nat Sci Edn) 40(1):96–101
14.
Zurück zum Zitat Song W, Yi T, Xin Z, Xin Z (2014) The research on hybrid kernel function facing vehicle driving pattern recognition. In: Proceedings of 2014 international conference on industrial engineering and information technology Song W, Yi T, Xin Z, Xin Z (2014) The research on hybrid kernel function facing vehicle driving pattern recognition. In: Proceedings of 2014 international conference on industrial engineering and information technology
15.
Zurück zum Zitat Liu M, Zhou SS, Wu H (2009) SHM based on new hybrid kernel function. J Comput Appl 29(S2):167–168+206 Liu M, Zhou SS, Wu H (2009) SHM based on new hybrid kernel function. J Comput Appl 29(S2):167–168+206
16.
Zurück zum Zitat Tang Q, Wang HR, Xu XY, Wang C (2014) Hydrological time series model based on SVM with hybrid kernel function and its application. Syst Eng Theory Pract 34(2):521–529 Tang Q, Wang HR, Xu XY, Wang C (2014) Hydrological time series model based on SVM with hybrid kernel function and its application. Syst Eng Theory Pract 34(2):521–529
17.
Zurück zum Zitat Yan GT, Ma GF, Xiao YZ (2007) Support vector machines based on hybrid kernel function. J Harbin Inst Technol 39(11):1704–1706MathSciNetMATH Yan GT, Ma GF, Xiao YZ (2007) Support vector machines based on hybrid kernel function. J Harbin Inst Technol 39(11):1704–1706MathSciNetMATH
18.
Zurück zum Zitat Wei JR (2015) A reevaluation of hybrid kernel function for support vector machine. Stat Res 32(2):90–96 Wei JR (2015) A reevaluation of hybrid kernel function for support vector machine. Stat Res 32(2):90–96
19.
Zurück zum Zitat Qing M (2013) Instance selection research based on ELM and PNN. Hebei University, Hebei, p 6 Qing M (2013) Instance selection research based on ELM and PNN. Hebei University, Hebei, p 6
20.
Zurück zum Zitat Mo C (2014) Network traffic prediction model based on selecting training samples with reasonable forgetting. Comput Appl Softw 31(10):120–123 Mo C (2014) Network traffic prediction model based on selecting training samples with reasonable forgetting. Comput Appl Softw 31(10):120–123
21.
Zurück zum Zitat Du ZL, Li XM, Zheng ZG, Zhang GR, Mao Q (2015) Extreme learning machine based on regularization and forgetting factor and its application in fault prediction. Chin J Sci Instrum 36(7):1546–1553 Du ZL, Li XM, Zheng ZG, Zhang GR, Mao Q (2015) Extreme learning machine based on regularization and forgetting factor and its application in fault prediction. Chin J Sci Instrum 36(7):1546–1553
22.
Zurück zum Zitat Zhang X, Wang H-L (2011) Selective forgetting extreme learning machine and its application to time series prediction. Acta Phys Sin 60(8):080504MathSciNet Zhang X, Wang H-L (2011) Selective forgetting extreme learning machine and its application to time series prediction. Acta Phys Sin 60(8):080504MathSciNet
23.
Zurück zum Zitat Zhang Y, Zhu X, Luo Y (2014) An SVM Algorithm for overcoming the influence of muscle fatigue in sEMG based human machine interaction. Control Eng China 21(4):96–101 Zhang Y, Zhu X, Luo Y (2014) An SVM Algorithm for overcoming the influence of muscle fatigue in sEMG based human machine interaction. Control Eng China 21(4):96–101
24.
Zurück zum Zitat Wu C-M, Wang X-D, Bai D-Y, Zhang H-D (2010) Fast SVM incremental learning algorithm using KKT conditions and between-class convex hull vectors. Comput Eng Des 31(8):1792–1798 Wu C-M, Wang X-D, Bai D-Y, Zhang H-D (2010) Fast SVM incremental learning algorithm using KKT conditions and between-class convex hull vectors. Comput Eng Des 31(8):1792–1798
25.
Zurück zum Zitat Xiao ZC, Wang J, Wang Y-S (2010) Predict the time series of the parameter-varying chaotic system based on recursive lease square support vector machine (RLS-SVM). Aeronaut Comput Tech 40(3):30–37 Xiao ZC, Wang J, Wang Y-S (2010) Predict the time series of the parameter-varying chaotic system based on recursive lease square support vector machine (RLS-SVM). Aeronaut Comput Tech 40(3):30–37
26.
Zurück zum Zitat Lu YL, Li L, Zhou MM, Tian G-L (2009) A new fuzzy support vector machine based on hybrid kernel function. In: Proceedings of the eighth international conference on machine learning and cybernetics, Baoding, 12–15 July 2009 Lu YL, Li L, Zhou MM, Tian G-L (2009) A new fuzzy support vector machine based on hybrid kernel function. In: Proceedings of the eighth international conference on machine learning and cybernetics, Baoding, 12–15 July 2009
27.
Zurück zum Zitat Rong HJ, Huang GB (2009) Online sequential fuzzy extreme learning machine for function approximation and classification problems. IEEE Trans Syst Man Cybern Part B Cybern 39(4):1067–1072CrossRef Rong HJ, Huang GB (2009) Online sequential fuzzy extreme learning machine for function approximation and classification problems. IEEE Trans Syst Man Cybern Part B Cybern 39(4):1067–1072CrossRef
28.
Zurück zum Zitat Dhillon IS, Modha DS (2001) Concept decomposition for large sparse text data using clustering. Mach Learn 42(1):143–175MATHCrossRef Dhillon IS, Modha DS (2001) Concept decomposition for large sparse text data using clustering. Mach Learn 42(1):143–175MATHCrossRef
29.
Zurück zum Zitat Chiang JH, Hao PY (2003) A new kernel-based fuzzy clustering approach: support vector clustering with cell growing. IEEE Trans Fuzzy Syst 11(4):518–527CrossRef Chiang JH, Hao PY (2003) A new kernel-based fuzzy clustering approach: support vector clustering with cell growing. IEEE Trans Fuzzy Syst 11(4):518–527CrossRef
30.
Zurück zum Zitat Zhao K, Li L, Deng N (2012) A new method to construct fuzzy membership. Comput Technol Dev 22(8):75–77 Zhao K, Li L, Deng N (2012) A new method to construct fuzzy membership. Comput Technol Dev 22(8):75–77
31.
Zurück zum Zitat Lin CF, Wang SD (2002) Fuzzy support vector machines. IEEE Trans Neural Netw 13(2):464–471CrossRef Lin CF, Wang SD (2002) Fuzzy support vector machines. IEEE Trans Neural Netw 13(2):464–471CrossRef
32.
Zurück zum Zitat Liu SY, Du Z (2007) An improved fuzzy support vector machine method. CAAI Trans Intell Syst 2(3):30–33 Liu SY, Du Z (2007) An improved fuzzy support vector machine method. CAAI Trans Intell Syst 2(3):30–33
33.
Zurück zum Zitat Ye Y, Squartini S, Piazza F (2012) Online sequential extreme learning machine in no stationary environments. Neurocomputing 116:94–101CrossRef Ye Y, Squartini S, Piazza F (2012) Online sequential extreme learning machine in no stationary environments. Neurocomputing 116:94–101CrossRef
34.
Zurück zum Zitat Zhang S, Liu J, Tian J-W (2004) An SVM-based small target segmentation and clustering approach. In: Proceedings of the third international conference on machine learning and cybernetics. IEEE, Shanghai, pp 3318–3323 Zhang S, Liu J, Tian J-W (2004) An SVM-based small target segmentation and clustering approach. In: Proceedings of the third international conference on machine learning and cybernetics. IEEE, Shanghai, pp 3318–3323
35.
Zurück zum Zitat Wille R (1982) Restructuring lattice theory: an approach based on hierarchies of concepts. In: Rival I (ed) Ordered Sets. Reidel, Dordrecht, pp 445–470CrossRef Wille R (1982) Restructuring lattice theory: an approach based on hierarchies of concepts. In: Rival I (ed) Ordered Sets. Reidel, Dordrecht, pp 445–470CrossRef
36.
Zurück zum Zitat Christopher B (2007) Pattern recognition and machine learning. Springer, New York Christopher B (2007) Pattern recognition and machine learning. Springer, New York
37.
Zurück zum Zitat Du Z (2009) Research on some variants of support vector machine. Xi Dian University, Xi’an Du Z (2009) Research on some variants of support vector machine. Xi Dian University, Xi’an
Metadaten
Titel
A new method of online extreme learning machine based on hybrid kernel function
verfasst von
Senyue Zhang
Wenan Tan
Qingjun Wang
Nan Wang
Publikationsdatum
19.07.2018
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 9/2019
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-3629-4

Weitere Artikel der Ausgabe 9/2019

Neural Computing and Applications 9/2019 Zur Ausgabe

S.I. : Emergence in Human-like Intelligence towards Cyber-Physical Systems

Open-circuit fault detection for three-phase inverter based on backpropagation neural network

S.I. : Emergence in Human-like Intelligence towards Cyber-Physical Systems

Research on partial fingerprint recognition algorithm based on deep learning