Skip to main content
Top
Published in: Natural Computing 1/2021

27-02-2019

Adaptive CCR-ELM with variable-length brain storm optimization algorithm for class-imbalance learning

Authors: Jian Cheng, Jingjing Chen, Yi-nan Guo, Shi Cheng, Linkai Yang, Pei Zhang

Published in: Natural Computing | Issue 1/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Class-specific cost regulation extreme learning machine (CCR-ELM) can effectively deal with the class imbalance problems. However, its key parameters, including the number of hidden nodes, the input weights, the biases and the tradeoff factors are normally generated randomly or preset by human. Moreover, the number of input weights and biases depend on the size of hidden layer. Inappropriate quantity of hidden nodes may lead to the useless or redundant neuron nodes, and make the whole structure complex, even cause the worse generalization and unstable classification performances. Based on this, an adaptive CCR-ELM with variable-length brain storm optimization algorithm is proposed for the class imbalance learning. Each individual consists of all above parameters of CCR-ELM and its length varies with the number of hidden nodes. A novel mergence operator is presented to incorporate two parent individuals with different length and generate a new individual. The experimental results for nine imbalance datasets show that variable-length brain storm optimization algorithm can find better parameters of CCR-ELM, resulting in the better classification accuracy than other evolutionary optimization algorithms, such as GA, PSO, and VPSO. In addition, the classification performance of the proposed adaptive algorithm is relatively stable under varied imbalance ratios. Applying the proposed algorithm in the fault diagnosis of conveyor belt also proves that ACCR-ELM with VLen-BSO has the better classification performances.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Cheng S, Qin QD, Chen JF et al (2014) Maintaining population diversity in brain storm optimization algorithm. Proc IEEE Congr Evolut Comput 4(3):3230–3237 Cheng S, Qin QD, Chen JF et al (2014) Maintaining population diversity in brain storm optimization algorithm. Proc IEEE Congr Evolut Comput 4(3):3230–3237
go back to reference Cheng S, Qin QD, Chen JF et al (2015) Brain storm optimization algorithm: a review. Artif Intell Rev 6728:1–14 Cheng S, Qin QD, Chen JF et al (2015) Brain storm optimization algorithm: a review. Artif Intell Rev 6728:1–14
go back to reference Ertam F, Avci E (2017) A new approach for internet traffic classification: GA-WK-ELM. Measurement 95:135–142CrossRef Ertam F, Avci E (2017) A new approach for internet traffic classification: GA-WK-ELM. Measurement 95:135–142CrossRef
go back to reference Gao M, Hong X, Chen S et al (2011) A combined smote and PSO based RBF classifier for two-class imbalanced problems. Neurocomputing 74(17):3456–3466CrossRef Gao M, Hong X, Chen S et al (2011) A combined smote and PSO based RBF classifier for two-class imbalanced problems. Neurocomputing 74(17):3456–3466CrossRef
go back to reference Guo XP, Wu YL, Xie LX et al (2015) An adaptive brain storm optimization algorithm for multiobjective optimization problems. Lect Notes Comput Sci 9140(4):365–372CrossRef Guo XP, Wu YL, Xie LX et al (2015) An adaptive brain storm optimization algorithm for multiobjective optimization problems. Lect Notes Comput Sci 9140(4):365–372CrossRef
go back to reference Guo YN, Zhen Y, Wang C et al (2016) Cultural particle swarm optimization algorithms for uncertain multi-objective problems with interval parameters. Nat Comput 16(4):1–22MathSciNet Guo YN, Zhen Y, Wang C et al (2016) Cultural particle swarm optimization algorithms for uncertain multi-objective problems with interval parameters. Nat Comput 16(4):1–22MathSciNet
go back to reference Guo YN, Zhang P, Cheng J et al (2017) An improved weighted ELM with krill herd algorithm for imbalanced learning. In: Advances in swarm intelligence Springer, pp 371–378 Guo YN, Zhang P, Cheng J et al (2017) An improved weighted ELM with krill herd algorithm for imbalanced learning. In: Advances in swarm intelligence Springer, pp 371–378
go back to reference Guo YN, Cheng J, Luo S, Gong DW, Xue Y (2018) Robust dynamic multi-objective vehicle routing optimization method. IEEE/ACM Trans Comput Biol Bioinform 15(6):1891–1903CrossRef Guo YN, Cheng J, Luo S, Gong DW, Xue Y (2018) Robust dynamic multi-objective vehicle routing optimization method. IEEE/ACM Trans Comput Biol Bioinform 15(6):1891–1903CrossRef
go back to reference Han F, Yao HF, Ling QH (2013) An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 116:87–93CrossRef Han F, Yao HF, Ling QH (2013) An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 116:87–93CrossRef
go back to reference He HB, Ma YQ (2013) Imbalanced learning: foundations, algorithms, and applications. Wiley, New YorkCrossRef He HB, Ma YQ (2013) Imbalanced learning: foundations, algorithms, and applications. Wiley, New YorkCrossRef
go back to reference Huang GB, Zhu QY, and Siew CK (2005) Extreme learning machine: a new learning scheme of feed forward neural networks. In: IEEE international joint conference on neural networks, vol 2, pp 985–990 Huang GB, Zhu QY, and Siew CK (2005) Extreme learning machine: a new learning scheme of feed forward neural networks. In: IEEE international joint conference on neural networks, vol 2, pp 985–990
go back to reference Huang GB, Zhou HM, Ding XJ et al (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B 42(2):513–529CrossRef Huang GB, Zhou HM, Ding XJ et al (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B 42(2):513–529CrossRef
go back to reference Huang GB, Song SJ, Gupta JND et al (2014) Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern 44(12):2405–2417CrossRef Huang GB, Song SJ, Gupta JND et al (2014) Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern 44(12):2405–2417CrossRef
go back to reference Li QJ, Mao YB (2014) A review of boosting methods for imbalanced data classification. Pattern Anal Appl 17(4):679–693MathSciNetCrossRef Li QJ, Mao YB (2014) A review of boosting methods for imbalanced data classification. Pattern Anal Appl 17(4):679–693MathSciNetCrossRef
go back to reference Li D, Zhang W (2014) Stock price prediction based on ELM and FOA. Comput Eng Appl 50(18):14–18 Li D, Zhang W (2014) Stock price prediction based on ELM and FOA. Comput Eng Appl 50(18):14–18
go back to reference Liu XY, Wu JX, Zhou ZH (2009) Exploratory undersampling for class-imbalance learning. IEEE Trans Syst Man Cybern Part B 39(2):539–550CrossRef Liu XY, Wu JX, Zhou ZH (2009) Exploratory undersampling for class-imbalance learning. IEEE Trans Syst Man Cybern Part B 39(2):539–550CrossRef
go back to reference Mirza B, Lin ZP, Toh KA (2013) Weighted online sequential extreme learning machine for class imbalance learning. Neural Process Lett 38(3):465–486CrossRef Mirza B, Lin ZP, Toh KA (2013) Weighted online sequential extreme learning machine for class imbalance learning. Neural Process Lett 38(3):465–486CrossRef
go back to reference Mirza B, Lin ZP, Liu N (2015) Ensemble of subset online sequential extreme learning machine for class imbalance and concept drift. Neurocomputing 149(Part A):316–329CrossRef Mirza B, Lin ZP, Liu N (2015) Ensemble of subset online sequential extreme learning machine for class imbalance and concept drift. Neurocomputing 149(Part A):316–329CrossRef
go back to reference Nitesh VC, Bowyer KW, Lawrence OH et al (2002) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16(1):321–357MATH Nitesh VC, Bowyer KW, Lawrence OH et al (2002) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16(1):321–357MATH
go back to reference Ramentol E (2012) SMOTE-RS: a hybrid preprocessing approach based on oversampling and undersampling for high imbalanced data-sets using smote and rough sets theory. Knowl Inf Syst 33(2):245–265CrossRef Ramentol E (2012) SMOTE-RS: a hybrid preprocessing approach based on oversampling and undersampling for high imbalanced data-sets using smote and rough sets theory. Knowl Inf Syst 33(2):245–265CrossRef
go back to reference Rong HJ, Huang GB, Narasimhan S et al (2009) Online sequential fuzzy extreme learning machine for function approximation and classification problems. IEEE Trans Syst Man Cybern Part B 39(4):1067CrossRef Rong HJ, Huang GB, Narasimhan S et al (2009) Online sequential fuzzy extreme learning machine for function approximation and classification problems. IEEE Trans Syst Man Cybern Part B 39(4):1067CrossRef
go back to reference Shen F, Liu J, Wu P (2018) Double complete D-LBP with extreme learning machine auto-encoder and cascade forest for facial expression analysis. In: 25th IEEE international conference on image processing (ICIP), pp 1947–1951 Shen F, Liu J, Wu P (2018) Double complete D-LBP with extreme learning machine auto-encoder and cascade forest for facial expression analysis. In: 25th IEEE international conference on image processing (ICIP), pp 1947–1951
go back to reference Wang B, Sun YN, Xue B et al (2018) Evolving deep convolutional neural networks by variable-length particle swarm optimization for image classification. In: IEEE congress on evolutionary computation Wang B, Sun YN, Xue B et al (2018) Evolving deep convolutional neural networks by variable-length particle swarm optimization for image classification. In: IEEE congress on evolutionary computation
go back to reference Wu G, Chang EY (2005) KBA: kernel boundary alignment considering imbalanced data distribution. IEEE Trans Knowl Data Eng 17(6):786–795CrossRef Wu G, Chang EY (2005) KBA: kernel boundary alignment considering imbalanced data distribution. IEEE Trans Knowl Data Eng 17(6):786–795CrossRef
go back to reference Wu DH, Wang ZL, Ye C et al (2016) Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset. Neurocomputing 190:35–49CrossRef Wu DH, Wang ZL, Ye C et al (2016) Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset. Neurocomputing 190:35–49CrossRef
go back to reference Xiao WD, Zhang J, Li Y et al (2017) Class-specific cost regulation extreme learning machine for imbalanced classification. Neurocomputing 261:70–82CrossRef Xiao WD, Zhang J, Li Y et al (2017) Class-specific cost regulation extreme learning machine for imbalanced classification. Neurocomputing 261:70–82CrossRef
go back to reference Yang LX, Yang SY, Li SJ et al (2017) Incremental laplacian regularization extreme learning machine for online learning. Appl Soft Comput 59:546–555CrossRef Yang LX, Yang SY, Li SJ et al (2017) Incremental laplacian regularization extreme learning machine for online learning. Appl Soft Comput 59:546–555CrossRef
go back to reference Yu HL, Sun CY, Yang XB et al (2016) ODOC-ELM: optimal decision outputs compensation-based extreme learning machine for classifying imbalanced data. Knowl Based Syst 92:55–70CrossRef Yu HL, Sun CY, Yang XB et al (2016) ODOC-ELM: optimal decision outputs compensation-based extreme learning machine for classifying imbalanced data. Knowl Based Syst 92:55–70CrossRef
go back to reference Zeng ZQ, Qun WU, Liao BS et al (2009) A classfication method for imbalance data set based on kernel smote. Acta Electron Sin 37(11):2489–2495 Zeng ZQ, Qun WU, Liao BS et al (2009) A classfication method for imbalance data set based on kernel smote. Acta Electron Sin 37(11):2489–2495
go back to reference Zhao JW, Wang ZH, Dong SP (2012) Online sequential extreme learning machine with forgetting mechanism. Neurocomputing 87(15):79–89CrossRef Zhao JW, Wang ZH, Dong SP (2012) Online sequential extreme learning machine with forgetting mechanism. Neurocomputing 87(15):79–89CrossRef
go back to reference Zong WW, Huang GB, Chen YQ (2013) Weighted extreme learning machine for imbalance learning. Neurocomputing 101(3):229–242CrossRef Zong WW, Huang GB, Chen YQ (2013) Weighted extreme learning machine for imbalance learning. Neurocomputing 101(3):229–242CrossRef
Metadata
Title
Adaptive CCR-ELM with variable-length brain storm optimization algorithm for class-imbalance learning
Authors
Jian Cheng
Jingjing Chen
Yi-nan Guo
Shi Cheng
Linkai Yang
Pei Zhang
Publication date
27-02-2019
Publisher
Springer Netherlands
Published in
Natural Computing / Issue 1/2021
Print ISSN: 1567-7818
Electronic ISSN: 1572-9796
DOI
https://doi.org/10.1007/s11047-019-09735-9

Other articles of this Issue 1/2021

Natural Computing 1/2021 Go to the issue

EditorialNotes

Preface

Premium Partner