Skip to main content
Erschienen in: Neural Processing Letters 3/2020

17.06.2020

Parameter-Free Extreme Learning Machine for Imbalanced Classification

verfasst von: Li Li, Kaiyi Zhao, Ruizhi Sun, Jiangzhang Gan, Gang Yuan, Tong Liu

Erschienen in: Neural Processing Letters | Ausgabe 3/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Imbalanced data distribution is a common problem in classification situations, that is the number of samples in different categories varies greatly, thus increasing the classification difficulty. Although many methods have been used for the imbalanced data classification, there are still problems with low classification accuracy in minority class and adding additional parameter settings. In order to increase minority classification accuracy in imbalanced problem, this paper proposes a parameter-free weighting learning mechanism based on extreme learning machine and sample loss values to balance the number of samples in each training step. The proposed method mainly includes two aspects: the sample weight learning process based on the sample losses; the sample selection process and weight update process according to the constraint function and iterations. Experimental results on twelve datasets from the KEEL repository show that the proposed method could achieve more balanced and accurate results than other compared methods in this work.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Ganganwar V (2012) An overview of classification algorithms for imbalanced datasets. Int J Emerg Technol Adv Eng 2(4):42–47 Ganganwar V (2012) An overview of classification algorithms for imbalanced datasets. Int J Emerg Technol Adv Eng 2(4):42–47
3.
Zurück zum Zitat Li L, Sun R, Cai S, Zhao K, Zhang Q (2019) A review of improved extreme learning machine methods for data stream classification. Multimed Tools Appl 78(23):33375–33400CrossRef Li L, Sun R, Cai S, Zhao K, Zhang Q (2019) A review of improved extreme learning machine methods for data stream classification. Multimed Tools Appl 78(23):33375–33400CrossRef
4.
Zurück zum Zitat Srimuang W, Intarasothonchun S (2015) Classification model of network intrusion using weighted extreme learning machine. In: 2015 12th international joint conference on computer science and software engineering (JCSSE), 2015. IEEE, pp 190–194 Srimuang W, Intarasothonchun S (2015) Classification model of network intrusion using weighted extreme learning machine. In: 2015 12th international joint conference on computer science and software engineering (JCSSE), 2015. IEEE, pp 190–194
5.
Zurück zum Zitat Wei W, Li J, Cao L, Ou Y, Chen J (2013) Effective detection of sophisticated online banking fraud on extremely imbalanced data. World Wide Web 16(4):449–475CrossRef Wei W, Li J, Cao L, Ou Y, Chen J (2013) Effective detection of sophisticated online banking fraud on extremely imbalanced data. World Wide Web 16(4):449–475CrossRef
6.
Zurück zum Zitat Haixiang G, Yijing L, Shang J, Mingyun G, Yuanyue H, Bing G (2017) Learning from class-imbalanced data: review of methods and applications. Expert Syst Appl 73:220–239CrossRef Haixiang G, Yijing L, Shang J, Mingyun G, Yuanyue H, Bing G (2017) Learning from class-imbalanced data: review of methods and applications. Expert Syst Appl 73:220–239CrossRef
7.
Zurück zum Zitat Burnaev E, Erofeev P, Papanov A (2015) Influence of resampling on accuracy of imbalanced classification. In: Eighth international conference on machine vision (ICMV 2015), 2015. International Society for Optics and Photonics, p 987521 Burnaev E, Erofeev P, Papanov A (2015) Influence of resampling on accuracy of imbalanced classification. In: Eighth international conference on machine vision (ICMV 2015), 2015. International Society for Optics and Photonics, p 987521
8.
Zurück zum Zitat Charte F, Rivera AJ, del Jesus MJ, Herrera F (2015) Addressing imbalance in multilabel classification: measures and random resampling algorithms. Neurocomputing 163:3–16CrossRef Charte F, Rivera AJ, del Jesus MJ, Herrera F (2015) Addressing imbalance in multilabel classification: measures and random resampling algorithms. Neurocomputing 163:3–16CrossRef
9.
Zurück zum Zitat Wang S, Minku LL, Yao X (2014) Resampling-based ensemble methods for online class imbalance learning. IEEE Trans Knowl Data Eng 27(5):1356–1368CrossRef Wang S, Minku LL, Yao X (2014) Resampling-based ensemble methods for online class imbalance learning. IEEE Trans Knowl Data Eng 27(5):1356–1368CrossRef
11.
Zurück zum Zitat Zheng E, Zhang C, Liu X, Lu H, Sun J (2013) Cost-sensitive extreme learning machine. In: International conference on advanced data mining and applications, 2013. Springer, pp 478–488 Zheng E, Zhang C, Liu X, Lu H, Sun J (2013) Cost-sensitive extreme learning machine. In: International conference on advanced data mining and applications, 2013. Springer, pp 478–488
12.
Zurück zum Zitat Wang X, Liu X, Japkowicz N, Matwin S (2013) Resampling and cost-sensitive methods for imbalanced multi-instance learning. In: 2013 IEEE 13th international conference on data mining workshops, 2013. IEEE, pp 808–816 Wang X, Liu X, Japkowicz N, Matwin S (2013) Resampling and cost-sensitive methods for imbalanced multi-instance learning. In: 2013 IEEE 13th international conference on data mining workshops, 2013. IEEE, pp 808–816
13.
Zurück zum Zitat Qian Y, Liang Y, Li M, Feng G, Shi X (2014) A resampling ensemble algorithm for classification of imbalance problems. Neurocomputing 143:57–67CrossRef Qian Y, Liang Y, Li M, Feng G, Shi X (2014) A resampling ensemble algorithm for classification of imbalance problems. Neurocomputing 143:57–67CrossRef
14.
Zurück zum Zitat Zhu X, Zhu Y, Zheng W (2019) Spectral rotation for deep one-step clustering. Pattern Recognit 105:107175CrossRef Zhu X, Zhu Y, Zheng W (2019) Spectral rotation for deep one-step clustering. Pattern Recognit 105:107175CrossRef
15.
Zurück zum Zitat Zhu X, Zhang S, He W, Hu R, Lei C, Zhu P (2018) One-step multi-view spectral clustering. IEEE Trans Knowl Data Eng 31(10):2022–2034CrossRef Zhu X, Zhang S, He W, Hu R, Lei C, Zhu P (2018) One-step multi-view spectral clustering. IEEE Trans Knowl Data Eng 31(10):2022–2034CrossRef
16.
Zurück zum Zitat Ling CX, Sheng VS (2008) Cost-sensitive learning and the class imbalance problem. In: Encyclopedia of machine learning, vol 2011, pp 231–235 Ling CX, Sheng VS (2008) Cost-sensitive learning and the class imbalance problem. In: Encyclopedia of machine learning, vol 2011, pp 231–235
17.
Zurück zum Zitat Ren Y, Zhao P, Xu Z, Yao D (2017) Balanced self-paced learning with feature corruption. In: 2017 international joint conference on neural networks (IJCNN), 2017. IEEE, pp 2064–2071 Ren Y, Zhao P, Xu Z, Yao D (2017) Balanced self-paced learning with feature corruption. In: 2017 international joint conference on neural networks (IJCNN), 2017. IEEE, pp 2064–2071
18.
Zurück zum Zitat Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef
20.
Zurück zum Zitat Alade OA, Selamat A, Sallehuddin R (2017) A review of advances in extreme learning machine techniques and its applications. In: International conference of reliable information and communication technology, 2017. Springer, pp 885–895 Alade OA, Selamat A, Sallehuddin R (2017) A review of advances in extreme learning machine techniques and its applications. In: International conference of reliable information and communication technology, 2017. Springer, pp 885–895
21.
Zurück zum Zitat Zong W, Huang G-B, Chen Y (2013) Weighted extreme learning machine for imbalance learning. Neurocomputing 101:229–242CrossRef Zong W, Huang G-B, Chen Y (2013) Weighted extreme learning machine for imbalance learning. Neurocomputing 101:229–242CrossRef
22.
Zurück zum Zitat Akbulut Y, Şengür A, Guo Y, Smarandache F (2017) A novel neutrosophic weighted extreme learning machine for imbalanced data set. Symmetry 9(8):142CrossRef Akbulut Y, Şengür A, Guo Y, Smarandache F (2017) A novel neutrosophic weighted extreme learning machine for imbalanced data set. Symmetry 9(8):142CrossRef
23.
Zurück zum Zitat Zhang X, Song Q, Wang G, Zhang K, He L, Jia X (2015) A dissimilarity-based imbalance data classification algorithm. Appl Intell 42(3):544–565CrossRef Zhang X, Song Q, Wang G, Zhang K, He L, Jia X (2015) A dissimilarity-based imbalance data classification algorithm. Appl Intell 42(3):544–565CrossRef
24.
Zurück zum Zitat Lu C, Ke H, Zhang G, Mei Y, Xu H (2019) An improved weighted extreme learning machine for imbalanced data classification. Memetic Comput 11(1):27–34CrossRef Lu C, Ke H, Zhang G, Mei Y, Xu H (2019) An improved weighted extreme learning machine for imbalanced data classification. Memetic Comput 11(1):27–34CrossRef
25.
Zurück zum Zitat Li K, Kong X, Lu Z, Wenyin L, Yin J (2014) Boosting weighted ELM for imbalanced learning. Neurocomputing 128:15–21CrossRef Li K, Kong X, Lu Z, Wenyin L, Yin J (2014) Boosting weighted ELM for imbalanced learning. Neurocomputing 128:15–21CrossRef
26.
Zurück zum Zitat Raghuwanshi BS, Shukla S (2018) Class-specific kernelized extreme learning machine for binary class imbalance learning. Appl Soft Comput 73:1026–1038CrossRef Raghuwanshi BS, Shukla S (2018) Class-specific kernelized extreme learning machine for binary class imbalance learning. Appl Soft Comput 73:1026–1038CrossRef
27.
Zurück zum Zitat Hu R, Zhu X, Zhu Y, Gan J (2019) Robust SVM with adaptive graph learning. World Wide Web 23:1–24 Hu R, Zhu X, Zhu Y, Gan J (2019) Robust SVM with adaptive graph learning. World Wide Web 23:1–24
28.
Zurück zum Zitat Zhu X, Gan J, Lu G, Li J, Zhang S (2019) Spectral clustering via half-quadratic optimization. World Wide Web 23:1–20 Zhu X, Gan J, Lu G, Li J, Zhang S (2019) Spectral clustering via half-quadratic optimization. World Wide Web 23:1–20
29.
Zurück zum Zitat Xiao W, Zhang J, Li Y, Zhang S, Yang W (2017) Class-specific cost regulation extreme learning machine for imbalanced classification. Neurocomputing 261:70–82CrossRef Xiao W, Zhang J, Li Y, Zhang S, Yang W (2017) Class-specific cost regulation extreme learning machine for imbalanced classification. Neurocomputing 261:70–82CrossRef
31.
Zurück zum Zitat Zhu X, Li X, Zhang S, Xu Z, Yu L, Wang C (2017) Graph PCA hashing for similarity search. IEEE Trans Multimed 19(9):2033–2044CrossRef Zhu X, Li X, Zhang S, Xu Z, Yu L, Wang C (2017) Graph PCA hashing for similarity search. IEEE Trans Multimed 19(9):2033–2044CrossRef
32.
Zurück zum Zitat Zheng W, Zhu X, Wen G, Zhu Y, Yu H, Gan J (2018) Unsupervised feature selection by self-paced learning regularization. Pattern Recognit Lett Zheng W, Zhu X, Wen G, Zhu Y, Yu H, Gan J (2018) Unsupervised feature selection by self-paced learning regularization. Pattern Recognit Lett
33.
Zurück zum Zitat Huang C, Li Y, Change Loy C, Tang X (2016) Learning deep representation for imbalanced classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016. pp 5375–5384 Huang C, Li Y, Change Loy C, Tang X (2016) Learning deep representation for imbalanced classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016. pp 5375–5384
34.
35.
Zurück zum Zitat Wang T, Cao J, Lai X, Chen B (2018) Deep weighted extreme learning machine. Cognit Comput 10(6):890–907CrossRef Wang T, Cao J, Lai X, Chen B (2018) Deep weighted extreme learning machine. Cognit Comput 10(6):890–907CrossRef
36.
Zurück zum Zitat Raghuwanshi BS, Shukla S (2018) Class-specific extreme learning machine for handling binary class imbalance problem. Neural Netw 105:206–217CrossRef Raghuwanshi BS, Shukla S (2018) Class-specific extreme learning machine for handling binary class imbalance problem. Neural Netw 105:206–217CrossRef
Metadaten
Titel
Parameter-Free Extreme Learning Machine for Imbalanced Classification
verfasst von
Li Li
Kaiyi Zhao
Ruizhi Sun
Jiangzhang Gan
Gang Yuan
Tong Liu
Publikationsdatum
17.06.2020
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2020
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10282-z

Weitere Artikel der Ausgabe 3/2020

Neural Processing Letters 3/2020 Zur Ausgabe

Neuer Inhalt