Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 4/2017

17.02.2016 | Original Article

An ELM-based model with sparse-weighting strategy for sequential data imbalance problem

verfasst von: Wentao Mao, Jinwan Wang, Zhanao Xue

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 4/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In many practical engineering applications, online sequential data imbalance problems are universally found. Many traditional machine learning methods are hard to improve the classification accuracy effectively while solving these problems. To get fast and efficient classification, a new online sequential extreme learning machine algorithm with sparse-weighting strategy is proposed to increase the accuracy of minority class while reducing the accuracy loss of majority class as much as possible. The main idea is integrating a new sparse-weighting strategy into the present data-based strategy for sequential data imbalance problem. In offline stage, a two phase balanced strategies is introduced to obtain the valuable virtual sample set. In online stage, a dynamic weighting strategy is proposed to assign the corresponding weight for each sequential sample by means of the change of sensitivity and specificity in order to maintain the optimal network structure. Experimental results on two kinds of imbalanced datasets, UCI datasets and the real-world air pollutant forecasting dataset, show that the proposed method has higher prediction accuracy and better numerical stability compared with ELM, OS-ELM, meta-cognitive OS-ELM and weighted OS-ELM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Yang Y, Han DQ (2016) A new distance-based total uncertainty measure in the theory of belief functions. Knowl-Based Syst 94:114-123CrossRef Yang Y, Han DQ (2016) A new distance-based total uncertainty measure in the theory of belief functions. Knowl-Based Syst 94:114-123CrossRef
2.
Zurück zum Zitat Mirza B, Lin Z, Toh KA (2013) Weighted online sequential extreme learning machine for class imbalance learning. Neural Process Lett 38:465–486CrossRef Mirza B, Lin Z, Toh KA (2013) Weighted online sequential extreme learning machine for class imbalance learning. Neural Process Lett 38:465–486CrossRef
3.
Zurück zum Zitat Chawla NV, Bowyer KW, Hall LO (2011) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357MATH Chawla NV, Bowyer KW, Hall LO (2011) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357MATH
4.
Zurück zum Zitat Yang Z, Qiao L, Peng X (2007) Research on datamining method for imbalanced dataset based on improved SMOTE. Acta Electron Sin 12:22–26 Yang Z, Qiao L, Peng X (2007) Research on datamining method for imbalanced dataset based on improved SMOTE. Acta Electron Sin 12:22–26
5.
Zurück zum Zitat Liu Y, Liu S, Liu T, Wang Z (2014) New oversampling algorithm DB_SMOTE. Comput Eng Appl 50:92–95 Liu Y, Liu S, Liu T, Wang Z (2014) New oversampling algorithm DB_SMOTE. Comput Eng Appl 50:92–95
6.
Zurück zum Zitat Wang X, Aamir R, Fu A (2015) Fuzziness based sample categorization for classifier performance improvement. J Intell Fuzzy Syst 29:1185–1196MathSciNetCrossRef Wang X, Aamir R, Fu A (2015) Fuzziness based sample categorization for classifier performance improvement. J Intell Fuzzy Syst 29:1185–1196MathSciNetCrossRef
7.
Zurück zum Zitat Krawczyk B, Woźniak M, Schaefer G (2014) Cost-sensitive decision tree ensembles for effective imbalanced classification. Appl Soft Comput J 14:554–562CrossRef Krawczyk B, Woźniak M, Schaefer G (2014) Cost-sensitive decision tree ensembles for effective imbalanced classification. Appl Soft Comput J 14:554–562CrossRef
8.
Zurück zum Zitat Cervantes J, García-Lamont F, López A, Rodriguez L, Castilla JSR, Trueba A (2015) PSO-based method for SVM classification on skewed data-sets. Lecture notes in computer science, vol 9227. Springer International Publishing, pp 79–86. doi:10.1007/978-3-319-22053-6_9 Cervantes J, García-Lamont F, López A, Rodriguez L, Castilla JSR, Trueba A (2015) PSO-based method for SVM classification on skewed data-sets. Lecture notes in computer science, vol 9227. Springer International Publishing, pp 79–86. doi:10.​1007/​978-3-319-22053-6_​9
9.
Zurück zum Zitat Wang X, Xing H, Li Y, Li Y (2015) A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning. IEEE Trans Fuzzy Syst 23(5):1638–1654CrossRef Wang X, Xing H, Li Y, Li Y (2015) A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning. IEEE Trans Fuzzy Syst 23(5):1638–1654CrossRef
10.
Zurück zum Zitat Wang X (2015) Uncertainty in learning from big data-editorial. J Intell Fuzzy Syst 28(5):2329–2330CrossRef Wang X (2015) Uncertainty in learning from big data-editorial. J Intell Fuzzy Syst 28(5):2329–2330CrossRef
11.
Zurück zum Zitat Huang G, Zhou H, Ding X (2012) Extreme learning machine for regression and multiclass. IEEE Trans Syst Man Cybern Part B Cybern 42:513–529CrossRef Huang G, Zhou H, Ding X (2012) Extreme learning machine for regression and multiclass. IEEE Trans Syst Man Cybern Part B Cybern 42:513–529CrossRef
12.
Zurück zum Zitat Feng G, Huang GB, Lin Q (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. Neural Netw IEEE Trans 20:1352–1357CrossRef Feng G, Huang GB, Lin Q (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. Neural Netw IEEE Trans 20:1352–1357CrossRef
13.
Zurück zum Zitat Miche Y, Sorjamaa A, Bas P (2010) OP-ELM: optimally pruned extreme learning machine. Neural Netw IEEE Trans 21:158–162CrossRef Miche Y, Sorjamaa A, Bas P (2010) OP-ELM: optimally pruned extreme learning machine. Neural Netw IEEE Trans 21:158–162CrossRef
14.
Zurück zum Zitat Lu S, Wang X, Zhang G, Zhou X (2015) Effective algorithms of the Moore–Penrose inverse matrices for extreme learning machine. Intell Data Anal 19(4):743–760CrossRef Lu S, Wang X, Zhang G, Zhou X (2015) Effective algorithms of the Moore–Penrose inverse matrices for extreme learning machine. Intell Data Anal 19(4):743–760CrossRef
15.
Zurück zum Zitat Wang X, Shao Q, Qing M, Zhai J (2013) Architecture selection for networks trained with extreme learning machine using localized generalization error model. Neurocomputing 102:3–9CrossRef Wang X, Shao Q, Qing M, Zhai J (2013) Architecture selection for networks trained with extreme learning machine using localized generalization error model. Neurocomputing 102:3–9CrossRef
16.
Zurück zum Zitat Liang N, Huang GB (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17:1411–1423CrossRef Liang N, Huang GB (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17:1411–1423CrossRef
17.
Zurück zum Zitat Mirza B, Lin Z, Liu N (2006) Ensemble of subset online sequential extreme learning machine for class imbalance and concept drift. Neurocomputing 149:316–329CrossRef Mirza B, Lin Z, Liu N (2006) Ensemble of subset online sequential extreme learning machine for class imbalance and concept drift. Neurocomputing 149:316–329CrossRef
18.
Zurück zum Zitat Chiu CC (2013) Online Sequential Prediction of Minority Class of Suspended Particulate Matters by Meta-Cognitive OS-ELM. Master Thesis, University of Macau Chiu CC (2013) Online Sequential Prediction of Minority Class of Suspended Particulate Matters by Meta-Cognitive OS-ELM. Master Thesis, University of Macau
19.
Zurück zum Zitat Yen SJ, Lee YS (2009) Cluster-based under-sampling approaches for imbalanced data distributions. Expert Syst Appl 36:5718–5727CrossRef Yen SJ, Lee YS (2009) Cluster-based under-sampling approaches for imbalanced data distributions. Expert Syst Appl 36:5718–5727CrossRef
20.
Zurück zum Zitat Zhu W, Miao J, Qing L (2014) Robust regression with extreme support vectors. Pattern Recognit Lett 45:205–210CrossRef Zhu W, Miao J, Qing L (2014) Robust regression with extreme support vectors. Pattern Recognit Lett 45:205–210CrossRef
21.
Zurück zum Zitat Zhu W, Miao J, Qing L (2014) Extreme support vector regression. In: Sun F, Toh K-A, Romay MG, Mao K (eds) Extreme learning machines 2013: algorithms and applications. Springer International Publishing, pp 25–34 Zhu W, Miao J, Qing L (2014) Extreme support vector regression. In: Sun F, Toh K-A, Romay MG, Mao K (eds) Extreme learning machines 2013: algorithms and applications. Springer International Publishing, pp 25–34
22.
Zurück zum Zitat Leng Q, Qi H, Miao J, Zhu W, Su G (2015) One-class classification with extreme learning machine. Mathe Probl Eng 2015(2015):1–11MathSciNet Leng Q, Qi H, Miao J, Zhu W, Su G (2015) One-class classification with extreme learning machine. Mathe Probl Eng 2015(2015):1–11MathSciNet
23.
Zurück zum Zitat Yang L, Zhang R (2012) Online sequential ELM algorithm and its improvement. J Northwest Univ (Nat Sci Edn) 42:885–896MathSciNetMATH Yang L, Zhang R (2012) Online sequential ELM algorithm and its improvement. J Northwest Univ (Nat Sci Edn) 42:885–896MathSciNetMATH
24.
Zurück zum Zitat Zhang X (2005) Matrix analysis and application. Tsinghua University Press, Beijing Zhang X (2005) Matrix analysis and application. Tsinghua University Press, Beijing
25.
Zurück zum Zitat Vong CM, Ip WF, Wong PK, Chiu CC (2014) Predicting minority class for suspended particulate matters level by extreme learning machine. Neurocomputing 128:136–144CrossRef Vong CM, Ip WF, Wong PK, Chiu CC (2014) Predicting minority class for suspended particulate matters level by extreme learning machine. Neurocomputing 128:136–144CrossRef
Metadaten
Titel
An ELM-based model with sparse-weighting strategy for sequential data imbalance problem
verfasst von
Wentao Mao
Jinwan Wang
Zhanao Xue
Publikationsdatum
17.02.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 4/2017
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-016-0509-z

Weitere Artikel der Ausgabe 4/2017

International Journal of Machine Learning and Cybernetics 4/2017 Zur Ausgabe

Neuer Inhalt