Skip to main content

2016 | OriginalPaper | Buchkapitel

Evaluating Confidence Intervals for ELM Predictions

verfasst von : Anton Akusok, Yoan Miche, Kaj-Mikael Björk, Rui Nian, Paula Lauren, Amaury Lendasse

Erschienen in: Proceedings of ELM-2015 Volume 2

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a way of providing more useful and interpretable results for ELM models by adding confidence intervals to predictions. Unlike a usual statistical approach with Mean Squared Error (MSE) that evaluates an average performance of an ELM model over the whole dataset, the proposed method computed particular confidence intervals for each data sample. A confidence for each particular sample makes ELM predictions more intuitive to interpret, and an ELM model more applicable in practice under task-specific requirements. The method shows good results on both toy and a real skin segmentation datasets. On a toy dataset, the predicted confidence intervals accurately represent a variable magnitude noise. On a real dataset, classification with a confidence interval improves the precision at the cost of recall.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of the 2004 IEEE International Joint Conference on Neural Networks, vol. 2, pp. 985–990, IEEE (2004) Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of the 2004 IEEE International Joint Conference on Neural Networks, vol. 2, pp. 985–990, IEEE (2004)
2.
Zurück zum Zitat Huang, G.B., Zhou, H., Ding, X., Zhang, R.: Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 42(2), 513–529 (2012)CrossRef Huang, G.B., Zhou, H., Ding, X., Zhang, R.: Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 42(2), 513–529 (2012)CrossRef
3.
Zurück zum Zitat Huang, G.B.: What are Extreme learning machines? Filling the gap between Frank Rosenblatts Dream and John von Neumanns Puzzle. Cogn. Comput. 7(3), 263–278 (2015)CrossRef Huang, G.B.: What are Extreme learning machines? Filling the gap between Frank Rosenblatts Dream and John von Neumanns Puzzle. Cogn. Comput. 7(3), 263–278 (2015)CrossRef
4.
Zurück zum Zitat van Heeswijk, M., Miche, Y., Oja, E., Lendasse, A.: Gpu-accelerated and parallelized ELM ensembles for large-scale regression. Neurocomputing 74(16), 2430–2437 (2011)CrossRef van Heeswijk, M., Miche, Y., Oja, E., Lendasse, A.: Gpu-accelerated and parallelized ELM ensembles for large-scale regression. Neurocomputing 74(16), 2430–2437 (2011)CrossRef
5.
Zurück zum Zitat Miche, Y., Sorjamaa, A., Bas, P., Simula, O., Jutten, C., Lendasse, A.: OP-ELM: optimally pruned extreme learning machine. IEEE Trans. Neural Netw. 21(1), 158–162 (2010)CrossRef Miche, Y., Sorjamaa, A., Bas, P., Simula, O., Jutten, C., Lendasse, A.: OP-ELM: optimally pruned extreme learning machine. IEEE Trans. Neural Netw. 21(1), 158–162 (2010)CrossRef
6.
Zurück zum Zitat Miche, Y., van Heeswijk, M., Bas, P., Simula, O., Lendasse, A.: TROP-ELM: a double-regularized ELM using LARS and Tikhonov regularization. Neurocomputing 74(16), 2413–2421 (2011)CrossRef Miche, Y., van Heeswijk, M., Bas, P., Simula, O., Lendasse, A.: TROP-ELM: a double-regularized ELM using LARS and Tikhonov regularization. Neurocomputing 74(16), 2413–2421 (2011)CrossRef
7.
Zurück zum Zitat Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70(1), 489–501 (2006)CrossRef Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70(1), 489–501 (2006)CrossRef
8.
Zurück zum Zitat Yu, Q., Miche, Y., Eirola, E., van Heeswijk, M., Séverin, E., Lendasse, A.: Regularized extreme learning machine for regression with missing data. Neurocomputing 102, 45–51 (2013)CrossRef Yu, Q., Miche, Y., Eirola, E., van Heeswijk, M., Séverin, E., Lendasse, A.: Regularized extreme learning machine for regression with missing data. Neurocomputing 102, 45–51 (2013)CrossRef
9.
Zurück zum Zitat Miche, Y., Bas, P., Jutten, C., Simula, O., Lendasse, A.: A methodology for building regression models using extreme learning machine: OP-ELM. In: ESANN 2008 Proceedings Miche, Y., Bas, P., Jutten, C., Simula, O., Lendasse, A.: A methodology for building regression models using extreme learning machine: OP-ELM. In: ESANN 2008 Proceedings
10.
Zurück zum Zitat Cambria, E., et al.: Extreme learning machines. IEEE Intell. Syst. 28(6), 30–59 (2013)CrossRef Cambria, E., et al.: Extreme learning machines. IEEE Intell. Syst. 28(6), 30–59 (2013)CrossRef
11.
Zurück zum Zitat Akusok, A., Miche, Y., Karhunen, J., Björk, K.M., Nian, R., Lendasse, A.: Arbitrary category classification of websites based on image content. IEEE Comput. Intell. Mag. 10(2), 30–41 (2015)CrossRef Akusok, A., Miche, Y., Karhunen, J., Björk, K.M., Nian, R., Lendasse, A.: Arbitrary category classification of websites based on image content. IEEE Comput. Intell. Mag. 10(2), 30–41 (2015)CrossRef
12.
Zurück zum Zitat Shang, Z., He, J.: Confidence-weighted extreme learning machine for regression problems. Neurocomputing 148, 544–550 (2015)CrossRef Shang, Z., He, J.: Confidence-weighted extreme learning machine for regression problems. Neurocomputing 148, 544–550 (2015)CrossRef
13.
Zurück zum Zitat Lendasse, A., Ji, Y., Reyhani, N., Verleysen, M.: LS-SVM Hyperparameter Selection with a Nonparametric Noise Estimator. In: Artificial Neural Networks: Formal Models and Their Applications ICANN 2005. Volume 3697 of Lecture Notes in Computer Science. Springer, Berlin Heidelberg, pp. 625–630 (2005) Lendasse, A., Ji, Y., Reyhani, N., Verleysen, M.: LS-SVM Hyperparameter Selection with a Nonparametric Noise Estimator. In: Artificial Neural Networks: Formal Models and Their Applications ICANN 2005. Volume 3697 of Lecture Notes in Computer Science. Springer, Berlin Heidelberg, pp. 625–630 (2005)
14.
Zurück zum Zitat Pouzols, F.M., Lendasse, A., Barros, A.B.: Autoregressive time series prediction by means of fuzzy inference systems using nonparametric residual variance estimation. Fuzzy Sets Sys. 161(4), 471–497 (2010). Theme: Forecasting, Classification, and Learning Pouzols, F.M., Lendasse, A., Barros, A.B.: Autoregressive time series prediction by means of fuzzy inference systems using nonparametric residual variance estimation. Fuzzy Sets Sys. 161(4), 471–497 (2010). Theme: Forecasting, Classification, and Learning
15.
Zurück zum Zitat Guillén, A., Sovilj, D., Lendasse, A., Mateo, F., Rojas, I.: Minimising the delta test for variable selection in regression problems. Int. J. High Perform. Syst. Archit. 1(4), 269–281 (2008)CrossRef Guillén, A., Sovilj, D., Lendasse, A., Mateo, F., Rojas, I.: Minimising the delta test for variable selection in regression problems. Int. J. High Perform. Syst. Archit. 1(4), 269–281 (2008)CrossRef
16.
Zurück zum Zitat Bishop, C.M.: Pattern Recognition and Machine Learning. Volume 4 of Information science and statistics. Springer (2006) Bishop, C.M.: Pattern Recognition and Machine Learning. Volume 4 of Information science and statistics. Springer (2006)
17.
Zurück zum Zitat Akusok, A., Björk, K.M., Miché, Y., Lendasse, A.: High-performance extreme learning machines: a complete toolbox for big data applications. IEEE Access 3, 1011–1025 (2015)CrossRef Akusok, A., Björk, K.M., Miché, Y., Lendasse, A.: High-performance extreme learning machines: a complete toolbox for big data applications. IEEE Access 3, 1011–1025 (2015)CrossRef
18.
Zurück zum Zitat Phung, S.L., Bouzerdoum, A., Chai D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27(1), 148–154 (2005) Phung, S.L., Bouzerdoum, A., Chai D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27(1), 148–154 (2005)
19.
Zurück zum Zitat Swaney, C., Akusok, A., Björk, K.M., Miche, Y., Lendasse, A.: Efficient skin segmentation via neural networks: HP-ELM and BD-SOM. 53, 400–409 (2015) Swaney, C., Akusok, A., Björk, K.M., Miche, Y., Lendasse, A.: Efficient skin segmentation via neural networks: HP-ELM and BD-SOM. 53, 400–409 (2015)
Metadaten
Titel
Evaluating Confidence Intervals for ELM Predictions
verfasst von
Anton Akusok
Yoan Miche
Kaj-Mikael Björk
Rui Nian
Paula Lauren
Amaury Lendasse
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-28373-9_35