Skip to main content

2018 | OriginalPaper | Buchkapitel

A Self-Organizing Ensemble of Deep Neural Networks for the Classification of Data from Complex Processes

verfasst von : Niclas Ståhl, Göran Falkman, Gunnar Mathiason, Alexander Karlsson

Erschienen in: Information Processing and Management of Uncertainty in Knowledge-Based Systems. Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present a new self-organizing algorithm for classification of a data that combines and extends the strengths of several common machine learning algorithms, such as algorithms in self-organizing neural networks, ensemble methods and deep neural networks. The increased expression power is combined with the explanation power of self-organizing networks. Our algorithm outperforms both deep neural networks and ensembles of deep neural networks. For our evaluation case, we use production monitoring data from a complex steel manufacturing process, where data is both high-dimensional and has many nonlinear interdependencies. In addition to the improved prediction score, the algorithm offers a new deep-learning based approach for how computational resources can be focused in data exploration, since the algorithm points out areas of the input space that are more challenging to learn.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
This work was supported by Vinnova and Jernkontoret under the project Dataflow. We would like to thank Andreas Persson at Outokumpu AB for the valuable collaboration.
 
Literatur
2.
Zurück zum Zitat Cuadrado, A.A., Diaz, I., Diez, A.B., Obeso, F., Gonzalez, J.A.: Visual data mining and monitoring in steel processes. In: Conference Record of the 2002 IEEE Industry Applications Conference, 37th IAS Annual Meeting (Cat. No. 02CH37344), vol. 1, pp. 493–500 (2002). https://doi.org/10.1109/IAS.2002.1044131 Cuadrado, A.A., Diaz, I., Diez, A.B., Obeso, F., Gonzalez, J.A.: Visual data mining and monitoring in steel processes. In: Conference Record of the 2002 IEEE Industry Applications Conference, 37th IAS Annual Meeting (Cat. No. 02CH37344), vol. 1, pp. 493–500 (2002). https://​doi.​org/​10.​1109/​IAS.​2002.​1044131
4.
Zurück zum Zitat Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems, pp. 625–632 (1995) Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems, pp. 625–632 (1995)
5.
Zurück zum Zitat Fritzke, B.: Growing self-organizing networks-why? In: ESANN 1996, pp. 61–72 (1996) Fritzke, B.: Growing self-organizing networks-why? In: ESANN 1996, pp. 61–72 (1996)
12.
Zurück zum Zitat van der Maaten, L., Hinton, G.: Visualizing data using t-sne. J. Mach. Learn. Res. 9, 2579–2605 (2008) van der Maaten, L., Hinton, G.: Visualizing data using t-sne. J. Mach. Learn. Res. 9, 2579–2605 (2008)
13.
Zurück zum Zitat Martinetz, T.M., Berkovich, S.G., Schulten, K.J.: ‘Neural-gas’ network for vector quantization and its application to time-series prediction. IEEE Trans. Neural Netw. 4(4), 558–569 (1993)CrossRef Martinetz, T.M., Berkovich, S.G., Schulten, K.J.: ‘Neural-gas’ network for vector quantization and its application to time-series prediction. IEEE Trans. Neural Netw. 4(4), 558–569 (1993)CrossRef
14.
Zurück zum Zitat Opitz, D.W., Maclin, R.: Popular ensemble methods. J. Artif. Intell. Res. (JAIR) 11, 169–198 (1999)MATH Opitz, D.W., Maclin, R.: Popular ensemble methods. J. Artif. Intell. Res. (JAIR) 11, 169–198 (1999)MATH
15.
Zurück zum Zitat Poole, B., Lahiri, S., Raghu, M., Sohl-Dickstein, J., Ganguli, S.: Exponential expressivity in deep neural networks through transient chaos. In: Lee, D.D., Sugiyama, M., Luxburg, U.V., Guyon, I., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 29, pp. 3360–3368. Curran Associates Inc. (2016) Poole, B., Lahiri, S., Raghu, M., Sohl-Dickstein, J., Ganguli, S.: Exponential expressivity in deep neural networks through transient chaos. In: Lee, D.D., Sugiyama, M., Luxburg, U.V., Guyon, I., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 29, pp. 3360–3368. Curran Associates Inc. (2016)
Metadaten
Titel
A Self-Organizing Ensemble of Deep Neural Networks for the Classification of Data from Complex Processes
verfasst von
Niclas Ståhl
Göran Falkman
Gunnar Mathiason
Alexander Karlsson
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91479-4_21