Skip to main content

2016 | OriginalPaper | Buchkapitel

3. Multi-dimensional Data Clustering and Visualization via Echo State Networks

verfasst von : Petia Koprinkova-Hristova

Erschienen in: New Approaches in Intelligent Image Analysis

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The chapter summarizes the proposed recently approach for multidimensional data clustering and visualization. It uses a special kind of recurrent networks called Echo state networks (ESN) to generate multiple two-dimensional (2D) projections of the multidimensional original data. For this purpose equilibrium states of all neurons in the ESN are exploited. In order to fit the neurons equilibriums to the data an algorithm for tuning internal weights of the ESN called Intrinsic Plasticity (IP) is applied. Next 2D projections are subjected to selection based on different criteria in dependence on the aim of particular clustering task to be solved. The selected projections are used to cluster and/or to visualize the original data set. Several examples demonstrate possible ways to apply the proposed approach to variety of multidimensional data sets, namely: steel alloys discrimination by their composition; Earth cover classification from hyper spectral satellite images; working regimes classification of an industrial plant using data from multiple measurements; discrimination of patterns of random dot motion on the screen; and clustering and visualization of static and dynamic “sound pictures” taken by multiple randomly placed microphones.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ackley, D.H., Hinton, G.E., Sejnowski, T.J.: A learning algorithm for Boltzmann machines. Cogn. Sci. 9, 147–169 (1985)CrossRef Ackley, D.H., Hinton, G.E., Sejnowski, T.J.: A learning algorithm for Boltzmann machines. Cogn. Sci. 9, 147–169 (1985)CrossRef
2.
Zurück zum Zitat Alexiev, K., Bocheva, N., Stefanov, S.: Assessment of age-related changes in global motion direction discrimination. In: International Conference Automatics and Informatics’11, pp. B277−B280, Sofia, Bulgaria, 3−7 Oct 2011 Alexiev, K., Bocheva, N., Stefanov, S.: Assessment of age-related changes in global motion direction discrimination. In: International Conference Automatics and Informatics’11, pp. B277−B280, Sofia, Bulgaria, 3−7 Oct 2011
3.
Zurück zum Zitat Beardsley, S.A., Ward, R.L., Vaina, L.M.: A neural network model of spiral-planar motion tuning in MSTd. Vision. Res. 43, 577–595 (2003)CrossRef Beardsley, S.A., Ward, R.L., Vaina, L.M.: A neural network model of spiral-planar motion tuning in MSTd. Vision. Res. 43, 577–595 (2003)CrossRef
4.
Zurück zum Zitat Bocheva, N., Bojilov, L.: Neural network model for visual discrimination of complex motion. Comptes rendus de’l Academie bulgare des Sciences 65(10), 1356–1379 (2012) Bocheva, N., Bojilov, L.: Neural network model for visual discrimination of complex motion. Comptes rendus de’l Academie bulgare des Sciences 65(10), 1356–1379 (2012)
5.
6.
Zurück zum Zitat Brody, C.D., Romo, R., Kepecs, A.: Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamical representations. Curr. Opin. Neurobiol. 13, 204–211 (2003)CrossRef Brody, C.D., Romo, R., Kepecs, A.: Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamical representations. Curr. Opin. Neurobiol. 13, 204–211 (2003)CrossRef
7.
Zurück zum Zitat Doukovska, L., Koprinkova-Hristova, P., Beloreshki, S.: Analysis of mill fan system for predictive maintenance. In: International Conference on Automatics and Informatics’11, pp. B-331−B-334, Sofia, Bulgaria, 3–7 Oct 2011 Doukovska, L., Koprinkova-Hristova, P., Beloreshki, S.: Analysis of mill fan system for predictive maintenance. In: International Conference on Automatics and Informatics’11, pp. B-331−B-334, Sofia, Bulgaria, 3–7 Oct 2011
10.
Zurück zum Zitat Grossberg, S., Pilly, P.K.: Temporal dynamics of decision-making during motion perception in the visual cortex, Technical report BU CAS/CNS TR-2007-001, Feb 2008 Grossberg, S., Pilly, P.K.: Temporal dynamics of decision-making during motion perception in the visual cortex, Technical report BU CAS/CNS TR-2007-001, Feb 2008
11.
Zurück zum Zitat Haddad, W.M., Chellaboina, V.S., Nersesov, S.G.: Thermodynamics: A Dynamical System Approach, Princeton University Press (2005) Haddad, W.M., Chellaboina, V.S., Nersesov, S.G.: Thermodynamics: A Dynamical System Approach, Princeton University Press (2005)
12.
Zurück zum Zitat Hammouda, K.: A comparative study of data clustering techniques. In: SYDE 625: Tools of Intelligent Systems Design, Course Project, Aug 2000 Hammouda, K.: A comparative study of data clustering techniques. In: SYDE 625: Tools of Intelligent Systems Design, Course Project, Aug 2000
13.
Zurück zum Zitat Hinton, G.E., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefMATH Hinton, G.E., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefMATH
14.
Zurück zum Zitat Jaeger, H.: Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the “echo state network” approach, GMD Report 159, German National Research Center for Information Technology (2002) Jaeger, H.: Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the “echo state network” approach, GMD Report 159, German National Research Center for Information Technology (2002)
15.
Zurück zum Zitat Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. 31(3), 264–323 (1999)CrossRef Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. 31(3), 264–323 (1999)CrossRef
16.
Zurück zum Zitat Koprinkova-Hristova, P., Palm, G.: ESN intrinsic plasticity versus reservoir stability. In: Artificial Neural Networks and Machine Learning—ICANN 2011. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6791, pp. 69−76 (2011) Koprinkova-Hristova, P., Palm, G.: ESN intrinsic plasticity versus reservoir stability. In: Artificial Neural Networks and Machine Learning—ICANN 2011. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6791, pp. 69−76 (2011)
17.
Zurück zum Zitat Koprinkova-Hristova, P., Tontchev, N.: Echo state networks for multi-dimensional data clustering. In: Artificial Neural Networks and Machine Learning—ICANN 2012. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7552 (PART 1), pp. 571–578 (2012) Koprinkova-Hristova, P., Tontchev, N.: Echo state networks for multi-dimensional data clustering. In: Artificial Neural Networks and Machine Learning—ICANN 2012. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7552 (PART 1), pp. 571–578 (2012)
18.
Zurück zum Zitat Koprinkova-Hristova, P., Alexiev, K., Borisova, D., Jelev, G., Atanassov, V.: Recurrent neural networks for automatic clustering of multispectral satellite images, In: Bruzzone, L (ed.) Proceedings of SPIE, Image and Signal Processing for Remote Sensing XIX, vol. 8892, 88920X, 17 Oct 2013. doi:10.1117/12 Koprinkova-Hristova, P., Alexiev, K., Borisova, D., Jelev, G., Atanassov, V.: Recurrent neural networks for automatic clustering of multispectral satellite images, In: Bruzzone, L (ed.) Proceedings of SPIE, Image and Signal Processing for Remote Sensing XIX, vol. 8892, 88920X, 17 Oct 2013. doi:10.​1117/​12
19.
Zurück zum Zitat Koprinkova-Hristova, P., Angelova, D., Borisova, D., Jelev, G.: Clustering of spectral images using Echo state networks. In: IEEE International Symposium on Innovations in Intelligent Systems and Applications, IEEE INISTA 2013, Albena, Bulgaria, 19–21 June 2013. doi:10.1109/INISTA.2013.6577633 Koprinkova-Hristova, P., Angelova, D., Borisova, D., Jelev, G.: Clustering of spectral images using Echo state networks. In: IEEE International Symposium on Innovations in Intelligent Systems and Applications, IEEE INISTA 2013, Albena, Bulgaria, 19–21 June 2013. doi:10.​1109/​INISTA.​2013.​6577633
20.
Zurück zum Zitat Koprinkova-Hristova, P., Doukovska, L., Kostov, P.: Working regimes classification for predictive maintenance of mill fan systems. In: 2013 IEEE International Symposium on Innovations in Intelligent Systems and Applications, IEEE INISTA 2013, Albena, Bulgaria, 19–21 June 2013. doi:10.1109/INISTA.2013.6577632 Koprinkova-Hristova, P., Doukovska, L., Kostov, P.: Working regimes classification for predictive maintenance of mill fan systems. In: 2013 IEEE International Symposium on Innovations in Intelligent Systems and Applications, IEEE INISTA 2013, Albena, Bulgaria, 19–21 June 2013. doi:10.​1109/​INISTA.​2013.​6577632
21.
Zurück zum Zitat Koprinkova-Hristova, P., Alexiev, K.: Echo state networks in dynamic data clustering. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8131, pp. 343−350 (2013) Koprinkova-Hristova, P., Alexiev, K.: Echo state networks in dynamic data clustering. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8131, pp. 343−350 (2013)
22.
Zurück zum Zitat Koprinkova-Hristova, P., Alexiev, K.: Sound fields clusterization via neural networks. In: 2014 IEEE International Symposium on Innovations in Intelligent Systems and Applications, INISTA 2014, pp. 368−374, Alberobello, Italy, 23−25 June 2014 Koprinkova-Hristova, P., Alexiev, K.: Sound fields clusterization via neural networks. In: 2014 IEEE International Symposium on Innovations in Intelligent Systems and Applications, INISTA 2014, pp. 368−374, Alberobello, Italy, 23−25 June 2014
23.
Zurück zum Zitat Koprinkova-Hristova, P., Alexiev, K.: Dynamic sound fields clusterization using neuro-fuzzy approach. In: 16th International Conference, AIMSA 2014, Varna, Bulgaria, 11−13 Sept 2014. Artificial Intelligence: Methodology, Systems, and Applications, Lecture Notes in Computer Science, vol. 8722, pp. 194−205 (2014) Koprinkova-Hristova, P., Alexiev, K.: Dynamic sound fields clusterization using neuro-fuzzy approach. In: 16th International Conference, AIMSA 2014, Varna, Bulgaria, 11−13 Sept 2014. Artificial Intelligence: Methodology, Systems, and Applications, Lecture Notes in Computer Science, vol. 8722, pp. 194−205 (2014)
25.
Zurück zum Zitat Lazar, A., Pipa, G., Triesch, J.: Predictive coding in cortical microcircuits. In: Kurkova, V., et al. (eds.) ICANN 2008, Part II, LNCS 5164, pp. 386–395 (2008) Lazar, A., Pipa, G., Triesch, J.: Predictive coding in cortical microcircuits. In: Kurkova, V., et al. (eds.) ICANN 2008, Part II, LNCS 5164, pp. 386–395 (2008)
26.
Zurück zum Zitat Lukosevicius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3, 127–149 (2009)CrossRefMATH Lukosevicius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3, 127–149 (2009)CrossRefMATH
28.
Zurück zum Zitat Ozturk, M., Xu, D., Principe, J.: Analysis and design of echo state networks. Neural Comput. 19, 111–138 (2007) Ozturk, M., Xu, D., Principe, J.: Analysis and design of echo state networks. Neural Comput. 19, 111–138 (2007)
29.
Zurück zum Zitat Peng, X., Guo, J., Lei, M., Peng, Y.: Analog circuit fault diagnosis with echo state networks based on corresponding clusters. In: Liu, et al. (eds.) ISNN 2011, Part I, LNCS 6675, pp. 437–444 (2011) Peng, X., Guo, J., Lei, M., Peng, Y.: Analog circuit fault diagnosis with echo state networks based on corresponding clusters. In: Liu, et al. (eds.) ISNN 2011, Part I, LNCS 6675, pp. 437–444 (2011)
30.
Zurück zum Zitat Schrauwen, B., Wandermann, M., Verstraeten, D., Steil, J.J., Stroobandt, D.: Improving reservoirs using intrinsic plasticity. Neurocomputing 71, 1159–1171 (2008)CrossRef Schrauwen, B., Wandermann, M., Verstraeten, D., Steil, J.J., Stroobandt, D.: Improving reservoirs using intrinsic plasticity. Neurocomputing 71, 1159–1171 (2008)CrossRef
31.
Zurück zum Zitat Steil, J.J.: Online reservoir adaptation by intrinsic plasticity for back-propagation-decoleration and echo state learning. Neural Netw. 20, 353–364 (2007)CrossRefMATH Steil, J.J.: Online reservoir adaptation by intrinsic plasticity for back-propagation-decoleration and echo state learning. Neural Netw. 20, 353–364 (2007)CrossRefMATH
32.
Zurück zum Zitat Woodward, A., Ikegami, T.: A reservoir computing approach to image classification using coupled echo state and back-propagation neural networks. In: Proceedings of 26th International Conference on Image and Vision Computing, Auckland, New Zealand, pp. 543–458, 29 Nov−1 Dec 2011 (2011) Woodward, A., Ikegami, T.: A reservoir computing approach to image classification using coupled echo state and back-propagation neural networks. In: Proceedings of 26th International Conference on Image and Vision Computing, Auckland, New Zealand, pp. 543–458, 29 Nov−1 Dec 2011 (2011)
33.
Zurück zum Zitat Yager, R., Filev, D.: Generation of fuzzy rules by mountain clustering. J. Intell. Fuzzy Syst. 2(3), 209–219 (1994) Yager, R., Filev, D.: Generation of fuzzy rules by mountain clustering. J. Intell. Fuzzy Syst. 2(3), 209–219 (1994)
Metadaten
Titel
Multi-dimensional Data Clustering and Visualization via Echo State Networks
verfasst von
Petia Koprinkova-Hristova
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-32192-9_3