Skip to main content

2020 | OriginalPaper | Buchkapitel

A Fast Algorithm to Find Best Matching Units in Self-Organizing Maps

verfasst von : Yann Bernard, Nicolas Hueber, Bernard Girau

Erschienen in: Artificial Neural Networks and Machine Learning – ICANN 2020

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Self-Organizing Maps (SOM) are well-known unsupervised neural networks able to perform vector quantization while mapping an underlying regular neighbourhood structure onto the codebook. They are used in a wide range of applications. As with most properly trained neural networks models, increasing the number of neurons in a SOM leads to better results or new emerging properties. Therefore highly efficient algorithms for learning and evaluation are key to improve the performance of such models. In this paper, we propose a faster alternative to compute the Winner Takes All component of SOM that scales better with a large number of neurons. We present our algorithm to find the so-called best matching unit (BMU) in a SOM, and we theoretically analyze its computational complexity. Statistical results on various synthetic and real-world datasets confirm this analysis and show an even more significant improvement in computing time with a minimal degradation of performance. With our method, we explore a new approach for optimizing SOM that can be combined with other optimization methods commonly used in these models for an even faster computation in both learning and recall phases.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abadi, M., Jovanovic, S., Khalifa, K.B., Weber, S., Bedoui, M.H.: A scalable and adaptable hardware NoC-based self organizing map. Microprocess. Microsyst. 57, 1–14 (2018)CrossRef Abadi, M., Jovanovic, S., Khalifa, K.B., Weber, S., Bedoui, M.H.: A scalable and adaptable hardware NoC-based self organizing map. Microprocess. Microsyst. 57, 1–14 (2018)CrossRef
2.
Zurück zum Zitat Amerijckx, C., Legat, J.D., Verleysen, M.: Image compression using self-organizing maps. Syst. Anal. Modell. Simul. 43(11), 1529–1543 (2003)MathSciNetCrossRef Amerijckx, C., Legat, J.D., Verleysen, M.: Image compression using self-organizing maps. Syst. Anal. Modell. Simul. 43(11), 1529–1543 (2003)MathSciNetCrossRef
3.
Zurück zum Zitat Cottrell, M., Olteanu, M., Rossi, F., Villa-Vialaneix, N.N.: Self-OrganizingMaps, theory and applications. Revista de Investigacion Operacional 39(1), 1–22 (2018) Cottrell, M., Olteanu, M., Rossi, F., Villa-Vialaneix, N.N.: Self-OrganizingMaps, theory and applications. Revista de Investigacion Operacional 39(1), 1–22 (2018)
5.
Zurück zum Zitat Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems, vol. 7. pp. 625–632. MIT Press (1995) Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems, vol. 7. pp. 625–632. MIT Press (1995)
6.
Zurück zum Zitat Huang, Z., et al.: A hardware-efficient vector quantizer based on self-organizing map for high-speed image compression. Appl. Sci. 7(11), 1106 (2017)CrossRef Huang, Z., et al.: A hardware-efficient vector quantizer based on self-organizing map for high-speed image compression. Appl. Sci. 7(11), 1106 (2017)CrossRef
7.
Zurück zum Zitat Jackson, Z., Souza, C., Flaks, J., Pan, Y., Nicolas, H., Thite, A.: Jakobovski/free-spoken-digit-dataset: v1.0.8, August 2018 Jackson, Z., Souza, C., Flaks, J., Pan, Y., Nicolas, H., Thite, A.: Jakobovski/free-spoken-digit-dataset: v1.0.8, August 2018
9.
Zurück zum Zitat Kohonen, T.: The self-organizing map. Neurocomputing 21(1–3), 1–6 (1998)CrossRef Kohonen, T.: The self-organizing map. Neurocomputing 21(1–3), 1–6 (1998)CrossRef
10.
Zurück zum Zitat Kohonen, T.: Essentials of the self-organizing map. Neural Netw. 37, 52–65 (2013)CrossRef Kohonen, T.: Essentials of the self-organizing map. Neural Netw. 37, 52–65 (2013)CrossRef
11.
Zurück zum Zitat Kohonen, T., Honkela, T.: Kohonen network. Scholarpedia 2(1), 1568 (2007)CrossRef Kohonen, T., Honkela, T.: Kohonen network. Scholarpedia 2(1), 1568 (2007)CrossRef
12.
Zurück zum Zitat MacQueen, J.: Some methods for classification and analysis of multivariate observations. The Regents of the University of California (1967) MacQueen, J.: Some methods for classification and analysis of multivariate observations. The Regents of the University of California (1967)
13.
Zurück zum Zitat Martinetz, T.M., Berkovich, S.G., Schulten, K.J.: Neural-gas network for vector quantization and its application to time-series prediction. IEEE Trans. Neural Netw. 4(4), 558–569 (1993)CrossRef Martinetz, T.M., Berkovich, S.G., Schulten, K.J.: Neural-gas network for vector quantization and its application to time-series prediction. IEEE Trans. Neural Netw. 4(4), 558–569 (1993)CrossRef
14.
Zurück zum Zitat Oyana, T.J., Achenie, L.E., Heo, J.: The new and computationally efficient MIL-SOM algorithm: potential benefits for visualization and analysis of a large-scale high-dimensional clinically acquired geographic data. Comput. Math. Methods Med. 2012, 14 (2012)CrossRef Oyana, T.J., Achenie, L.E., Heo, J.: The new and computationally efficient MIL-SOM algorithm: potential benefits for visualization and analysis of a large-scale high-dimensional clinically acquired geographic data. Comput. Math. Methods Med. 2012, 14 (2012)CrossRef
15.
Zurück zum Zitat Vasuki, A., Vanathi, P.: A review of vector quantization techniques. IEEE Potentials 25(4), 39–47 (2006)CrossRef Vasuki, A., Vanathi, P.: A review of vector quantization techniques. IEEE Potentials 25(4), 39–47 (2006)CrossRef
16.
Metadaten
Titel
A Fast Algorithm to Find Best Matching Units in Self-Organizing Maps
verfasst von
Yann Bernard
Nicolas Hueber
Bernard Girau
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-61616-8_66