Skip to main content

2014 | OriginalPaper | Buchkapitel

6. A Multi-Signal Variant for the GPU-Based Parallelization of Growing Self-Organizing Networks

verfasst von : Giacomo Parigi, Angelo Stramieri, Danilo Pau, Marco Piastra

Erschienen in: Informatics in Control, Automation and Robotics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Among the many possible approaches for the parallelization of self-organizing networks, and in particular of growing self-organizing networks, perhaps the most common one is producing an optimized, parallel implementation of the standard sequential algorithms reported in the literature. In this chapter we explore an alternative approach, based on a new algorithm variant specifically designed to match the features of the large-scale, fine-grained parallelism of GPUs, in which multiple input signals are processed at once. Comparative tests have been performed, using both parallel and sequential implementations of the new algorithm variant, in particular for a growing self-organizing network that reconstructs surfaces from point clouds. The experimental results show that this approach allows harnessing in a more effective way the intrinsic parallelism that the self-organizing networks algorithms seem intuitively to suggest, obtaining better performances even with networks of smaller size.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
An aging mechanism is also applied to connections (see for instance [9]).
 
Literatur
1.
Zurück zum Zitat Piastra, M.: Self-organizing adaptive map: autonomous learning of curves and surfaces from point samples. Neural Netw. 41, 96–112 (2012)CrossRef Piastra, M.: Self-organizing adaptive map: autonomous learning of curves and surfaces from point samples. Neural Netw. 41, 96–112 (2012)CrossRef
2.
Zurück zum Zitat Lawrence, R., Almasi, G., Rushmeier, H.: A scalable parallel algorithm for self-organizing maps with applications to sparse data mining problems. Data Min. Knowl. Disc. 3, 171–195 (1999)CrossRef Lawrence, R., Almasi, G., Rushmeier, H.: A scalable parallel algorithm for self-organizing maps with applications to sparse data mining problems. Data Min. Knowl. Disc. 3, 171–195 (1999)CrossRef
3.
Zurück zum Zitat Kohonen, T.: Self-Organizing Maps. Springer series in information sciences, vol. 30. Springer, Berlin (2001) Kohonen, T.: Self-Organizing Maps. Springer series in information  sciences, vol. 30. Springer, Berlin (2001)
4.
Zurück zum Zitat Orts, S., Garcia-Rodriguez, J., Viejo, D., Cazorla, M., Morell, V.: Gpgpu implementation of growing neural gas: application to 3d scene reconstruction. J. Parallel Distrib. Comput. 72(10), 1361–1372 (2012)CrossRef Orts, S., Garcia-Rodriguez, J., Viejo, D., Cazorla, M., Morell, V.: Gpgpu implementation of growing neural gas: application to 3d scene reconstruction. J. Parallel Distrib. Comput. 72(10), 1361–1372 (2012)CrossRef
5.
Zurück zum Zitat García-Rodríguez, J., Angelopoulou, A., Morell, V., Orts, S., Psarrou, A., García-Chamizo, J.: Fast image representation with gpu-based growing neural gas. Adv. Comput. Intell., Lect. Notes Comput. Sci 6692, 58–65 (2011)CrossRef García-Rodríguez, J., Angelopoulou, A., Morell, V., Orts, S., Psarrou, A., García-Chamizo, J.: Fast image representation with gpu-based growing neural gas. Adv. Comput. Intell., Lect. Notes Comput. Sci 6692, 58–65 (2011)CrossRef
6.
Zurück zum Zitat Luo, Z., Liu, H., Wu, X.: Artificial neural network computation on graphic process unit. In: Proceedings of the IEEE International Joint Conference on Neural Networks, IJCNN’05. IEEE 2005, vol. 1, pp. 622–626 (2005) Luo, Z., Liu, H., Wu, X.: Artificial neural network computation on graphic process unit. In: Proceedings of the IEEE International Joint Conference on Neural Networks, IJCNN’05. IEEE 2005, vol. 1, pp. 622–626 (2005)
7.
Zurück zum Zitat Campbell, A., Berglund, E., Streit, A.: Graphics hardware implementation of the parameter-less self-organising map. In: Intelligent Data Engineering and Automated Learning-IDEAL 2005, pp. 5–14 (2005) Campbell, A., Berglund, E., Streit, A.: Graphics hardware implementation of the parameter-less self-organising map. In: Intelligent Data Engineering and Automated Learning-IDEAL 2005, pp. 5–14 (2005)
8.
Zurück zum Zitat Owens, J., Luebke, D., Govindaraju, N., Harris, M., Krüger, J., Lefohn, A., Purcell, T.: A survey of general-purpose computation on graphics hardware. Comput. Graphics Forum 26, 80–113 (2007) (Wiley Online Library) Owens, J., Luebke, D., Govindaraju, N., Harris, M., Krüger, J., Lefohn, A., Purcell, T.: A survey of general-purpose computation on graphics hardware. Comput. Graphics Forum 26, 80–113 (2007) (Wiley Online Library)
9.
Zurück zum Zitat Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems 7, MIT Press (1995) Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems 7, MIT Press (1995)
10.
Zurück zum Zitat Marsland, S., Shapiro, J., Nehmzow, U.: A self-organising network that grows when required. Neural Netw. 15, 1041–1058 (2002)CrossRef Marsland, S., Shapiro, J., Nehmzow, U.: A self-organising network that grows when required. Neural Netw. 15, 1041–1058 (2002)CrossRef
11.
Zurück zum Zitat Martinetz, T., Schulten, K.: Topology representing networks. Neural Netw. 7, 507–522 (1994)CrossRef Martinetz, T., Schulten, K.: Topology representing networks. Neural Netw. 7, 507–522 (1994)CrossRef
12.
Zurück zum Zitat Owens, J., Houston, M., Luebke, D., Green, S., Stone, J., Phillips, J.: Gpu computing. Proc. IEEE 96, 879–899 (2008)CrossRef Owens, J., Houston, M., Luebke, D., Green, S., Stone, J., Phillips, J.: Gpu computing. Proc. IEEE 96, 879–899 (2008)CrossRef
13.
Zurück zum Zitat McCool, M.: Data-parallel programming on the cell be and the gpu using the rapidmind development platform. In: GSPx Multicore Applications Conference. vol. 9. (2006) McCool, M.: Data-parallel programming on the cell be and the gpu using the rapidmind development platform. In: GSPx Multicore Applications Conference. vol. 9. (2006)
14.
Zurück zum Zitat Papakipos, M.: The Peakstream Platform: High-Productivity Software Development for Multi-Core Processors. PeakStream Inc., Redwood City (2007) Papakipos, M.: The Peakstream Platform: High-Productivity Software Development for Multi-Core Processors. PeakStream Inc., Redwood City (2007)
15.
Zurück zum Zitat NVIDIA Corporation: CUDA C programming guide, version 4.0. Santa Clara (2011) NVIDIA Corporation: CUDA C programming guide, version 4.0. Santa Clara (2011)
16.
Zurück zum Zitat Hensley, J.: AMD CTM overview. In: ACM SIGGRAPH 2007 courses, p. 7. ACM, New York (2007) Hensley, J.: AMD CTM overview. In: ACM SIGGRAPH 2007 courses, p. 7. ACM, New York (2007)
17.
Zurück zum Zitat Stone, J., Gohara, D., Shi, G.: Opencl: a parallel programming standard for heterogeneous computing systems. Comput. Sci. Eng. 12, 66 (2010)CrossRef Stone, J., Gohara, D., Shi, G.: Opencl: a parallel programming standard for heterogeneous computing systems. Comput. Sci. Eng. 12, 66 (2010)CrossRef
18.
Zurück zum Zitat Buck, I., Foley, T., Horn, D., Sugerman, J., Fatahalian, K., Houston, M., Hanrahan, P.: Brook for gpus: stream computing on graphics hardware. ACM Trans. Graph. 23, 777–786 (2004)CrossRef Buck, I., Foley, T., Horn, D., Sugerman, J., Fatahalian, K., Houston, M., Hanrahan, P.: Brook for gpus: stream computing on graphics hardware. ACM Trans. Graph. 23, 777–786 (2004)CrossRef
19.
Zurück zum Zitat Harris, M.: Optimizing parallel reduction in cuda. CUDA SDK Whitepaper (2007) Harris, M.: Optimizing parallel reduction in cuda. CUDA SDK Whitepaper (2007)
20.
Zurück zum Zitat Liu, S., Flach, P., Cristianini, N.: Generic multiplicative methods for implementing machine learning algorithms on mapreduce. Arxiv, preprint arXiv:1111.2111 (2011) Liu, S., Flach, P., Cristianini, N.: Generic multiplicative methods for implementing machine learning algorithms on mapreduce. Arxiv, preprint arXiv:1111.2111 (2011)
21.
Zurück zum Zitat Zhang, C., Li, F., Jestes, J.: Efficient parallel knn joins for large data in mapreduce. In: Proceedings of 15th International Conference on Extending Database Technology (EDBT 2012). (2012) Zhang, C., Li, F., Jestes, J.: Efficient parallel knn joins for large data in mapreduce. In: Proceedings of 15th International Conference on Extending Database Technology (EDBT 2012). (2012)
22.
Zurück zum Zitat Edelsbrunner, H.: GGeometry and topology for mesh generation. Cambridge Monographs on Applied and Computational Mathematics, vol. 7. Cambridge University Press, Cambridge (2001) Edelsbrunner, H.: GGeometry and topology for mesh generation. Cambridge Monographs on Applied and Computational Mathematics, vol. 7. Cambridge University Press, Cambridge (2001)
24.
Zurück zum Zitat Hockney, R.W., Eastwood, J.W.: Computer Simulation Using Particles. Taylor & Francis Inc., Bristol (1988)CrossRefMATH Hockney, R.W., Eastwood, J.W.: Computer Simulation Using Particles. Taylor & Francis Inc., Bristol (1988)CrossRefMATH
Metadaten
Titel
A Multi-Signal Variant for the GPU-Based Parallelization of Growing Self-Organizing Networks
verfasst von
Giacomo Parigi
Angelo Stramieri
Danilo Pau
Marco Piastra
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-03500-0_6

Neuer Inhalt