Skip to main content
Erschienen in: Neural Computing and Applications 7/2011

01.10.2011 | ICONIP2009

A GPU implementation for LBG and SOM training

verfasst von: Yi Xiao, Chi Sing Leung, Tze-Yui Ho, Ping-Man Lam

Erschienen in: Neural Computing and Applications | Ausgabe 7/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Vector quantization (VQ) is an effective technique applicable in a wide range of areas, such as image compression and pattern recognition. The most time-consuming procedure of VQ is codebook training, and two of the frequently used training algorithms are LBG and self-organizing map (SOM). Nowadays, desktop computers are usually equipped with programmable graphics processing units (GPUs), whose parallel data-processing ability is ideal for codebook training acceleration. Although there are some GPU algorithms for LBG training, their implementations suffer from a large amount of data transfer between CPU and GPU and a large number of rendering passes within a training iteration. This paper presents a novel GPU-based training implementation for LBG and SOM training. More specifically, we utilize the random write ability of vertex shader to reduce the overheads mentioned above. Our experimental results show that our approach can run four times faster than the previous approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
In fact, we do not need to swap the contents of the two sets of textures. We only need to swap their texture IDs.
 
Literatur
1.
Zurück zum Zitat Linde Y, Buzo A, Gray RM (1980) An algorithm for vector quantizer design. IEEE Trans Commun 28(1):84–95CrossRef Linde Y, Buzo A, Gray RM (1980) An algorithm for vector quantizer design. IEEE Trans Commun 28(1):84–95CrossRef
2.
Zurück zum Zitat Gray RM (1984) Vector quantization. IEEE Acoust Speech Signal Process Mag 1(1):4–29 Gray RM (1984) Vector quantization. IEEE Acoust Speech Signal Process Mag 1(1):4–29
3.
Zurück zum Zitat Gersho A, Gray RM (1991) Vector quantization and signal compression. Kluwer, Norwell Gersho A, Gray RM (1991) Vector quantization and signal compression. Kluwer, Norwell
4.
Zurück zum Zitat Lu Z-M, Xu D-G, Sun S-H (2000) Multipurpose image watermarking algorithm based on multistage vector quantization. IEEE Trans Image Process 14(6):822–831 Lu Z-M, Xu D-G, Sun S-H (2000) Multipurpose image watermarking algorithm based on multistage vector quantization. IEEE Trans Image Process 14(6):822–831
5.
Zurück zum Zitat Tsang PWM, Tsang WH (1996) Preservation of interlaced patterns in encoding video signals using side match vector quantization smoothing regularization of MLP for Jacobian stabilization. IEEE Trans Consu Electron 42(1):112–120MathSciNetCrossRef Tsang PWM, Tsang WH (1996) Preservation of interlaced patterns in encoding video signals using side match vector quantization smoothing regularization of MLP for Jacobian stabilization. IEEE Trans Consu Electron 42(1):112–120MathSciNetCrossRef
6.
Zurück zum Zitat Mukherjee D, Chae JJ, Mitra SK, Manjunath BS (2000) A source and channel-coding framework for vector-based data hiding in video. IEEE Trans Circuits Syst Video Technol 10:630–645CrossRef Mukherjee D, Chae JJ, Mitra SK, Manjunath BS (2000) A source and channel-coding framework for vector-based data hiding in video. IEEE Trans Circuits Syst Video Technol 10:630–645CrossRef
7.
Zurück zum Zitat Sim J-Y, Lee S-U (2008) Compression of 3D point visual data using vector quantization and rate-distortion optimization. IEEE Trans Multimed 10(3):305–315CrossRef Sim J-Y, Lee S-U (2008) Compression of 3D point visual data using vector quantization and rate-distortion optimization. IEEE Trans Multimed 10(3):305–315CrossRef
8.
Zurück zum Zitat Pham T (2003) Alignment-free sequence comparison with vector quantization and hidden markov models. In CSB ’03: Proceedings of the IEEE computer society conference on bioinformatics, Washington, DC, USA, 2003, p 534, IEEE Computer Society Pham T (2003) Alignment-free sequence comparison with vector quantization and hidden markov models. In CSB ’03: Proceedings of the IEEE computer society conference on bioinformatics, Washington, DC, USA, 2003, p 534, IEEE Computer Society
9.
Zurück zum Zitat Ramasubramanian V, Paliwal KK (1992) Fast k-dimensional tree algorithms for nearest neighborsearch with application to vector quantization encoding. IEEE Trans Signal Process 40(3):518–531CrossRef Ramasubramanian V, Paliwal KK (1992) Fast k-dimensional tree algorithms for nearest neighborsearch with application to vector quantization encoding. IEEE Trans Signal Process 40(3):518–531CrossRef
10.
Zurück zum Zitat Laha A, Chanda B, Pal NR (2006) Accelerated codebook searching in a som-based vector quantizer. IJCNN 2006. 2006, pp 3306–3311 Laha A, Chanda B, Pal NR (2006) Accelerated codebook searching in a som-based vector quantizer. IJCNN 2006. 2006, pp 3306–3311
12.
Zurück zum Zitat Mark WR, Glanville RS, Akeley K, Kilgard MJ (2003) Cg: A system for programing graphics hardware in a C-like language. ACM Trans Graph 22(3):896–907CrossRef Mark WR, Glanville RS, Akeley K, Kilgard MJ (2003) Cg: A system for programing graphics hardware in a C-like language. ACM Trans Graph 22(3):896–907CrossRef
13.
Zurück zum Zitat Bolz J, Farmer I, Grinspun E, Schreoder P (2003) Sparse matrix solvers on the GPU: conjugate gradients and multigrid. ACM Trans Graph 22(3):917–924CrossRef Bolz J, Farmer I, Grinspun E, Schreoder P (2003) Sparse matrix solvers on the GPU: conjugate gradients and multigrid. ACM Trans Graph 22(3):917–924CrossRef
14.
Zurück zum Zitat Leung CS, Wong TT, Lam PM, Choy KH (2006) An RBF-based image compression method for image-based rendering. IEEE Trans Image Process 15(1):1031–1041CrossRef Leung CS, Wong TT, Lam PM, Choy KH (2006) An RBF-based image compression method for image-based rendering. IEEE Trans Image Process 15(1):1031–1041CrossRef
15.
Zurück zum Zitat Garcia A, Shen HW (2005) GPU-based 3d wavelet reconstruction with tileboarding. Vis Comput 21(8–10):755–763CrossRef Garcia A, Shen HW (2005) GPU-based 3d wavelet reconstruction with tileboarding. Vis Comput 21(8–10):755–763CrossRef
16.
Zurück zum Zitat Wong TT, Leung CS, Heng PA, Wang J (2007) Discrete wavelet transform on consumer-level graphics hardware. IEEE Trans Multimed 9(3):668–673CrossRef Wong TT, Leung CS, Heng PA, Wang J (2007) Discrete wavelet transform on consumer-level graphics hardware. IEEE Trans Multimed 9(3):668–673CrossRef
17.
Zurück zum Zitat Ho TY, Lam PM, Leung CS (2008) Parallelization of cellular neural networks on gpu. Pattern Recogn Lett 41(8):2684–2692MATH Ho TY, Lam PM, Leung CS (2008) Parallelization of cellular neural networks on gpu. Pattern Recogn Lett 41(8):2684–2692MATH
18.
Zurück zum Zitat Bohn CA (1998) Kohonen feature mapping through graphics hardware. In: Proceedings of 3rd international conference on computational intelligence and neurosciences, pp 64–67 Bohn CA (1998) Kohonen feature mapping through graphics hardware. In: Proceedings of 3rd international conference on computational intelligence and neurosciences, pp 64–67
19.
Zurück zum Zitat Takizawa H, Kobayashi H (2006) Hierarchical parallel processing of large scale data clustering on a pc cluster with gpu co-processing. J Supercomput 36:219–234CrossRef Takizawa H, Kobayashi H (2006) Hierarchical parallel processing of large scale data clustering on a pc cluster with gpu co-processing. J Supercomput 36:219–234CrossRef
20.
Zurück zum Zitat Togneri R, Lai E, Attikiouzel Y (1990) Kohonen’s algorithm for the numerical parametrisation of manifolds. Pattern Recognit Lett 11(5):313–319MATHCrossRef Togneri R, Lai E, Attikiouzel Y (1990) Kohonen’s algorithm for the numerical parametrisation of manifolds. Pattern Recognit Lett 11(5):313–319MATHCrossRef
21.
Zurück zum Zitat Leung CS, Chan LW (1997) Transmission of vector quantized data over a noisy channel. IEEE Trans Neural Netw 8(3):582–589CrossRef Leung CS, Chan LW (1997) Transmission of vector quantized data over a noisy channel. IEEE Trans Neural Netw 8(3):582–589CrossRef
22.
Zurück zum Zitat Leung CS, Chan LW (1999) Design of trellis vetor quantizers using kohonen maps. Neural Netw 12(6):907–914CrossRef Leung CS, Chan LW (1999) Design of trellis vetor quantizers using kohonen maps. Neural Netw 12(6):907–914CrossRef
Metadaten
Titel
A GPU implementation for LBG and SOM training
verfasst von
Yi Xiao
Chi Sing Leung
Tze-Yui Ho
Ping-Man Lam
Publikationsdatum
01.10.2011
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 7/2011
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-010-0403-7

Weitere Artikel der Ausgabe 7/2011

Neural Computing and Applications 7/2011 Zur Ausgabe