Skip to main content

2015 | OriginalPaper | Buchkapitel

A Straightforward Implementation of a GPU-accelerated ELM in R with NVIDIA Graphic Cards

verfasst von : M. Alia-Martinez, J. Antonanzas, F. Antonanzas-Torres, A. Pernía-Espinoza, R. Urraca

Erschienen in: Hybrid Artificial Intelligent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

General purpose computing on graphics processing units (GPGPU) is a promising technique to cope with nowadays arising computational challenges due to the suitability of GPUs for parallel processing. Several libraries and functions are being released to boost the use of GPUs in real world problems. However, many of these packages require a deep knowledge in GPUs’ architecture and in low-level programming. As a result, end users find trouble in exploiting GPGPU advantages. In this paper, we focus on the GPU-acceleration of a prediction technique specially designed to deal with big datasets: the extreme learning machine (ELM). The intent of this study is to develop a user-friendly library in the open source R language and subsequently release the code in https://​github.​com/​maaliam/​EDMANS-elmNN-GPU.​git. Therefore R users can freely implement it with the only requirement of having a NVIDIA graphic card. The most computationally demanding operations were identified by performing a sensitivity analysis. As a result, only matrix multiplications were executed in the GPU as they take around 99 % of total execution time. A speedup rate up to 15 times was obtained with this GPU-accelerated ELM in the most computationally expensive scenarios. Moreover, the applicability of the GPU-accelerated ELM was also tested with a typical case of model selection, in which genetic algorithms were used to fine-tune an ELM and training thousands of models is required. In this case, still a speedup of 6 times was obtained.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hashem, I.A.T., Yaqoob, I., Anuar, N.B., Mokhtar, S., Gani, A., Ullah Khan, S.: The rise of “big data” on cloud computing: review and open research issues. Inf. Syst. 47, 98–115 (2015)CrossRef Hashem, I.A.T., Yaqoob, I., Anuar, N.B., Mokhtar, S., Gani, A., Ullah Khan, S.: The rise of “big data” on cloud computing: review and open research issues. Inf. Syst. 47, 98–115 (2015)CrossRef
2.
Zurück zum Zitat Chyzhyk, D., Savio, A., Graña, M.: Evolutionary ELM wrapper feature selection for alzheimer’s disease CAD on anatomical brain MRI. Neurocomputing 128, 73–80 (2014)CrossRef Chyzhyk, D., Savio, A., Graña, M.: Evolutionary ELM wrapper feature selection for alzheimer’s disease CAD on anatomical brain MRI. Neurocomputing 128, 73–80 (2014)CrossRef
3.
Zurück zum Zitat Peddie, J.: The new visualization engine - the heterogeneous processor unit. In: Dill, J., Earnshaw, R., Kasik, D., Vince, J., Wong, P.C. (eds.) Expanding The Frontiers Of Visual Analytics And Visualization, pp. 377–396. Springer International Publishing, London (2012)CrossRef Peddie, J.: The new visualization engine - the heterogeneous processor unit. In: Dill, J., Earnshaw, R., Kasik, D., Vince, J., Wong, P.C. (eds.) Expanding The Frontiers Of Visual Analytics And Visualization, pp. 377–396. Springer International Publishing, London (2012)CrossRef
4.
Zurück zum Zitat Urraca, R., Antonanzas, J., Martinez-de Pison, F.J., Antonanzas-Torres, F.: Estimation of solar global irradiation in remote areas. J. Renew. Sustain. Energy (In Press) Urraca, R., Antonanzas, J., Martinez-de Pison, F.J., Antonanzas-Torres, F.: Estimation of solar global irradiation in remote areas. J. Renew. Sustain. Energy (In Press)
5.
Zurück zum Zitat van Heeswijk, M., Miche, Y., Oja, E., Lendasse, A.: GPU-accelerated and parallelized ELM ensembles for large-scale regression. Neurocomputing 74(16), 2430–2437 (2011)CrossRef van Heeswijk, M., Miche, Y., Oja, E., Lendasse, A.: GPU-accelerated and parallelized ELM ensembles for large-scale regression. Neurocomputing 74(16), 2430–2437 (2011)CrossRef
6.
Zurück zum Zitat Team, R.C.: R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria (2014) Team, R.C.: R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria (2014)
7.
Zurück zum Zitat Buckner, J., Wilson, J., Seligman, M., Athey, B., Watson, S., Meng, F.: The gputools package enables GPU computing in R. Bioinformatics 26(1), 134–135 (2010)CrossRef Buckner, J., Wilson, J., Seligman, M., Athey, B., Watson, S., Meng, F.: The gputools package enables GPU computing in R. Bioinformatics 26(1), 134–135 (2010)CrossRef
8.
Zurück zum Zitat Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70, 489–501 (2006)CrossRef Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70, 489–501 (2006)CrossRef
9.
Zurück zum Zitat Salcedo-Sanz, S., Casanova-Mateo, C., Pastor-Sanchez, A., Giron, M.S.: Daily global solar radiation prediction based on a hybrid coral reefs optimization - extreme learning machine approach. Sol. Energy 105, 91–98 (2014)CrossRef Salcedo-Sanz, S., Casanova-Mateo, C., Pastor-Sanchez, A., Giron, M.S.: Daily global solar radiation prediction based on a hybrid coral reefs optimization - extreme learning machine approach. Sol. Energy 105, 91–98 (2014)CrossRef
10.
Zurück zum Zitat Huang, G.B.: Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern.-Part B: Cybern. 42(2), 513–529 (2012)CrossRef Huang, G.B.: Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern.-Part B: Cybern. 42(2), 513–529 (2012)CrossRef
11.
Zurück zum Zitat Gosso, A.: elmNN: Implementation of ELM (Extreme Learning Machine) algorithm for SLFN (Single Hidden Layer Feedforward Neural Networks). R package version 1.3 (2012) Gosso, A.: elmNN: Implementation of ELM (Extreme Learning Machine) algorithm for SLFN (Single Hidden Layer Feedforward Neural Networks). R package version 1.3 (2012)
12.
Zurück zum Zitat Urraca-Valle, R., Sodupe-Ortega, E., Antoñanzas Torres, J., Antoñanzas-Torres, F., Martínez-de-Pisón, F.J.: An overall performance comparative of GA-PARSIMONY methodology with regression algorithms. In: de la Puerta, J.G., Ferreira, I.G., Bringas, P.G., Klett, F., Abraham, A., de Carvalho, A.C.P.L.F., Herrero, A., Baruque, B., Quintián, H., Corchado, E. (eds.) International Joint Conference SOCO’14-CISIS’14-ICEUTE’14. AISC, vol. 299, pp. 53–62. Springer, Heidelberg (2014) CrossRef Urraca-Valle, R., Sodupe-Ortega, E., Antoñanzas Torres, J., Antoñanzas-Torres, F., Martínez-de-Pisón, F.J.: An overall performance comparative of GA-PARSIMONY methodology with regression algorithms. In: de la Puerta, J.G., Ferreira, I.G., Bringas, P.G., Klett, F., Abraham, A., de Carvalho, A.C.P.L.F., Herrero, A., Baruque, B., Quintián, H., Corchado, E. (eds.) International Joint Conference SOCO’14-CISIS’14-ICEUTE’14. AISC, vol. 299, pp. 53–62. Springer, Heidelberg (2014) CrossRef
13.
Zurück zum Zitat Ye, J.: On measuring and correcting the effects of data mining and model selection. J. Am. Stat. Assoc. 93(441), 120–131 (1998)CrossRefMATH Ye, J.: On measuring and correcting the effects of data mining and model selection. J. Am. Stat. Assoc. 93(441), 120–131 (1998)CrossRefMATH
14.
Zurück zum Zitat Seni, G., Elder, J.: Ensembe Methods In Data Mining. Improving Accuracy Through Combining Predictions. Morgan & Claypool, Chicago (2010) Seni, G., Elder, J.: Ensembe Methods In Data Mining. Improving Accuracy Through Combining Predictions. Morgan & Claypool, Chicago (2010)
Metadaten
Titel
A Straightforward Implementation of a GPU-accelerated ELM in R with NVIDIA Graphic Cards
verfasst von
M. Alia-Martinez
J. Antonanzas
F. Antonanzas-Torres
A. Pernía-Espinoza
R. Urraca
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-19644-2_54