Skip to main content
Erschienen in: Cluster Computing 3/2017

17.06.2017

Parallel high-dimensional multi-objective feature selection for EEG classification with dynamic workload balancing on CPU–GPU architectures

verfasst von: Juan José Escobar, Julio Ortega, Jesús González, Miguel Damas, Antonio F. Díaz

Erschienen in: Cluster Computing | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Many bioinformatics applications that analyse large volumes of high-dimensional data comprise complex problems requiring metaheuristics approaches with different types of implicit parallelism. For example, although functional parallelism would be used to accelerate evolutionary algorithms, the fitness evaluation of the population could imply the computation of cost functions with data parallelism. This way, heterogeneous parallel architectures, including central processing unit (CPU) microprocessors with multiple superscalar cores and accelerators such as graphics processing units (GPUs) could be very useful. This paper aims to take advantage of such CPU–GPU heterogeneous architectures to accelerate electroencephalogram classification and feature selection problems by evolutionary multi-objective optimization, in the context of brain computing interface tasks. In this paper, we have used the OpenCL framework to develop parallel master-worker codes implementing an evolutionary multi-objective feature selection procedure in which the individuals of the population are dynamically distributed among the available CPU and GPU cores.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Rupp, R., Kleih, S., Leeb, R., Millan, J., Knbler, A., Mnller-Putz, G.: Brain-computer interfaces and assistive technology. In: Grnbler, G., Hildt, E. (eds.) Brain-Computer-Interfaces in their Ethical, Social and Cultural Contexts. The International Library of Ethics, Law and Technology, pp. 7–38. Springer, New York (2014) Rupp, R., Kleih, S., Leeb, R., Millan, J., Knbler, A., Mnller-Putz, G.: Brain-computer interfaces and assistive technology. In: Grnbler, G., Hildt, E. (eds.) Brain-Computer-Interfaces in their Ethical, Social and Cultural Contexts. The International Library of Ethics, Law and Technology, pp. 7–38. Springer, New York (2014)
2.
Zurück zum Zitat Collet, P.: Why gpgpus for evolutionary computation? In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 3–14. Springer, New York (2013)CrossRef Collet, P.: Why gpgpus for evolutionary computation? In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 3–14. Springer, New York (2013)CrossRef
3.
Zurück zum Zitat Luong, T., Melab, N., Talbi, E.G.: Gpu-based island model for evolutionary algorithms. In: Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation. pp. 1089–1096. GECCO’2010, ACM, Portland, OR (2010) Luong, T., Melab, N., Talbi, E.G.: Gpu-based island model for evolutionary algorithms. In: Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation. pp. 1089–1096. GECCO’2010, ACM, Portland, OR (2010)
4.
Zurück zum Zitat Alba, E., Luque, G., Nesmachnow, S.: Parallel metaheuristics: recent advances and new trends. Int. Trans. Oper. Res. 20(1), 1–48 (2013)CrossRefMATH Alba, E., Luque, G., Nesmachnow, S.: Parallel metaheuristics: recent advances and new trends. Int. Trans. Oper. Res. 20(1), 1–48 (2013)CrossRefMATH
5.
Zurück zum Zitat Pospichal, P., Jaros, J., Schwarz, J.: Parallel genetic algorithm on the cuda architecture. In: Di Chio, C., Cagnoni, S., Cotta, C., Ebner, M., Ekárt, A., Esparcia-Alcazar, A., Goh, C.K., Merelo, J., Neri, F., Preuß, M., Togelius, J., Yannakakis, G. (eds.) Proceedings of the 13th European Conference on the Applications of Evolutionary Computation, pp. 442–451. EvoApplications’2010, Springer, Istambul, Turkey (2010) Pospichal, P., Jaros, J., Schwarz, J.: Parallel genetic algorithm on the cuda architecture. In: Di Chio, C., Cagnoni, S., Cotta, C., Ebner, M., Ekárt, A., Esparcia-Alcazar, A., Goh, C.K., Merelo, J., Neri, F., Preuß, M., Togelius, J., Yannakakis, G. (eds.) Proceedings of the 13th European Conference on the Applications of Evolutionary Computation, pp. 442–451. EvoApplications’2010, Springer, Istambul, Turkey (2010)
6.
Zurück zum Zitat Escobar, J., Ortega, J., González, J., Damas, M.: Assessing parallel heterogeneous computer architectures for multiobjective feature selection on eeg classification. In: Ortuño, F., Rojas, I. (eds.) Proceedings of the 4th International Conference on Bioinformatics and Biomedical Engineering, pp. 277–289. IWBBIO’2016, Springer, Granada (2016) Escobar, J., Ortega, J., González, J., Damas, M.: Assessing parallel heterogeneous computer architectures for multiobjective feature selection on eeg classification. In: Ortuño, F., Rojas, I. (eds.) Proceedings of the 4th International Conference on Bioinformatics and Biomedical Engineering, pp. 277–289. IWBBIO’2016, Springer, Granada (2016)
7.
Zurück zum Zitat Escobar, J., Ortega, J., González, J., Damas, M.: Improving memory accesses for heterogeneous parallel multi-objective feature selection on eeg classification. In: Proceedings of the 4th International Workshop on Parallelism in Bioinformatics. PBIO’2016, Springer, Grenoble (2016) Escobar, J., Ortega, J., González, J., Damas, M.: Improving memory accesses for heterogeneous parallel multi-objective feature selection on eeg classification. In: Proceedings of the 4th International Workshop on Parallelism in Bioinformatics. PBIO’2016, Springer, Grenoble (2016)
8.
Zurück zum Zitat Bellman, R.: Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton (1961)CrossRefMATH Bellman, R.: Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton (1961)CrossRefMATH
9.
Zurück zum Zitat Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)MATH Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)MATH
10.
Zurück zum Zitat Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., Coello Coello, C.: A survey of multiobjective evolutionary algorithms for data mining: Part i. IEEE Trans. Evol. Comput. 18(1), 4–19 (2014)CrossRef Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., Coello Coello, C.: A survey of multiobjective evolutionary algorithms for data mining: Part i. IEEE Trans. Evol. Comput. 18(1), 4–19 (2014)CrossRef
11.
Zurück zum Zitat Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., Coello Coello, C.: A survey of multiobjective evolutionary algorithms for data mining: Part ii. IEEE Trans. Evol. Comput. 18(1), 20–35 (2014)CrossRef Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S., Coello Coello, C.: A survey of multiobjective evolutionary algorithms for data mining: Part ii. IEEE Trans. Evol. Comput. 18(1), 20–35 (2014)CrossRef
12.
Zurück zum Zitat Emmanouilidis, C., Hunter, A., MacIntyre, J.: A multiobjective evolutionary setting for feature selection and a commonality-based crossover operator. In: Proceedings of the 2000 Congress on Evolutionary Computation. CEC’2000, vol. 1, pp. 309–316. IEEE, La Jolla, CA (2000) Emmanouilidis, C., Hunter, A., MacIntyre, J.: A multiobjective evolutionary setting for feature selection and a commonality-based crossover operator. In: Proceedings of the 2000 Congress on Evolutionary Computation. CEC’2000, vol. 1, pp. 309–316. IEEE, La Jolla, CA (2000)
13.
Zurück zum Zitat Handl, J., Knowles, J.: Feature subset selection in unsupervised learning via multiobjective optimization. Int. J. Comput. Intell. Res. 2(3), 217–238 (2006)MathSciNetCrossRef Handl, J., Knowles, J.: Feature subset selection in unsupervised learning via multiobjective optimization. Int. J. Comput. Intell. Res. 2(3), 217–238 (2006)MathSciNetCrossRef
14.
Zurück zum Zitat Morita, M., Sabourin, R., Bortolozzi, F., Suen, C.: Unsupervised feature selection using multi-objective genetic algorithms for handwritten word recognition. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition, pp. 666–670. ICDAR’2013, IEEE (2003) Morita, M., Sabourin, R., Bortolozzi, F., Suen, C.: Unsupervised feature selection using multi-objective genetic algorithms for handwritten word recognition. In: Proceedings of the Seventh International Conference on Document Analysis and Recognition, pp. 666–670. ICDAR’2013, IEEE (2003)
15.
Zurück zum Zitat Arbelaitz, O., Gurrutxaga, I., Muguerza, J., PTrez, J., Perona, I.: An extensive comparative study of cluster validity indices. Pattern Recognit. 46(1), 243–256 (2013)CrossRef Arbelaitz, O., Gurrutxaga, I., Muguerza, J., PTrez, J., Perona, I.: An extensive comparative study of cluster validity indices. Pattern Recognit. 46(1), 243–256 (2013)CrossRef
16.
Zurück zum Zitat Kimovski, D., Ortega, J., Ortiz, A., Baños, R.: Leveraging cooperation for parallel multi-objective feature selection in high-dimensional eeg data. Concurr. Comput. Pract. Exp. 27(18), 5476–5499 (2015)CrossRef Kimovski, D., Ortega, J., Ortiz, A., Baños, R.: Leveraging cooperation for parallel multi-objective feature selection in high-dimensional eeg data. Concurr. Comput. Pract. Exp. 27(18), 5476–5499 (2015)CrossRef
19.
Zurück zum Zitat Gunarathne, T., Salpitikorala, B., Chauhan, A., Fox, G.: Optimizing opencl kernels for iterative statistical algorithms on gpus. In: Proceedings of the Second International Workshop on GPUs and Scientific Applications, pp. 33–44. GPUScA’2011, Galveston Island, TX (2011) Gunarathne, T., Salpitikorala, B., Chauhan, A., Fox, G.: Optimizing opencl kernels for iterative statistical algorithms on gpus. In: Proceedings of the Second International Workshop on GPUs and Scientific Applications, pp. 33–44. GPUScA’2011, Galveston Island, TX (2011)
20.
Zurück zum Zitat Dhanasekaran, B., Rubin, N.: A new method for gpu based irregular reductions and its application to k-means clustering. In: Proceedings of the Fourth Workshop on General Purpose Processing on Graphics Processing Units, pp. 729–737. GPGPU-4, ACM, Newport Beach, California (2011) Dhanasekaran, B., Rubin, N.: A new method for gpu based irregular reductions and its application to k-means clustering. In: Proceedings of the Fourth Workshop on General Purpose Processing on Graphics Processing Units, pp. 729–737. GPGPU-4, ACM, Newport Beach, California (2011)
21.
Zurück zum Zitat Asensio-Cubero, J., Gan, J., Palaniappan, R.: Multiresolution analysis over simple graphs for brain computer interfaces. J. Neural Eng. 10(4), 046014 (2013)CrossRef Asensio-Cubero, J., Gan, J., Palaniappan, R.: Multiresolution analysis over simple graphs for brain computer interfaces. J. Neural Eng. 10(4), 046014 (2013)CrossRef
22.
Zurück zum Zitat Daubechies, I.: Ten Lectures on Wavelets. Society for Industrial and Applied Mathematics, Philadelphia, PA (1992)CrossRefMATH Daubechies, I.: Ten Lectures on Wavelets. Society for Industrial and Applied Mathematics, Philadelphia, PA (1992)CrossRefMATH
23.
Zurück zum Zitat Deb, K., Agrawal, S., Pratap, A., Meyarivan, T.: A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: Nsga-ii. In: Proceedings of the 6th International Conference on Parallel Problem Solving from Nature. pp. 849–858. PPSN VI, Springer, Paris (2000) Deb, K., Agrawal, S., Pratap, A., Meyarivan, T.: A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: Nsga-ii. In: Proceedings of the 6th International Conference on Parallel Problem Solving from Nature. pp. 849–858. PPSN VI, Springer, Paris (2000)
27.
Zurück zum Zitat Jian, L., Wang, C., Liu, Y., Liang, S., Yi, W., Shi, Y.: Parallel data mining techniques on graphics processing unit with compute unified device architecture (cuda). J. Supercomput. 64(3), 942–967 (2013)CrossRef Jian, L., Wang, C., Liu, Y., Liang, S., Yi, W., Shi, Y.: Parallel data mining techniques on graphics processing unit with compute unified device architecture (cuda). J. Supercomput. 64(3), 942–967 (2013)CrossRef
28.
Zurück zum Zitat Gainaru, A., Slusanschi, E., Trausan-Matu, S.: Mapping data mining algorithms on a gpu architecture: A study. In: Kryszkiewicz, M., Rybinski, H., Skowron, A., Raś, Z.W. (eds.) Proceedings of the 19th International Symposium. Foundations of Intelligent Systems, pp. 102–112. ISMIS’2011, Springer Berlin Heidelberg, Warsaw (2011) Gainaru, A., Slusanschi, E., Trausan-Matu, S.: Mapping data mining algorithms on a gpu architecture: A study. In: Kryszkiewicz, M., Rybinski, H., Skowron, A., Raś, Z.W. (eds.) Proceedings of the 19th International Symposium. Foundations of Intelligent Systems, pp. 102–112. ISMIS’2011, Springer Berlin Heidelberg, Warsaw (2011)
29.
Zurück zum Zitat Hestness, J., Keckler, S., Wood, D.: Gpu computing pipeline inefficiencies and optimization opportunities in heterogeneous cpu-gpu processors. In: Proceedings of the 2015 IEEE International Symposium on Workload Characterization. pp. 87–97. IISWC’15, IEEE Computer Society, Atlanta, GA (2015) Hestness, J., Keckler, S., Wood, D.: Gpu computing pipeline inefficiencies and optimization opportunities in heterogeneous cpu-gpu processors. In: Proceedings of the 2015 IEEE International Symposium on Workload Characterization. pp. 87–97. IISWC’15, IEEE Computer Society, Atlanta, GA (2015)
30.
Zurück zum Zitat Sharma, D., Collet, P.: Implementation techniques for massively parallel multi-objective optimization. In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 267–286. Springer, New York (2013)CrossRef Sharma, D., Collet, P.: Implementation techniques for massively parallel multi-objective optimization. In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 267–286. Springer, New York (2013)CrossRef
31.
Zurück zum Zitat Wong, M., Cui, G.: Data mining using parallel multi-objective evolutionary algorithms on graphics processing units. In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 287–307. Springer, New York (2013)CrossRef Wong, M., Cui, G.: Data mining using parallel multi-objective evolutionary algorithms on graphics processing units. In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 287–307. Springer, New York (2013)CrossRef
32.
Zurück zum Zitat Baramkar, P., Kulkarni, D.: Review for k-means on graphics processing units (gpu). Int. J. Eng. Res. Technol. 3(6), 1911–1914 (2014) Baramkar, P., Kulkarni, D.: Review for k-means on graphics processing units (gpu). Int. J. Eng. Res. Technol. 3(6), 1911–1914 (2014)
33.
Zurück zum Zitat Kijsipongse, E., U-ruekolan, S.: Dynamic load balancing on gpu clusters for large-scale k-means clustering. In: Proceedings of the 9th International Joint Conference on Computer Science and Software Engineering, pp. 346–350. JCSSE’2012, Bangkok (2012) Kijsipongse, E., U-ruekolan, S.: Dynamic load balancing on gpu clusters for large-scale k-means clustering. In: Proceedings of the 9th International Joint Conference on Computer Science and Software Engineering, pp. 346–350. JCSSE’2012, Bangkok (2012)
34.
Zurück zum Zitat Farivar, F., Rebolledo, D., Chan, E., Campbell, R.: A parallel implementation of k-means clustering on gpus. In: Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, pp. 340–345. PDPTA’08, Las Vegas, Nevada (2008) Farivar, F., Rebolledo, D., Chan, E., Campbell, R.: A parallel implementation of k-means clustering on gpus. In: Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, pp. 340–345. PDPTA’08, Las Vegas, Nevada (2008)
35.
Zurück zum Zitat Wu, R., Zhang, B., Hsu, M.: Clustering billions of data points using gpus. In: Hast, A., Buchty, R., Tao, J., Weidendorfer, J. (eds.) Proceedings of the Combined Workshops on UnConventional High Performance Computing workshop plus Memory Access Workshop. pp. 1–6. UCHPC-MAW’09, ACM, Ischia (2009) Wu, R., Zhang, B., Hsu, M.: Clustering billions of data points using gpus. In: Hast, A., Buchty, R., Tao, J., Weidendorfer, J. (eds.) Proceedings of the Combined Workshops on UnConventional High Performance Computing workshop plus Memory Access Workshop. pp. 1–6. UCHPC-MAW’09, ACM, Ischia (2009)
36.
Zurück zum Zitat Zechner, M., Granitzer, M.: Accelerating k-means on the graphics processor via cuda. In: Proceedings of the First International Conference on Intensive Applications and Services, pp. 7–15. INTENSIVE’09, IEEE, Valencia (2009) Zechner, M., Granitzer, M.: Accelerating k-means on the graphics processor via cuda. In: Proceedings of the First International Conference on Intensive Applications and Services, pp. 7–15. INTENSIVE’09, IEEE, Valencia (2009)
37.
Zurück zum Zitat Fazendeiro, P., Padole, C., Sequeira, P., Prata, P.: Opencl implementations of a genetic algorithm for feature selection in periocular biometric recognition. In: Panigrahi, B., Das, S., Suganthan, P., Nanda, P. (eds.) Third International Conference on Swarm, Evolutionary and Memetic Computing, pp. 729–737. SEMCCO’2012, Springer, Bhubaneswar (2012) Fazendeiro, P., Padole, C., Sequeira, P., Prata, P.: Opencl implementations of a genetic algorithm for feature selection in periocular biometric recognition. In: Panigrahi, B., Das, S., Suganthan, P., Nanda, P. (eds.) Third International Conference on Swarm, Evolutionary and Memetic Computing, pp. 729–737. SEMCCO’2012, Springer, Bhubaneswar (2012)
Metadaten
Titel
Parallel high-dimensional multi-objective feature selection for EEG classification with dynamic workload balancing on CPU–GPU architectures
verfasst von
Juan José Escobar
Julio Ortega
Jesús González
Miguel Damas
Antonio F. Díaz
Publikationsdatum
17.06.2017
Verlag
Springer US
Erschienen in
Cluster Computing / Ausgabe 3/2017
Print ISSN: 1386-7857
Elektronische ISSN: 1573-7543
DOI
https://doi.org/10.1007/s10586-017-0980-7

Weitere Artikel der Ausgabe 3/2017

Cluster Computing 3/2017 Zur Ausgabe