Skip to main content
Top

2019 | OriginalPaper | Chapter

Multi-class Support Vector Machine Training and Classification Based on MPI-GPU Hybrid Parallel Architecture

Authors : I. Elgarhy, H. Khaled, Rania El Gohary, H. M. Faheem

Published in: Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2018

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Machine Learning (ML) is the process of extracting knowledge from current information to enable machine to predict new information based on the learned knowledge. Many ML algorithms aim at improving the learning process. Support vector machine (SVM) is one of the best classifiers for hyper-spectral images. As many of the ML algorithms, SVM training require a high computational cost that considered a very large quadratic programming optimization problem. The proposed sequential minimal optimization solve the highly computational problems using a hybrid parallel model that employs both graphical processing unit to implement binary-classifier and message passing interface to solve multi-class on “one-against-one” method. Our hybrid implementation achieves a speed up of 40X over the sequential (LIBSVM), a speed up of 7.5X over the CUDA-OPENMP for training dataset of 44442 records and 102 features size for 9 classes and a speed up of 13.7X over LIBSVM in classification process for 60300 records.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference NVIDIA Corporation: NVIDIA CUDA C Programming Guide (2010) NVIDIA Corporation: NVIDIA CUDA C Programming Guide (2010)
2.
go back to reference Sanders, J., Kandrot, E.: CUDA by Example: An Introduction to General-Purpose GPU Programming, 1st edn. Addison-Wesley Professional, Reading (2010) Sanders, J., Kandrot, E.: CUDA by Example: An Introduction to General-Purpose GPU Programming, 1st edn. Addison-Wesley Professional, Reading (2010)
3.
go back to reference Khaled, H., Faheem, H.M., El-Gohary, R.: Design and implementation of a hybrid MPI-CUDA model for the Smith–Waterman algorithm. Int. J. Data Min. Bioinform. 12(3), 313–327 (2015)CrossRef Khaled, H., Faheem, H.M., El-Gohary, R.: Design and implementation of a hybrid MPI-CUDA model for the Smith–Waterman algorithm. Int. J. Data Min. Bioinform. 12(3), 313–327 (2015)CrossRef
4.
go back to reference Aoyama, Y., Nakano, J., et al.: Rs/6000 sp: Practical MPI Programming. IBM Poughkeepsie, New York (1999) Aoyama, Y., Nakano, J., et al.: Rs/6000 sp: Practical MPI Programming. IBM Poughkeepsie, New York (1999)
5.
go back to reference Catanzaro, B., Sundaram, N., Keutzer, K.: Fast support vector machine training and classification on graphics processors. In: Proceedings of the 25th International Conference on Machine Learning, pp. 104–111 (2008) Catanzaro, B., Sundaram, N., Keutzer, K.: Fast support vector machine training and classification on graphics processors. In: Proceedings of the 25th International Conference on Machine Learning, pp. 104–111 (2008)
6.
go back to reference Carlos, J., Ribeiro, B., Lopes, N.: Development of support vector machines (SVMs) in graphics processing units for pattern recognition (2012) Carlos, J., Ribeiro, B., Lopes, N.: Development of support vector machines (SVMs) in graphics processing units for pattern recognition (2012)
7.
go back to reference Lopes, N., Ribeiro, B.: GPU machine learning library (GPUMLib). In: 2015 Machine Learning for Adaptive Many-Core Machines - A Practical Approach. Springer, Cham, pp. 15–36 (2015) Lopes, N., Ribeiro, B.: GPU machine learning library (GPUMLib). In: 2015 Machine Learning for Adaptive Many-Core Machines - A Practical Approach. Springer, Cham, pp. 15–36 (2015)
8.
go back to reference Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27:1–27:27 (2011)CrossRef Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27:1–27:27 (2011)CrossRef
9.
go back to reference Keerthi, S.S., Shevade, S.K., Bhattacharyya, C., Murthy, K.R.K.: Improvements to Platt’s SMO algorithm for SVM classifier design. Neural Comput. 13(3), 637–649 (2001)CrossRef Keerthi, S.S., Shevade, S.K., Bhattacharyya, C., Murthy, K.R.K.: Improvements to Platt’s SMO algorithm for SVM classifier design. Neural Comput. 13(3), 637–649 (2001)CrossRef
10.
go back to reference Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH
11.
go back to reference Platt, J.: Sequential minimal optimization: a fast algorithm for training support vector machines (1998) Platt, J.: Sequential minimal optimization: a fast algorithm for training support vector machines (1998)
12.
go back to reference Fan, R.-E., Chen, P.-H., Lin, C.-J.: Working set selection using second order ınformation for training support vector machines. J. Mach. Learn. Res. 6, 1889–1918 (2005)MathSciNetMATH Fan, R.-E., Chen, P.-H., Lin, C.-J.: Working set selection using second order ınformation for training support vector machines. J. Mach. Learn. Res. 6, 1889–1918 (2005)MathSciNetMATH
13.
go back to reference Hsu, C.-W., Lin, C.-J.: A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Netw. 13(2), 415–425 (2002)CrossRef Hsu, C.-W., Lin, C.-J.: A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Netw. 13(2), 415–425 (2002)CrossRef
14.
go back to reference Goetz, A.F., Vane, G., Solomon, J.E., Rock, B.N.: Imaging spectrometry for earth remote sensing. Science 228, 1147–1153 (1985)CrossRef Goetz, A.F., Vane, G., Solomon, J.E., Rock, B.N.: Imaging spectrometry for earth remote sensing. Science 228, 1147–1153 (1985)CrossRef
15.
go back to reference Green, R.O., et al.: Imaging spectroscopy and the airborne visible/ınfrared ımaging spectrometer (AVIRIS). Remote Sens. Environ. 65(3), 227–248 (1998)CrossRef Green, R.O., et al.: Imaging spectroscopy and the airborne visible/ınfrared ımaging spectrometer (AVIRIS). Remote Sens. Environ. 65(3), 227–248 (1998)CrossRef
16.
go back to reference Tan, K., Zhang, J., Du, Q., Wang, X.: GPU parallel implementation of support vector machines for hyperspectral image classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8(10), 4647–4656 (2015)CrossRef Tan, K., Zhang, J., Du, Q., Wang, X.: GPU parallel implementation of support vector machines for hyperspectral image classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8(10), 4647–4656 (2015)CrossRef
Metadata
Title
Multi-class Support Vector Machine Training and Classification Based on MPI-GPU Hybrid Parallel Architecture
Authors
I. Elgarhy
H. Khaled
Rania El Gohary
H. M. Faheem
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-319-99010-1_16

Premium Partner