Skip to main content
Erschienen in: International Journal of Parallel Programming 6/2018

23.06.2017

Boosting the Hardware-Efficiency of Cascade Support Vector Machines for Embedded Classification Applications

verfasst von: Christos Kyrkou, Theocharis Theocharides, Christos-Savvas Bouganis, Marios Polycarpou

Erschienen in: International Journal of Parallel Programming | Ausgabe 6/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Support Vector Machines (SVMs) are considered as a state-of-the-art classification algorithm capable of high accuracy rates for a different range of applications. When arranged in a cascade structure, SVMs can efficiently handle problems where the majority of data belongs to one of the two classes, such as image object classification, and hence can provide speedups over monolithic (single) SVM classifiers. However, the SVM classification process is still computationally demanding due to the number of support vectors. Consequently, in this paper we propose a hardware architecture optimized for cascaded SVM processing to boost performance and hardware efficiency, along with a hardware reduction method in order to reduce the overheads from the implementation of additional stages in the cascade, leading to significant resource and power savings. The architecture was evaluated for the application of object detection on \(800\times 600\) resolution images on a Spartan 6 Industrial Video Processing FPGA platform achieving over 30 frames-per-second. Moreover, by utilizing the proposed hardware reduction method we were able to reduce the utilization of FPGA custom-logic resources by \(\sim \)30%, and simultaneously observed \(\sim \)20% peak power reduction compared to a baseline implementation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cortes, C., Vapnik, V.: Support-vector networks. J. Mach. Learn. 20(3), 273–297 (1995)MATH Cortes, C., Vapnik, V.: Support-vector networks. J. Mach. Learn. 20(3), 273–297 (1995)MATH
2.
Zurück zum Zitat Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov. 2, 121–167 (1998)CrossRef Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov. 2, 121–167 (1998)CrossRef
3.
Zurück zum Zitat Osuna, E., Freund, R., Firosi, F.: Training support vector machines: an application to face detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 130–136 (1997) Osuna, E., Freund, R., Firosi, F.: Training support vector machines: an application to face detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 130–136 (1997)
4.
Zurück zum Zitat Wu, J., Rehg, J.M.: Chapter 8 object detection. In: Ensemble Machine Learning: Methods and Applications, 1st ed., pp. 225–250. Springer-Verlag, New York (2012)CrossRef Wu, J., Rehg, J.M.: Chapter 8 object detection. In: Ensemble Machine Learning: Methods and Applications, 1st ed., pp. 225–250. Springer-Verlag, New York (2012)CrossRef
5.
Zurück zum Zitat Heisele, B., Serre, T., Prentice, S., Poggio, T.: Hierarchical classification and feature reduction for fast face detection with support vector machines. Pattern Recognit. 36(9), 2007–2017 (2003)CrossRef Heisele, B., Serre, T., Prentice, S., Poggio, T.: Hierarchical classification and feature reduction for fast face detection with support vector machines. Pattern Recognit. 36(9), 2007–2017 (2003)CrossRef
6.
Zurück zum Zitat Kukenys, I., McCane, B.: Classifier cascades for support vector machines. In: International Conference on Image and Vision Computing, pp. 1–6 (2008) Kukenys, I., McCane, B.: Classifier cascades for support vector machines. In: International Conference on Image and Vision Computing, pp. 1–6 (2008)
7.
Zurück zum Zitat Ma, Y., Ding, X.: Face Detection Based on Cost-Sensitive Support Vector Machines. In: First International Workshop on Pattern Recognition with Support Vector Machines, pp. 260–267 (2002)CrossRef Ma, Y., Ding, X.: Face Detection Based on Cost-Sensitive Support Vector Machines. In: First International Workshop on Pattern Recognition with Support Vector Machines, pp. 260–267 (2002)CrossRef
8.
Zurück zum Zitat Cadambi, S., et al.: A Massively Parallel FPGA-Based Coprocessor for Support Vector Machines. In: IEEE International Symposium on Field Programmable Custom Computing Machines (FCCM), pp. 115–122 (2009) Cadambi, S., et al.: A Massively Parallel FPGA-Based Coprocessor for Support Vector Machines. In: IEEE International Symposium on Field Programmable Custom Computing Machines (FCCM), pp. 115–122 (2009)
9.
Zurück zum Zitat Pina-Ramirez, O., Valdes-Cristerna, R., Yanez-Suarez, O.: An FPGA implementation of linear kernel support vector machines. In: IEEE International Conference on Reconfigurable Computing and FPGA’s, pp. 1–6 (2006) Pina-Ramirez, O., Valdes-Cristerna, R., Yanez-Suarez, O.: An FPGA implementation of linear kernel support vector machines. In: IEEE International Conference on Reconfigurable Computing and FPGA’s, pp. 1–6 (2006)
10.
Zurück zum Zitat Ruiz-Llata, M., Guarnizo, G., Yébenes-Calvino, M.: FPGA implementation of a support vector machine for classification and regression. In: International Conference on Neural Networks, pp. 1–5 (2010) Ruiz-Llata, M., Guarnizo, G., Yébenes-Calvino, M.: FPGA implementation of a support vector machine for classification and regression. In: International Conference on Neural Networks, pp. 1–5 (2010)
11.
Zurück zum Zitat Fowers, J., Brown G., Cooke, P., Stitt, G.: A performance and energy comparison of FPGAs, GPUs, and multicores for sliding-window applications. In: ACM/SIGDA International Symposium on Field Programmable Gate Arrays (FPGA ’12), pp. 47–56 (2012) Fowers, J., Brown G., Cooke, P., Stitt, G.: A performance and energy comparison of FPGAs, GPUs, and multicores for sliding-window applications. In: ACM/SIGDA International Symposium on Field Programmable Gate Arrays (FPGA ’12), pp. 47–56 (2012)
12.
Zurück zum Zitat Cooke, P., Fowers, J., Brown, G., Stitt G.: A Tradeoff Analysis of FPGAs, GPUs, and Multicores for Sliding-Window Applications. In: ACM Transactions on Reconfigurable Technology Systems, vol. 8, no. 1 (2015)CrossRef Cooke, P., Fowers, J., Brown, G., Stitt G.: A Tradeoff Analysis of FPGAs, GPUs, and Multicores for Sliding-Window Applications. In: ACM Transactions on Reconfigurable Technology Systems, vol. 8, no. 1 (2015)CrossRef
13.
Zurück zum Zitat Kyrkou, C., Bouganis, C.-S., Theocharides, T.: An Embedded Hardware-Efficient Architecture for Real-Time Cascade Support Vector Machine Classification. In: International Conference on Embedded Computer Systems (SAMOS), pp. 129–136 (2013) Kyrkou, C., Bouganis, C.-S., Theocharides, T.: An Embedded Hardware-Efficient Architecture for Real-Time Cascade Support Vector Machine Classification. In: International Conference on Embedded Computer Systems (SAMOS), pp. 129–136 (2013)
14.
Zurück zum Zitat Burges, C.J.C.: Simplified support vector decision rules. In: International Conference on Machine Learning, pp. 71–77 (1996) Burges, C.J.C.: Simplified support vector decision rules. In: International Conference on Machine Learning, pp. 71–77 (1996)
15.
Zurück zum Zitat Sahbi, H., Geman, D., Boujemaa, N.: Face detection using coarse-to-fine support vector classifiers. In: International Conference on Image Processing, pp. 925–928 (2001) Sahbi, H., Geman, D., Boujemaa, N.: Face detection using coarse-to-fine support vector classifiers. In: International Conference on Image Processing, pp. 925–928 (2001)
16.
Zurück zum Zitat Romdhani, S., Torr, P., Schölkopf, B., Blake, A.: Efficient face detection by a cascaded support-vector machine expansion. R. Soc. Lond. Proc. Ser. A 460(2051), 3283–3297 (2004)MathSciNetCrossRef Romdhani, S., Torr, P., Schölkopf, B., Blake, A.: Efficient face detection by a cascaded support-vector machine expansion. R. Soc. Lond. Proc. Ser. A 460(2051), 3283–3297 (2004)MathSciNetCrossRef
17.
Zurück zum Zitat Ojala, T., Pietikainen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognit. 26(1), 51–59 (1996)CrossRef Ojala, T., Pietikainen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognit. 26(1), 51–59 (1996)CrossRef
18.
Zurück zum Zitat Hadid, A., Pietikainen, M., Ahonen, T.: A Discriminative Feature Space for Detecting and Recognizing Faces. In: IEEE Conference on Computer Vision and Pattern Recognition (2004) Hadid, A., Pietikainen, M., Ahonen, T.: A Discriminative Feature Space for Detecting and Recognizing Faces. In: IEEE Conference on Computer Vision and Pattern Recognition (2004)
19.
Zurück zum Zitat Pietikainen, M., Abdenour, H., Zhao, G., Ahonen, T.: Computer Vision Using Local Binary Patterns, vol. 40. Springer-Verlag, London (2011) Pietikainen, M., Abdenour, H., Zhao, G., Ahonen, T.: Computer Vision Using Local Binary Patterns, vol. 40. Springer-Verlag, London (2011)
20.
Zurück zum Zitat Catanzaro, B., Sundaram, N., Keutzer, K.: Fast support vector machine training and classification on graphics processors. In: International conference on Machine Learning, pp. 104–111 (2002) Catanzaro, B., Sundaram, N., Keutzer, K.: Fast support vector machine training and classification on graphics processors. In: International conference on Machine Learning, pp. 104–111 (2002)
21.
Zurück zum Zitat Zhao, H.-X., Magoules, F.: Parallel Support Vector Machines on Multi-core and Multiprocessor Systems. In: International Conference on Artificial Intelligence and Applications (2010) Zhao, H.-X., Magoules, F.: Parallel Support Vector Machines on Multi-core and Multiprocessor Systems. In: International Conference on Artificial Intelligence and Applications (2010)
22.
Zurück zum Zitat Anguita, D., Boni, A., Ridella, S.: A digital architecture for support vector machines: theory, algorithm, and FPGA implementation. IEEE Trans. Neural Netw. 14(5), 993–1009 (2003)CrossRef Anguita, D., Boni, A., Ridella, S.: A digital architecture for support vector machines: theory, algorithm, and FPGA implementation. IEEE Trans. Neural Netw. 14(5), 993–1009 (2003)CrossRef
23.
Zurück zum Zitat Genov, R., Gauwengerghs, G.: Kerneltron: support vector machines in silicon. IEEE Trans. Neural Netw. 14, 1426–1434 (2003)CrossRef Genov, R., Gauwengerghs, G.: Kerneltron: support vector machines in silicon. IEEE Trans. Neural Netw. 14, 1426–1434 (2003)CrossRef
24.
Zurück zum Zitat Mahmoodi, D., Soleimani, A., Khosravi, H., Taghizadeh, M.: FPGA simulation of linear and nonlinear support vector machine. J. Softw. Eng. Appl. 4, 320–328 (2011)CrossRef Mahmoodi, D., Soleimani, A., Khosravi, H., Taghizadeh, M.: FPGA simulation of linear and nonlinear support vector machine. J. Softw. Eng. Appl. 4, 320–328 (2011)CrossRef
25.
Zurück zum Zitat Biasi, I., Boni, A., Zorat, A.: A reconfigurable parallel architecture for SVM classification. In: IEEE International Joint Conference on Neural Networks, pp. 2867–2872 (2005) Biasi, I., Boni, A., Zorat, A.: A reconfigurable parallel architecture for SVM classification. In: IEEE International Joint Conference on Neural Networks, pp. 2867–2872 (2005)
26.
Zurück zum Zitat Groleat, T., Arzel, M., Vaton, S.: Harware Acceleration of SVM-based traffic classification on FPGA. In: International Wireless Communications and Mobile Computing Conference, pp. 443–449 (2012) Groleat, T., Arzel, M., Vaton, S.: Harware Acceleration of SVM-based traffic classification on FPGA. In: International Wireless Communications and Mobile Computing Conference, pp. 443–449 (2012)
27.
Zurück zum Zitat Ruiz-Llata, M., Yebenes-Calvino, M.: FPGA Implementation of Support Vector Machines for 3D Object Identification. In: International Conference on Artificial Neural Networks (2009) Ruiz-Llata, M., Yebenes-Calvino, M.: FPGA Implementation of Support Vector Machines for 3D Object Identification. In: International Conference on Artificial Neural Networks (2009)
28.
Zurück zum Zitat Reyna-Rojas, R., Houzet, D., Dragomirescu, D., Carlier, D., Ouadjaout, S.: Object recognition system-on-chip using the support vector machines. EURASIP J. Adv. Signal Process. 2005, 993–1004 (2005)CrossRef Reyna-Rojas, R., Houzet, D., Dragomirescu, D., Carlier, D., Ouadjaout, S.: Object recognition system-on-chip using the support vector machines. EURASIP J. Adv. Signal Process. 2005, 993–1004 (2005)CrossRef
29.
Zurück zum Zitat Graf, H.P., et al.: A Massively Parallel Digital Learning Processor. In: Annual Conference on Neural Information Processing Systems (NIPS), pp. 529–536 (2008) Graf, H.P., et al.: A Massively Parallel Digital Learning Processor. In: Annual Conference on Neural Information Processing Systems (NIPS), pp. 529–536 (2008)
30.
Zurück zum Zitat Boni, A., Pianegiani, F., Petri, D.: Low-power and low-cost implementation of SVMs for smart sensors. IEEE Trans. Instrum. Meas. 56(1), 39–44 (2007)CrossRef Boni, A., Pianegiani, F., Petri, D.: Low-power and low-cost implementation of SVMs for smart sensors. IEEE Trans. Instrum. Meas. 56(1), 39–44 (2007)CrossRef
31.
Zurück zum Zitat Anguita, D., Ghio, A., Pischiutta, S., Ridella, S.: A Hardware-friendly Support Vector Machine for Embedded Automotive Applications. In: International Joint Conference on Neural Networks (2007) Anguita, D., Ghio, A., Pischiutta, S., Ridella, S.: A Hardware-friendly Support Vector Machine for Embedded Automotive Applications. In: International Joint Conference on Neural Networks (2007)
32.
Zurück zum Zitat Meher, P.K., Valls, J., Tso-Bing, J., Sridharan, K., Maharatna, K.: 50 Years of CORDIC: Algorithms, Architectures, and Applications. In: IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 56, no. 9, pp. 1893–1907 (2009)MathSciNetCrossRef Meher, P.K., Valls, J., Tso-Bing, J., Sridharan, K., Maharatna, K.: 50 Years of CORDIC: Algorithms, Architectures, and Applications. In: IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 56, no. 9, pp. 1893–1907 (2009)MathSciNetCrossRef
33.
Zurück zum Zitat Khan, F., Arnold, M., Pottenger, W.: Finite Precision Analysis of Support Vector Machine Classification in Logarithmic Number Systems. In: Euromicro Symposium on Digital System Design (2004) Khan, F., Arnold, M., Pottenger, W.: Finite Precision Analysis of Support Vector Machine Classification in Logarithmic Number Systems. In: Euromicro Symposium on Digital System Design (2004)
34.
Zurück zum Zitat Khan, F., Arnold, M., Pottenger, W.: Hardware-based support vector machine classification in logarithmic number systems. In: IEEE International Symposium on Circuirs and Systems (2005) Khan, F., Arnold, M., Pottenger, W.: Hardware-based support vector machine classification in logarithmic number systems. In: IEEE International Symposium on Circuirs and Systems (2005)
35.
Zurück zum Zitat Boni, A., Zorat, A.: FPGA Implementation of Support Vector Machines with Pseudo-Logarithmic Number Representation. In: International Joint Conference on Neural Networks (2006) Boni, A., Zorat, A.: FPGA Implementation of Support Vector Machines with Pseudo-Logarithmic Number Representation. In: International Joint Conference on Neural Networks (2006)
36.
Zurück zum Zitat Anguita, D., Ghio, A., Pischiutta, S.: A learning machine for resource-limited adaptive hardware. In: Second NASA/ESA Conference on Adaptive Hardware and Systems (2007) Anguita, D., Ghio, A., Pischiutta, S.: A learning machine for resource-limited adaptive hardware. In: Second NASA/ESA Conference on Adaptive Hardware and Systems (2007)
37.
Zurück zum Zitat Ghio, A., Pischiutta, S.: A Support Vector Machine based pedestrian recognition system on resource-limited hardware architectures. In: Research in Microelectronics and Electronics Conference (2007) Ghio, A., Pischiutta, S.: A Support Vector Machine based pedestrian recognition system on resource-limited hardware architectures. In: Research in Microelectronics and Electronics Conference (2007)
38.
Zurück zum Zitat Anguita, D., Pischiutta, S., Ridella, S., Sterpi, D.: Feed-forward support vector machine without multipliers. IEEE Trans. Neural Netw. 17, 1328 (2006)CrossRef Anguita, D., Pischiutta, S., Ridella, S., Sterpi, D.: Feed-forward support vector machine without multipliers. IEEE Trans. Neural Netw. 17, 1328 (2006)CrossRef
39.
Zurück zum Zitat Carpenter, A.: CUSVM: A CUDA Implementation of Support Vector Machines (2009) Carpenter, A.: CUSVM: A CUDA Implementation of Support Vector Machines (2009)
40.
Zurück zum Zitat Bauer, S., Kohler, S., Doll, K., Brunsmann, U.: FPGA-GPU Architecture for Kernel SVM Pedestrian Detection. In: Computer Vision and Pattern Recognition Workshops (2010) Bauer, S., Kohler, S., Doll, K., Brunsmann, U.: FPGA-GPU Architecture for Kernel SVM Pedestrian Detection. In: Computer Vision and Pattern Recognition Workshops (2010)
41.
Zurück zum Zitat Papadonikolakis, M., Bouganis, C.-S.: Novel cascade FPGA accelerator for support vector machines classification. Trans. Neural Netw. Learn. Syst. 23(7), 1040–1052 (2012)CrossRef Papadonikolakis, M., Bouganis, C.-S.: Novel cascade FPGA accelerator for support vector machines classification. Trans. Neural Netw. Learn. Syst. 23(7), 1040–1052 (2012)CrossRef
42.
Zurück zum Zitat Maghazeh, A., Bordoloi, U., Eles, P., Peng, Z.: General Purpose Computing on Low-Power Embedded GPUs : Has It Come of Age? In: International Conference on Embedded Computer Systems (SAMOS XIII) (2013) Maghazeh, A., Bordoloi, U., Eles, P., Peng, Z.: General Purpose Computing on Low-Power Embedded GPUs : Has It Come of Age? In: International Conference on Embedded Computer Systems (SAMOS XIII) (2013)
43.
Zurück zum Zitat Kyrkou, C., Theocharides, T.: A parallel hardware architecture for real-time object detection with support vector machines. IEEE Trans. Comput. 61(6), 831–842 (2012)MathSciNetCrossRef Kyrkou, C., Theocharides, T.: A parallel hardware architecture for real-time object detection with support vector machines. IEEE Trans. Comput. 61(6), 831–842 (2012)MathSciNetCrossRef
44.
Zurück zum Zitat Kryjak, T., Komorkiewicz, M., Gorgon, M.: FPGA implementation of real-time head-shoulder detection using local binary patterns, SVM and foreground object detection. In: International Conference on Design and Architectures for Signal and Image Processing (2012) Kryjak, T., Komorkiewicz, M., Gorgon, M.: FPGA implementation of real-time head-shoulder detection using local binary patterns, SVM and foreground object detection. In: International Conference on Design and Architectures for Signal and Image Processing (2012)
Metadaten
Titel
Boosting the Hardware-Efficiency of Cascade Support Vector Machines for Embedded Classification Applications
verfasst von
Christos Kyrkou
Theocharis Theocharides
Christos-Savvas Bouganis
Marios Polycarpou
Publikationsdatum
23.06.2017
Verlag
Springer US
Erschienen in
International Journal of Parallel Programming / Ausgabe 6/2018
Print ISSN: 0885-7458
Elektronische ISSN: 1573-7640
DOI
https://doi.org/10.1007/s10766-017-0514-1

Weitere Artikel der Ausgabe 6/2018

International Journal of Parallel Programming 6/2018 Zur Ausgabe