Skip to main content
Top
Published in: Neural Computing and Applications 16/2020

18-01-2020 | Original Article

Hardware implementation of real-time pedestrian detection system

Authors: Abdelhamid Helali, Haythem Ameur, J. M. Górriz, J. Ramírez, Hassen Maaref

Published in: Neural Computing and Applications | Issue 16/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Histogram of oriented gradients (HOG) descriptor and support vector machine (SVM) classifier have been considered as a very efficient and robust tools used in the development of pedestrian detection systems. However, the enormous calculations make it difficult to meet real-time requirement specifically for advanced driver assistance system applications. The latter requires higher frame rate and resolution. In the present work, efficient pipelined architecture founded on cell-based scanning and simultaneous linear SVM classification is highlighted. The proposed real-time pedestrian detection architecture performs without external memories, and only 3 × 3 pixels are processed using two line buffers. Indeed, intermediate results will contribute directly to build the cell histograms. Consequently, it allows to reduce the required memory and to speed up the HOG feature extraction procedure. The implementation results on a heterogeneous platform show that the proposed architecture achieves an efficient pedestrian detection for full-HD video recordings (1080 × 1920 pixels) at 60 fps with reduced hardware resource consumption. Using the same hardware resources at 444 MHz, the proposed system turns out to handle a HD video at 180 fps.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Global status report on road safety (2015) World Health Organization, 2015 Global status report on road safety (2015) World Health Organization, 2015
5.
go back to reference Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D (2010) Object detection with discriminatively trained part-based models. IEEE Trans Pattern Anal Mach Intell 32(9):1627–1645CrossRef Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D (2010) Object detection with discriminatively trained part-based models. IEEE Trans Pattern Anal Mach Intell 32(9):1627–1645CrossRef
7.
go back to reference Sermanet P, Kavukcuoglu K, Chintala S, LeCun Y (2013) Pedestrian detection with unsupervised multi-stage feature learning. In: IEEE conference on computer vision and pattern recognition, pp 3626–3633 Sermanet P, Kavukcuoglu K, Chintala S, LeCun Y (2013) Pedestrian detection with unsupervised multi-stage feature learning. In: IEEE conference on computer vision and pattern recognition, pp 3626–3633
9.
go back to reference Wu B, Iandola F, Jin PH, Keutzer K (2017) SqueezeDet: unified, small, low power fully convolutional neural networks for real-time object detection for autonomous driving. In: 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), Honolulu, HI, pp 446–454. https://doi.org/10.1109/cvprw.2017.60 Wu B, Iandola F, Jin PH, Keutzer K (2017) SqueezeDet: unified, small, low power fully convolutional neural networks for real-time object detection for autonomous driving. In: 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), Honolulu, HI, pp 446–454. https://​doi.​org/​10.​1109/​cvprw.​2017.​60
14.
15.
go back to reference Yuan X, Cai-nian L, Xiao-liang X, Mei J, Jian-guo Z (2015) A two-stage hog feature extraction processor embedded with SVM for pedestrian detection, image processing (ICIP). In: 2015 IEEE international conference on, Quebec City, QC, pp 3452–3455. https://doi.org/10.1109/icip.2015.7351445 Yuan X, Cai-nian L, Xiao-liang X, Mei J, Jian-guo Z (2015) A two-stage hog feature extraction processor embedded with SVM for pedestrian detection, image processing (ICIP). In: 2015 IEEE international conference on, Quebec City, QC, pp 3452–3455. https://​doi.​org/​10.​1109/​icip.​2015.​7351445
16.
go back to reference Bauer S, Brunsmann U, Schlotterbeck Macht S (2009) FPGA implementation of a HOG-based pedestrian recognition system. MPC-Workshop July Bauer S, Brunsmann U, Schlotterbeck Macht S (2009) FPGA implementation of a HOG-based pedestrian recognition system. MPC-Workshop July
17.
go back to reference Takagi K, Mizuno K, Izumi S, Kawaguchi H, Yoshimoto M (2013) A sub-100-milliwatt dual-core HOG accelerator VLSI for real-time multiple object detection. In: IEEE international conference on acoustics, speech and signal processing, Vancouver, BC, pp 2533–2537. https://doi.org/10.1109/icassp.2013.6638112 Takagi K, Mizuno K, Izumi S, Kawaguchi H, Yoshimoto M (2013) A sub-100-milliwatt dual-core HOG accelerator VLSI for real-time multiple object detection. In: IEEE international conference on acoustics, speech and signal processing, Vancouver, BC, pp 2533–2537. https://​doi.​org/​10.​1109/​icassp.​2013.​6638112
21.
22.
go back to reference Górriz JM, Segovia F, Ramírez J, Lassl A, Salas Gonzalez D (2011) GMM based SPECT image classification for the diagnosis of Alzheimer’s disease. Appl Soft Comput 11:2313–2325CrossRef Górriz JM, Segovia F, Ramírez J, Lassl A, Salas Gonzalez D (2011) GMM based SPECT image classification for the diagnosis of Alzheimer’s disease. Appl Soft Comput 11:2313–2325CrossRef
24.
go back to reference Asa BH, Horn D, Siegelmann HT, Vapnik V (2002) Support vector clustering. J Mach Learn Res 2:125–137MATH Asa BH, Horn D, Siegelmann HT, Vapnik V (2002) Support vector clustering. J Mach Learn Res 2:125–137MATH
25.
go back to reference Dürre J, Paradzik D, Blume H (2018) A HOG-based realtime and multi-cale pedestrian detector demonstration system on FPGA In FPGA’18: 2018 ACM/SIGDA international symposium on field-programmable gate arrays, February 25–27, 2018, Monterey, CA, USA. ACM, New York, NY, USA, 10 pages. https://doi.org/10.1145/3174243.3174249 Dürre J, Paradzik D, Blume H (2018) A HOG-based realtime and multi-cale pedestrian detector demonstration system on FPGA In FPGA’18: 2018 ACM/SIGDA international symposium on field-programmable gate arrays, February 25–27, 2018, Monterey, CA, USA. ACM, New York, NY, USA, 10 pages. https://​doi.​org/​10.​1145/​3174243.​3174249
26.
go back to reference Rettkowski J, Boutros A, Göhringer D (2017) HW/SW Co-Design of the HOG algorithm on a Xilinx Zynq SoC. J Parallel Distrib Comput 109:50–62CrossRef Rettkowski J, Boutros A, Göhringer D (2017) HW/SW Co-Design of the HOG algorithm on a Xilinx Zynq SoC. J Parallel Distrib Comput 109:50–62CrossRef
27.
go back to reference Ameur H, Helali A, Maaref H, Youssef A (2016) Implementation of real time edge detection system for HD video on Zynq. In: 3rd international conference on automation, control, engineering and computer science (ACECS’16), proceedings of engineering and technology (PET), pp 41–45 Ameur H, Helali A, Maaref H, Youssef A (2016) Implementation of real time edge detection system for HD video on Zynq. In: 3rd international conference on automation, control, engineering and computer science (ACECS’16), proceedings of engineering and technology (PET), pp 41–45
31.
go back to reference Vivado Design Suite User Guide, UG910 (v2018.2) June 6, 2018 Vivado Design Suite User Guide, UG910 (v2018.2) June 6, 2018
33.
go back to reference Khedher L, Ramírez J, Górriz JM, Brahim A, Segovia F (2015) Early diagnosis of Alzheimer’s disease based on partial least squares, principal component analysis and support vector machine using segmented MRI images. Neurocomputing 151:139–150CrossRef Khedher L, Ramírez J, Górriz JM, Brahim A, Segovia F (2015) Early diagnosis of Alzheimer’s disease based on partial least squares, principal component analysis and support vector machine using segmented MRI images. Neurocomputing 151:139–150CrossRef
Metadata
Title
Hardware implementation of real-time pedestrian detection system
Authors
Abdelhamid Helali
Haythem Ameur
J. M. Górriz
J. Ramírez
Hassen Maaref
Publication date
18-01-2020
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 16/2020
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-04731-y

Other articles of this Issue 16/2020

Neural Computing and Applications 16/2020 Go to the issue

Engineering Applications of Neural Networks 2018

A honeybees-inspired heuristic algorithm for numerical optimisation

Premium Partner