Skip to main content
Top

2020 | OriginalPaper | Chapter

An Efficient Solution for People Tracking and Profiling from Video Streams Using Low-Power Compute

Authors : Marius Eduard Cojocea, Traian Rebedea

Published in: Advances in Computational Collective Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Balancing between performance and speed is vital for real-time applications. Given some of the latest edge devices, such as Raspberry Pi 4, Intel Neural Compute Stick 2, or Nvidia Jetson series, edge processing can become a valid choice for deploying computer vision algorithms in real-time scenarios. Object detection and tracking are two common problems that can be solved using such algorithms, which can be deployed with reasonable performance and speed on edge devices. In this paper, we show that the YOLO architecture can be successfully used for object detection and DeepSORT for object tracking on edge devices. The objects of interest in our scenario are persons, thus indicating face detection and tracking as another problem that is solved in the scope of the paper. Using Raspberry Pi 4 and Intel Neural Compute Stick 2, object detection and tracking models can be run on edge devices, though at around half the performance and more than 10 times slower than on a GPU server.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
2.
go back to reference Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014) Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)
3.
go back to reference Girshick, R.: Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1440–1448 (2015) Girshick, R.: Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1440–1448 (2015)
4.
go back to reference Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015) Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
5.
go back to reference He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017) He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)
6.
go back to reference Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016) Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
7.
go back to reference Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263–7271 (2017) Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263–7271 (2017)
9.
go back to reference Huang, R., Pedoeem, J., Chen, C.: YOLO-LITE: a real-time object detection algorithm optimized for non-GPU computers. In: 2018 IEEE International Conference on Big Data (Big Data), pp. 2503–2510 (2018) Huang, R., Pedoeem, J., Chen, C.: YOLO-LITE: a real-time object detection algorithm optimized for non-GPU computers. In: 2018 IEEE International Conference on Big Data (Big Data), pp. 2503–2510 (2018)
10.
go back to reference Welch, G., Bishop, G.: An introduction to the Kalman filter (1995) Welch, G., Bishop, G.: An introduction to the Kalman filter (1995)
11.
go back to reference Bewley, A., Ge, Z., Ott, L., Ramos, F., Upcroft, B.: Simple online and realtime tracking. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3464–3468 (2016) Bewley, A., Ge, Z., Ott, L., Ramos, F., Upcroft, B.: Simple online and realtime tracking. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3464–3468 (2016)
12.
go back to reference Wojke, N., Bewley, A., Paulus, D.: Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649 (2017) Wojke, N., Bewley, A., Paulus, D.: Simple online and realtime tracking with a deep association metric. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3645–3649 (2017)
13.
go back to reference Déniz, O., Bueno, G., Salido, J., De la Torre, F.: Face recognition using histograms of oriented gradients. Pattern Recognit. Lett. 32(12), 1598–1603 (2011)CrossRef Déniz, O., Bueno, G., Salido, J., De la Torre, F.: Face recognition using histograms of oriented gradients. Pattern Recognit. Lett. 32(12), 1598–1603 (2011)CrossRef
14.
go back to reference Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, vol. 1, pp. I (2001) Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, vol. 1, pp. I (2001)
15.
go back to reference Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)CrossRef Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)CrossRef
16.
go back to reference Qi, R., Jia, R.S., Mao, Q.C., Sun, H.M., Zuo, L.Q.: Face detection method based on cascaded convolutional networks. IEEE Access 7, 110740–110748 (2019)CrossRef Qi, R., Jia, R.S., Mao, Q.C., Sun, H.M., Zuo, L.Q.: Face detection method based on cascaded convolutional networks. IEEE Access 7, 110740–110748 (2019)CrossRef
17.
go back to reference Xiang, Y., Alahi, A., Savarese, S.: Learning to track: online multi-object tracking by decision making. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4705–4713 (2015) Xiang, Y., Alahi, A., Savarese, S.: Learning to track: online multi-object tracking by decision making. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4705–4713 (2015)
18.
go back to reference Yu, H., et al.: Groupwise tracking of crowded similar-appearance targets from low-continuity image sequences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 952–960 (2016) Yu, H., et al.: Groupwise tracking of crowded similar-appearance targets from low-continuity image sequences. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 952–960 (2016)
19.
go back to reference Lin, C.C., Hung, Y.: A prior-less method for multi-face tracking in unconstrained videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 538–547 (2018) Lin, C.C., Hung, Y.: A prior-less method for multi-face tracking in unconstrained videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 538–547 (2018)
20.
go back to reference Tijtgat, N., Van Ranst, W., Goedeme, T., Volckaert, B., De Turck, F.: Embedded real-time object detection for a UAV warning system. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 2110–2118 (2017) Tijtgat, N., Van Ranst, W., Goedeme, T., Volckaert, B., De Turck, F.: Embedded real-time object detection for a UAV warning system. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 2110–2118 (2017)
22.
go back to reference Jaramillo-Avila, U., Anderson, S.R.: Foveated image processing for faster object detection and recognition in embedded systems using deep convolutional neural networks. In: Martinez-Hernandez, U., et al. (eds.) Living Machines 2019. LNCS (LNAI), vol. 11556, pp. 193–204. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-24741-6_17CrossRef Jaramillo-Avila, U., Anderson, S.R.: Foveated image processing for faster object detection and recognition in embedded systems using deep convolutional neural networks. In: Martinez-Hernandez, U., et al. (eds.) Living Machines 2019. LNCS (LNAI), vol. 11556, pp. 193–204. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-24741-6_​17CrossRef
23.
go back to reference Cojocea, E., Hornea, S., Rebedea, T.: Balancing between centralized vs. edge processing in IoT platforms with applicability in advanced people flow analysis. In: 2019 18th RoEduNet Conference: Networking in Education and Research (RoEduNet), pp. 1–6. IEEE (2019) Cojocea, E., Hornea, S., Rebedea, T.: Balancing between centralized vs. edge processing in IoT platforms with applicability in advanced people flow analysis. In: 2019 18th RoEduNet Conference: Networking in Education and Research (RoEduNet), pp. 1–6. IEEE (2019)
27.
go back to reference Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the CLEAR MOT metrics. EURASIP J. Image Video Process. 2008, 1–10 (2008)CrossRef Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the CLEAR MOT metrics. EURASIP J. Image Video Process. 2008, 1–10 (2008)CrossRef
Metadata
Title
An Efficient Solution for People Tracking and Profiling from Video Streams Using Low-Power Compute
Authors
Marius Eduard Cojocea
Traian Rebedea
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-63119-2_13

Premium Partner