Skip to main content
Top

2024 | OriginalPaper | Chapter

Multiple Person Tracking Based on Gait Identification Using Kinect and OpenPose

Authors : Ryotaro Toma, Terumi Yaguchi, Hiroaki Kikuchi

Published in: Mobile, Secure, and Programmable Networking

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

A gait provides the characteristics of a person’s walking style and hence is classified as personal identifiable information. There have been several studies for personal identification using gait, including works using hardware such as depth sensors and studies using silhouette image sequences of gait. However, these methods were designed specialized for tracking a single walking person and the accuracy reduction when multiple people are simultaneously reflected in several angles of view is not clear yet. In addition, dependencies on hardware-based methods is not clarified yet. In this study, we focus on Kinect and OpenPose, the representative gait identification techniques with a function to detect multiple people simultaneously in real time. We investigate how many people can be identified for these devices and with the accuracy for tracking.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kim, D., Park, S.: A study on face masking scheme in video surveillance system. In: Tenth International Conference on Ubiquitous and Future Networks (ICUFN 2018), pp. 871–873 (2018) Kim, D., Park, S.: A study on face masking scheme in video surveillance system. In: Tenth International Conference on Ubiquitous and Future Networks (ICUFN 2018), pp. 871–873 (2018)
3.
go back to reference Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings Computer Vision and Pattern Recognition (CVPR 2001), pp. I-511–I-518 (2001) Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings Computer Vision and Pattern Recognition (CVPR 2001), pp. I-511–I-518 (2001)
4.
go back to reference Shakhnarovich, G., Viola, P., Moghaddam, B.: A unified learning framework for real time face detection and classification. In: Proceedings of the Automatic Face and Gesture Recognition (FG 2002) (2002) Shakhnarovich, G., Viola, P., Moghaddam, B.: A unified learning framework for real time face detection and classification. In: Proceedings of the Automatic Face and Gesture Recognition (FG 2002) (2002)
5.
go back to reference Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. (IJCV) 57(2), 134–157 (2004)CrossRef Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. (IJCV) 57(2), 134–157 (2004)CrossRef
6.
go back to reference Simonyan, K., Zissserman, A.: Very deep convolutional networks for large-scale image recognition. In: ICLR 2014, pp. 1409–1556 (2014) Simonyan, K., Zissserman, A.: Very deep convolutional networks for large-scale image recognition. In: ICLR 2014, pp. 1409–1556 (2014)
7.
go back to reference Wang, J., Li, Z.: Research on face recognition based on CNN. In: IOP Conference Series: Earth and Environmental Science, vol. 170, no. 3 (2018) Wang, J., Li, Z.: Research on face recognition based on CNN. In: IOP Conference Series: Earth and Environmental Science, vol. 170, no. 3 (2018)
8.
go back to reference Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874 (2014) Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874 (2014)
9.
go back to reference Preis, J., Kessel, M., Werner, M., Linnhoff-Popien, C.: Gait recognition with Kinect. In: Proceedings of the First Workshop on Kinect in Pervasive Computing (2012) Preis, J., Kessel, M., Werner, M., Linnhoff-Popien, C.: Gait recognition with Kinect. In: Proceedings of the First Workshop on Kinect in Pervasive Computing (2012)
10.
go back to reference Han, J., Bhanu, B.: Individual recognition using gait energy image. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 316–322 (2006)CrossRef Han, J., Bhanu, B.: Individual recognition using gait energy image. IEEE Trans. Pattern Anal. Mach. Intell. 28(2), 316–322 (2006)CrossRef
11.
go back to reference Bakchy, S.C., Islam, M.R., Sayeed, A.: Human identification on the basis of gait analysis using Kohonen self-organizing mapping technique. In: 2nd International Conference on Electrical, Computer and Telecommunication Engineering (ICECTE), pp. 1–4 (2016) Bakchy, S.C., Islam, M.R., Sayeed, A.: Human identification on the basis of gait analysis using Kohonen self-organizing mapping technique. In: 2nd International Conference on Electrical, Computer and Telecommunication Engineering (ICECTE), pp. 1–4 (2016)
12.
go back to reference Shiraga, K., Makihara, Y., Muramatsu, D., Echigo, T., Yagi, Y.: GEINet: view-invariant gait recognition using a convolutional neural network. In: 2016 International Conference on Biometrics (ICB), pp. 1–8 (2016) Shiraga, K., Makihara, Y., Muramatsu, D., Echigo, T., Yagi, Y.: GEINet: view-invariant gait recognition using a convolutional neural network. In: 2016 International Conference on Biometrics (ICB), pp. 1–8 (2016)
13.
go back to reference Amos, B., Ludwiczuk, B., Satyanarayanan, M.: OpenFace: a general- purpose face recognition library with mobile applications. Technical report, CMU School of Computer Science, CMU-CS-16-118 (2016) Amos, B., Ludwiczuk, B., Satyanarayanan, M.: OpenFace: a general- purpose face recognition library with mobile applications. Technical report, CMU School of Computer Science, CMU-CS-16-118 (2016)
15.
go back to reference Berndt, D.J., Clifford, J.: Using dynamic time warping to find patterns in time series. In: The Third International Conference on Knowledge Discovery and Data Mining, pp. 359–370 (1994) Berndt, D.J., Clifford, J.: Using dynamic time warping to find patterns in time series. In: The Third International Conference on Knowledge Discovery and Data Mining, pp. 359–370 (1994)
16.
go back to reference Amosa, T.I., et al.: Multi-camera multi-object tracking: a review of current trends and future advances. Neurocomputing 552 (2023) Amosa, T.I., et al.: Multi-camera multi-object tracking: a review of current trends and future advances. Neurocomputing 552 (2023)
17.
go back to reference Mori, T., Kikuchi, H.: Person tracking based on gait features from depth sensors. In: The 21st International Conference on Network-Based Information Systems (NBiS-2018), vol. 22, pp. 743–751 (2018) Mori, T., Kikuchi, H.: Person tracking based on gait features from depth sensors. In: The 21st International Conference on Network-Based Information Systems (NBiS-2018), vol. 22, pp. 743–751 (2018)
18.
go back to reference Mori, T., Kikuchi, H.: Robust person identification based on DTW distance of multiple-joint gait pattern. In: Mori, P., Furnell, S., Camp, O. (eds.) Proceedings of the 5th International Conference on Information Systems Security and Privacy, ICISSP 2019, pp. 221–229 (2019) Mori, T., Kikuchi, H.: Robust person identification based on DTW distance of multiple-joint gait pattern. In: Mori, P., Furnell, S., Camp, O. (eds.) Proceedings of the 5th International Conference on Information Systems Security and Privacy, ICISSP 2019, pp. 221–229 (2019)
19.
go back to reference Wang, H., Xie, S., Hong, Y.: VideoDP: a flexible platform for video analytics with differential privacy. Proc. Priv. Enhancing Technol. 2020(4), 277–296 (2020)CrossRef Wang, H., Xie, S., Hong, Y.: VideoDP: a flexible platform for video analytics with differential privacy. Proc. Priv. Enhancing Technol. 2020(4), 277–296 (2020)CrossRef
20.
go back to reference Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., Sheikh, Y.: OpenPose: realtime multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43(1), 172–186 (2021)CrossRef Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., Sheikh, Y.: OpenPose: realtime multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43(1), 172–186 (2021)CrossRef
24.
go back to reference Martınez-Felez, R., Alberto-Mollineda, R., Salvador-Sanchez, J.: Gender classification from pose-based GEIs. In: Proceedings of the Computer Vision and Graphics (ICCVG), pp. 501–508 (2012) Martınez-Felez, R., Alberto-Mollineda, R., Salvador-Sanchez, J.: Gender classification from pose-based GEIs. In: Proceedings of the Computer Vision and Graphics (ICCVG), pp. 501–508 (2012)
26.
go back to reference Bewes, J., Low, A., Morphett, A., Pate, F.D., Henneberg, M.: Artificial intelligence for sex determination of skeletal remains: application of a deep learning artificial neural network to human skulls. J. Forensic Leg. Med. 62, 40–43 (2019)CrossRef Bewes, J., Low, A., Morphett, A., Pate, F.D., Henneberg, M.: Artificial intelligence for sex determination of skeletal remains: application of a deep learning artificial neural network to human skulls. J. Forensic Leg. Med. 62, 40–43 (2019)CrossRef
28.
go back to reference Liu, J., Shahroudy, A., Perez, M., Wang, G., Duan, L.-Y., Kot, A.C.: NTU RGB+D 120: a large-scale benchmark for 3D human activity understanding. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 42, 2684–2701 (2019)CrossRef Liu, J., Shahroudy, A., Perez, M., Wang, G., Duan, L.-Y., Kot, A.C.: NTU RGB+D 120: a large-scale benchmark for 3D human activity understanding. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 42, 2684–2701 (2019)CrossRef
29.
go back to reference Martinez, J., Hossain, R., Romero, J., Little, J.J.: A simple yet effective baseline for 3D human pose estimation. In: ICCV, pp. 2640–2649 (2017) Martinez, J., Hossain, R., Romero, J., Little, J.J.: A simple yet effective baseline for 3D human pose estimation. In: ICCV, pp. 2640–2649 (2017)
30.
go back to reference Ten Holt, G.A., Reinders, M.J.T., Hendriks, E.A.: Multi-dimensional dynamic time warping for gesture recognition. In: Thirteenth Annual Conference of the Advanced School for Computing and Imaging (2007) Ten Holt, G.A., Reinders, M.J.T., Hendriks, E.A.: Multi-dimensional dynamic time warping for gesture recognition. In: Thirteenth Annual Conference of the Advanced School for Computing and Imaging (2007)
31.
go back to reference Muaaz, M., Mayrhofer, R.: Smartphone-based gait recognition: from authentication to imitation. IEEE Trans. Mob. Comput. 16(11), 3209–3221 (2017)CrossRef Muaaz, M., Mayrhofer, R.: Smartphone-based gait recognition: from authentication to imitation. IEEE Trans. Mob. Comput. 16(11), 3209–3221 (2017)CrossRef
34.
go back to reference Mishra, R.: Persuasive boundary point based face detection using normalized edge detection in regular expression face morphing. In: 2023 International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), Ballar, India, pp. 1–4 (2023) Mishra, R.: Persuasive boundary point based face detection using normalized edge detection in regular expression face morphing. In: 2023 International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), Ballar, India, pp. 1–4 (2023)
35.
go back to reference Wong, S.W., Chiu, Y.C., Tsai, C.Y.: A real-time affordance-based object pose estimation approach for robotic grasp pose estimation. In: 2023 International Conference on System Science and Engineering (ICSSE), Ho Chi Minh, Vietnam, pp. 614–619 (2023) Wong, S.W., Chiu, Y.C., Tsai, C.Y.: A real-time affordance-based object pose estimation approach for robotic grasp pose estimation. In: 2023 International Conference on System Science and Engineering (ICSSE), Ho Chi Minh, Vietnam, pp. 614–619 (2023)
Metadata
Title
Multiple Person Tracking Based on Gait Identification Using Kinect and OpenPose
Authors
Ryotaro Toma
Terumi Yaguchi
Hiroaki Kikuchi
Copyright Year
2024
DOI
https://doi.org/10.1007/978-3-031-52426-4_12

Premium Partner