Skip to main content
Top

03-11-2023

Enhancing Human Motion Prediction through Joint-based Analysis and AVI Video Conversion

Authors: Yi Xiong, Syed Atif Moqurrab, Awais Ahmad

Published in: Mobile Networks and Applications

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Human joint motion exhibits a high degree of freedom, with different joints capable of moving and rotating in various directions. Consequently, accurately capturing the features of posture motion becomes challenging, resulting in lower prediction accuracy. To address this issue, this paper proposes a novel method for predicting human motion based on joints using AVI video conversion. The foreground of human motion images in AVI videos is extracted using a Gaussian background model, and the AVI video is converted into a 3D video by fusing the foreground and background images. The spatiotemporal weighted attitude motion features of the 3D video frames are extracted and utilized as input for a CNN algorithm. Motion feature vectorization is employed to reduce motion edge detection errors through a spatiotemporal weighted adaptive interpolation method. Subsequently, the motion basis is generated after processing the fusion of attitude edge features. The particle filter algorithm is utilized to establish the human joint motion model, and joint-based motion prediction is conducted based on the motion basis. Experimental results demonstrate that the 3D conversion enhances the background depth of the 2-dimensional AVI video. Additionally, the proposed method extracts motion bases with clear performance, accurate actions, smooth outlines, and non-redundant backgrounds. The prediction results of human movement based on joints exhibit accuracy, with the error in comparison to actual movement falling within a controllable range.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Burtscher M (2020) A breath of fresh air for mitochondria in exercise physiology. Acta Physiol 229(3):e13490CrossRef Burtscher M (2020) A breath of fresh air for mitochondria in exercise physiology. Acta Physiol 229(3):e13490CrossRef
2.
go back to reference Wilson KA, Kung RW, D’souza S, Wetmore SD (2021) Anatomy of noncovalent interactions between the nucleobases or ribose and π-containing amino acids in RNA–protein complexes. Nucleic Acids Res 49(4):2213–2225CrossRef Wilson KA, Kung RW, D’souza S, Wetmore SD (2021) Anatomy of noncovalent interactions between the nucleobases or ribose and π-containing amino acids in RNA–protein complexes. Nucleic Acids Res 49(4):2213–2225CrossRef
3.
go back to reference Sampaio M, Navarro Haro MV, Wilks C, De Sousa B, Garcia-Palacios A, Hoffman HG (2021) Spanish-speaking therapists increasingly switch to telepsychology during COVID-19: networked virtual reality may be next. Telemed e-Health 27(8):919–928CrossRef Sampaio M, Navarro Haro MV, Wilks C, De Sousa B, Garcia-Palacios A, Hoffman HG (2021) Spanish-speaking therapists increasingly switch to telepsychology during COVID-19: networked virtual reality may be next. Telemed e-Health 27(8):919–928CrossRef
4.
go back to reference Chen J, Huang J (2022) Artificial intelligence image superpixel segmentation simulation based on fast SLIC. Comput Simul 39(6):170–174 Chen J, Huang J (2022) Artificial intelligence image superpixel segmentation simulation based on fast SLIC. Comput Simul 39(6):170–174
5.
go back to reference Alam A (2022) Social robots in education for long-term human-robot interaction: Socially supportive behaviour of robotic tutor for creating robo-tangible learning environment in a guided discovery learning interaction. ECS Trans 107(1):12389CrossRef Alam A (2022) Social robots in education for long-term human-robot interaction: Socially supportive behaviour of robotic tutor for creating robo-tangible learning environment in a guided discovery learning interaction. ECS Trans 107(1):12389CrossRef
6.
go back to reference Ming-lei S, Ai-zeng L, Li-hua L (2021) Speed control of vehicle automatic driving system based on 5G vehicle network. Int J Veh Des 86(1–4):71–87 Ming-lei S, Ai-zeng L, Li-hua L (2021) Speed control of vehicle automatic driving system based on 5G vehicle network. Int J Veh Des 86(1–4):71–87
7.
go back to reference Diederich S, Brendel AB, Morana S, Kolbe L (2022) On the design of and interaction with conversational agents: An organizing and assessing review of human-computer interaction research. J Assoc Inf Syst 23(1):96–138 Diederich S, Brendel AB, Morana S, Kolbe L (2022) On the design of and interaction with conversational agents: An organizing and assessing review of human-computer interaction research. J Assoc Inf Syst 23(1):96–138
8.
go back to reference Climent-Pérez P, Florez-Revuelta F (2021) Improved action recognition with separable spatio-temporal attention using alternative skeletal and video pre-processing. Sensors 21(3):1005CrossRef Climent-Pérez P, Florez-Revuelta F (2021) Improved action recognition with separable spatio-temporal attention using alternative skeletal and video pre-processing. Sensors 21(3):1005CrossRef
9.
go back to reference Montalva GA, Bastías N, Leyton F (2022) Strong ground motion prediction model for PGV and spectral velocity for the Chilean subduction zone. Bull Seismol Soc Am 112(1):348–360CrossRef Montalva GA, Bastías N, Leyton F (2022) Strong ground motion prediction model for PGV and spectral velocity for the Chilean subduction zone. Bull Seismol Soc Am 112(1):348–360CrossRef
10.
go back to reference Meng Z, She C, Zhao G, De Martini D (2022) Sampling, communication, and prediction co-design for synchronizing the real-world device and digital model in metaverse. IEEE J Sel Areas Commun 41(1):288–300CrossRef Meng Z, She C, Zhao G, De Martini D (2022) Sampling, communication, and prediction co-design for synchronizing the real-world device and digital model in metaverse. IEEE J Sel Areas Commun 41(1):288–300CrossRef
11.
go back to reference Li W, Zeng Y, Wu Y, Zhang Q, Chen G, Chen Y (2022) Dynamic manifold Boltzmann optimization based on self-supervised learning for human motion estimation. IET Image Proc 16(4):1162–1180CrossRef Li W, Zeng Y, Wu Y, Zhang Q, Chen G, Chen Y (2022) Dynamic manifold Boltzmann optimization based on self-supervised learning for human motion estimation. IET Image Proc 16(4):1162–1180CrossRef
12.
go back to reference Sun Y, Zhou J, Zhang X (2020) Human motion pattern recognition based on acceleration sensor. Comput Syst Appl 29(6):196–203 Sun Y, Zhou J, Zhang X (2020) Human motion pattern recognition based on acceleration sensor. Comput Syst Appl 29(6):196–203
13.
go back to reference Li L, Zhang Q (2021) Prediction and simulation of human behavior continuity based on time domain segmentation. Comput Simul 38(5):339–343 Li L, Zhang Q (2021) Prediction and simulation of human behavior continuity based on time domain segmentation. Comput Simul 38(5):339–343
14.
go back to reference Liu S, Wang S, Liu X, Lin CT, Lv Z (2021) Fuzzy detection aided real-time and robust visual tracking under complex environments. IEEE Trans Fuzzy Syst 29(1):90–102CrossRef Liu S, Wang S, Liu X, Lin CT, Lv Z (2021) Fuzzy detection aided real-time and robust visual tracking under complex environments. IEEE Trans Fuzzy Syst 29(1):90–102CrossRef
15.
go back to reference Liu S, Huang S, Wang S, Muhammad K, Bellavista P, Ser JD (2023) Visual tracking in complex scenes: a location fusion mechanism based on the combination of multiple visual cognition flows. Inf Fusion 96:281–296CrossRef Liu S, Huang S, Wang S, Muhammad K, Bellavista P, Ser JD (2023) Visual tracking in complex scenes: a location fusion mechanism based on the combination of multiple visual cognition flows. Inf Fusion 96:281–296CrossRef
16.
go back to reference Cui Q, Sun H, Kong Y, Zhang X, Li Y (2020) Efficient human motion prediction using temporal convolutional generative adversarial network. Inf Sci 545(2021):427–447 Cui Q, Sun H, Kong Y, Zhang X, Li Y (2020) Efficient human motion prediction using temporal convolutional generative adversarial network. Inf Sci 545(2021):427–447
17.
go back to reference Hacinecipoglu A, Konukseven EI, Koku AB (2020) Multiple human trajectory prediction and cooperative navigation modeling in crowded scenes. Intel Serv Robot 13(4):479–493CrossRef Hacinecipoglu A, Konukseven EI, Koku AB (2020) Multiple human trajectory prediction and cooperative navigation modeling in crowded scenes. Intel Serv Robot 13(4):479–493CrossRef
18.
go back to reference Estrada R (2020) Method for auto-calibrate projector and color-depth systems for spatial augmented reality applications. Int J Comput Inf Eng 14(12):548–554 Estrada R (2020) Method for auto-calibrate projector and color-depth systems for spatial augmented reality applications. Int J Comput Inf Eng 14(12):548–554
19.
go back to reference Poomhiran L, Phayung M, Sumitra N (2021) Improving the recognition performance of lip reading using the concatenated three sequence keyframe image technique. Eng Technol Appl Sci Res 11(2):6986–6992CrossRef Poomhiran L, Phayung M, Sumitra N (2021) Improving the recognition performance of lip reading using the concatenated three sequence keyframe image technique. Eng Technol Appl Sci Res 11(2):6986–6992CrossRef
20.
go back to reference Murn L, Alan FS, Marta M (2021) Interpreting super-resolution CNNs for sub-pixel motion compensation in video coding. Proceedings of the 29th ACM International Conference on Multimedia, 3803–3806 Murn L, Alan FS, Marta M (2021) Interpreting super-resolution CNNs for sub-pixel motion compensation in video coding. Proceedings of the 29th ACM International Conference on Multimedia, 3803–3806
21.
go back to reference Fan C, Fu W, Liu S (2022) A high-precision correction method in non-rigid 3D motion poses reconstruction. Connect Sci 34(1):2845–2859CrossRef Fan C, Fu W, Liu S (2022) A high-precision correction method in non-rigid 3D motion poses reconstruction. Connect Sci 34(1):2845–2859CrossRef
22.
go back to reference Juliu L, Xiangsuo F, Huajin C, Bing L, Lei M, Zhiyong X (2021) Dim and small target detection based on improved spatio-temporal filtering. IEEE Photonics J 14(1):1–11CrossRef Juliu L, Xiangsuo F, Huajin C, Bing L, Lei M, Zhiyong X (2021) Dim and small target detection based on improved spatio-temporal filtering. IEEE Photonics J 14(1):1–11CrossRef
Metadata
Title
Enhancing Human Motion Prediction through Joint-based Analysis and AVI Video Conversion
Authors
Yi Xiong
Syed Atif Moqurrab
Awais Ahmad
Publication date
03-11-2023
Publisher
Springer US
Published in
Mobile Networks and Applications
Print ISSN: 1383-469X
Electronic ISSN: 1572-8153
DOI
https://doi.org/10.1007/s11036-023-02261-0