Skip to main content

03.11.2023

Enhancing Human Motion Prediction through Joint-based Analysis and AVI Video Conversion

verfasst von: Yi Xiong, Syed Atif Moqurrab, Awais Ahmad

Erschienen in: Mobile Networks and Applications

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Human joint motion exhibits a high degree of freedom, with different joints capable of moving and rotating in various directions. Consequently, accurately capturing the features of posture motion becomes challenging, resulting in lower prediction accuracy. To address this issue, this paper proposes a novel method for predicting human motion based on joints using AVI video conversion. The foreground of human motion images in AVI videos is extracted using a Gaussian background model, and the AVI video is converted into a 3D video by fusing the foreground and background images. The spatiotemporal weighted attitude motion features of the 3D video frames are extracted and utilized as input for a CNN algorithm. Motion feature vectorization is employed to reduce motion edge detection errors through a spatiotemporal weighted adaptive interpolation method. Subsequently, the motion basis is generated after processing the fusion of attitude edge features. The particle filter algorithm is utilized to establish the human joint motion model, and joint-based motion prediction is conducted based on the motion basis. Experimental results demonstrate that the 3D conversion enhances the background depth of the 2-dimensional AVI video. Additionally, the proposed method extracts motion bases with clear performance, accurate actions, smooth outlines, and non-redundant backgrounds. The prediction results of human movement based on joints exhibit accuracy, with the error in comparison to actual movement falling within a controllable range.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Burtscher M (2020) A breath of fresh air for mitochondria in exercise physiology. Acta Physiol 229(3):e13490CrossRef Burtscher M (2020) A breath of fresh air for mitochondria in exercise physiology. Acta Physiol 229(3):e13490CrossRef
2.
Zurück zum Zitat Wilson KA, Kung RW, D’souza S, Wetmore SD (2021) Anatomy of noncovalent interactions between the nucleobases or ribose and π-containing amino acids in RNA–protein complexes. Nucleic Acids Res 49(4):2213–2225CrossRef Wilson KA, Kung RW, D’souza S, Wetmore SD (2021) Anatomy of noncovalent interactions between the nucleobases or ribose and π-containing amino acids in RNA–protein complexes. Nucleic Acids Res 49(4):2213–2225CrossRef
3.
Zurück zum Zitat Sampaio M, Navarro Haro MV, Wilks C, De Sousa B, Garcia-Palacios A, Hoffman HG (2021) Spanish-speaking therapists increasingly switch to telepsychology during COVID-19: networked virtual reality may be next. Telemed e-Health 27(8):919–928CrossRef Sampaio M, Navarro Haro MV, Wilks C, De Sousa B, Garcia-Palacios A, Hoffman HG (2021) Spanish-speaking therapists increasingly switch to telepsychology during COVID-19: networked virtual reality may be next. Telemed e-Health 27(8):919–928CrossRef
4.
Zurück zum Zitat Chen J, Huang J (2022) Artificial intelligence image superpixel segmentation simulation based on fast SLIC. Comput Simul 39(6):170–174 Chen J, Huang J (2022) Artificial intelligence image superpixel segmentation simulation based on fast SLIC. Comput Simul 39(6):170–174
5.
Zurück zum Zitat Alam A (2022) Social robots in education for long-term human-robot interaction: Socially supportive behaviour of robotic tutor for creating robo-tangible learning environment in a guided discovery learning interaction. ECS Trans 107(1):12389CrossRef Alam A (2022) Social robots in education for long-term human-robot interaction: Socially supportive behaviour of robotic tutor for creating robo-tangible learning environment in a guided discovery learning interaction. ECS Trans 107(1):12389CrossRef
6.
Zurück zum Zitat Ming-lei S, Ai-zeng L, Li-hua L (2021) Speed control of vehicle automatic driving system based on 5G vehicle network. Int J Veh Des 86(1–4):71–87 Ming-lei S, Ai-zeng L, Li-hua L (2021) Speed control of vehicle automatic driving system based on 5G vehicle network. Int J Veh Des 86(1–4):71–87
7.
Zurück zum Zitat Diederich S, Brendel AB, Morana S, Kolbe L (2022) On the design of and interaction with conversational agents: An organizing and assessing review of human-computer interaction research. J Assoc Inf Syst 23(1):96–138 Diederich S, Brendel AB, Morana S, Kolbe L (2022) On the design of and interaction with conversational agents: An organizing and assessing review of human-computer interaction research. J Assoc Inf Syst 23(1):96–138
8.
Zurück zum Zitat Climent-Pérez P, Florez-Revuelta F (2021) Improved action recognition with separable spatio-temporal attention using alternative skeletal and video pre-processing. Sensors 21(3):1005CrossRef Climent-Pérez P, Florez-Revuelta F (2021) Improved action recognition with separable spatio-temporal attention using alternative skeletal and video pre-processing. Sensors 21(3):1005CrossRef
9.
Zurück zum Zitat Montalva GA, Bastías N, Leyton F (2022) Strong ground motion prediction model for PGV and spectral velocity for the Chilean subduction zone. Bull Seismol Soc Am 112(1):348–360CrossRef Montalva GA, Bastías N, Leyton F (2022) Strong ground motion prediction model for PGV and spectral velocity for the Chilean subduction zone. Bull Seismol Soc Am 112(1):348–360CrossRef
10.
Zurück zum Zitat Meng Z, She C, Zhao G, De Martini D (2022) Sampling, communication, and prediction co-design for synchronizing the real-world device and digital model in metaverse. IEEE J Sel Areas Commun 41(1):288–300CrossRef Meng Z, She C, Zhao G, De Martini D (2022) Sampling, communication, and prediction co-design for synchronizing the real-world device and digital model in metaverse. IEEE J Sel Areas Commun 41(1):288–300CrossRef
11.
Zurück zum Zitat Li W, Zeng Y, Wu Y, Zhang Q, Chen G, Chen Y (2022) Dynamic manifold Boltzmann optimization based on self-supervised learning for human motion estimation. IET Image Proc 16(4):1162–1180CrossRef Li W, Zeng Y, Wu Y, Zhang Q, Chen G, Chen Y (2022) Dynamic manifold Boltzmann optimization based on self-supervised learning for human motion estimation. IET Image Proc 16(4):1162–1180CrossRef
12.
Zurück zum Zitat Sun Y, Zhou J, Zhang X (2020) Human motion pattern recognition based on acceleration sensor. Comput Syst Appl 29(6):196–203 Sun Y, Zhou J, Zhang X (2020) Human motion pattern recognition based on acceleration sensor. Comput Syst Appl 29(6):196–203
13.
Zurück zum Zitat Li L, Zhang Q (2021) Prediction and simulation of human behavior continuity based on time domain segmentation. Comput Simul 38(5):339–343 Li L, Zhang Q (2021) Prediction and simulation of human behavior continuity based on time domain segmentation. Comput Simul 38(5):339–343
14.
Zurück zum Zitat Liu S, Wang S, Liu X, Lin CT, Lv Z (2021) Fuzzy detection aided real-time and robust visual tracking under complex environments. IEEE Trans Fuzzy Syst 29(1):90–102CrossRef Liu S, Wang S, Liu X, Lin CT, Lv Z (2021) Fuzzy detection aided real-time and robust visual tracking under complex environments. IEEE Trans Fuzzy Syst 29(1):90–102CrossRef
15.
Zurück zum Zitat Liu S, Huang S, Wang S, Muhammad K, Bellavista P, Ser JD (2023) Visual tracking in complex scenes: a location fusion mechanism based on the combination of multiple visual cognition flows. Inf Fusion 96:281–296CrossRef Liu S, Huang S, Wang S, Muhammad K, Bellavista P, Ser JD (2023) Visual tracking in complex scenes: a location fusion mechanism based on the combination of multiple visual cognition flows. Inf Fusion 96:281–296CrossRef
16.
Zurück zum Zitat Cui Q, Sun H, Kong Y, Zhang X, Li Y (2020) Efficient human motion prediction using temporal convolutional generative adversarial network. Inf Sci 545(2021):427–447 Cui Q, Sun H, Kong Y, Zhang X, Li Y (2020) Efficient human motion prediction using temporal convolutional generative adversarial network. Inf Sci 545(2021):427–447
17.
Zurück zum Zitat Hacinecipoglu A, Konukseven EI, Koku AB (2020) Multiple human trajectory prediction and cooperative navigation modeling in crowded scenes. Intel Serv Robot 13(4):479–493CrossRef Hacinecipoglu A, Konukseven EI, Koku AB (2020) Multiple human trajectory prediction and cooperative navigation modeling in crowded scenes. Intel Serv Robot 13(4):479–493CrossRef
18.
Zurück zum Zitat Estrada R (2020) Method for auto-calibrate projector and color-depth systems for spatial augmented reality applications. Int J Comput Inf Eng 14(12):548–554 Estrada R (2020) Method for auto-calibrate projector and color-depth systems for spatial augmented reality applications. Int J Comput Inf Eng 14(12):548–554
19.
Zurück zum Zitat Poomhiran L, Phayung M, Sumitra N (2021) Improving the recognition performance of lip reading using the concatenated three sequence keyframe image technique. Eng Technol Appl Sci Res 11(2):6986–6992CrossRef Poomhiran L, Phayung M, Sumitra N (2021) Improving the recognition performance of lip reading using the concatenated three sequence keyframe image technique. Eng Technol Appl Sci Res 11(2):6986–6992CrossRef
20.
Zurück zum Zitat Murn L, Alan FS, Marta M (2021) Interpreting super-resolution CNNs for sub-pixel motion compensation in video coding. Proceedings of the 29th ACM International Conference on Multimedia, 3803–3806 Murn L, Alan FS, Marta M (2021) Interpreting super-resolution CNNs for sub-pixel motion compensation in video coding. Proceedings of the 29th ACM International Conference on Multimedia, 3803–3806
21.
Zurück zum Zitat Fan C, Fu W, Liu S (2022) A high-precision correction method in non-rigid 3D motion poses reconstruction. Connect Sci 34(1):2845–2859CrossRef Fan C, Fu W, Liu S (2022) A high-precision correction method in non-rigid 3D motion poses reconstruction. Connect Sci 34(1):2845–2859CrossRef
22.
Zurück zum Zitat Juliu L, Xiangsuo F, Huajin C, Bing L, Lei M, Zhiyong X (2021) Dim and small target detection based on improved spatio-temporal filtering. IEEE Photonics J 14(1):1–11CrossRef Juliu L, Xiangsuo F, Huajin C, Bing L, Lei M, Zhiyong X (2021) Dim and small target detection based on improved spatio-temporal filtering. IEEE Photonics J 14(1):1–11CrossRef
Metadaten
Titel
Enhancing Human Motion Prediction through Joint-based Analysis and AVI Video Conversion
verfasst von
Yi Xiong
Syed Atif Moqurrab
Awais Ahmad
Publikationsdatum
03.11.2023
Verlag
Springer US
Erschienen in
Mobile Networks and Applications
Print ISSN: 1383-469X
Elektronische ISSN: 1572-8153
DOI
https://doi.org/10.1007/s11036-023-02261-0

Neuer Inhalt