Skip to main content

2024 | OriginalPaper | Buchkapitel

Practices to MoCap Real-Time Streaming to VR

verfasst von : Nicolas Canale Romeiro, André Salomão, Letícia Maria Fraporti Zanini, Milton Luiz Horn Vieira

Erschienen in: Extended Reality

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Motion capture (MoCap) is a technology that records movement and turn it into 3D data. It can capture even the subtlest of movements, making animations look more natural and helping animators through reducing the time required to achieve a result. With the construction of 3D scenes in Virtual Reality, it might be possible to shorten even more the time needed to successfully achieve good animations resulting from MoCap. This paper explores what concerns VR development of 3D environments suitable for the use of real-time motion capture. The research is justified by the way it intends to enable future research in reducing the recording time per scene, thus through the usage of pre-recorded performances in the MoCap system software to simulate this aspect of the workflow. The goal here is to take precautions to avoid potential performance issues within the virtual environment being displayed in the HMD especially considering the ergonomics issue presented in the procedures of this research. Also, using a specific set of hardware and systems that were available for test, and that might differentiate between research labs, makes it harder to propose global solutions in a formal format to ensure accuracy and consistency for this field of research. Therefore, as a final suggestion, it would be beneficial to investigate the development of a standardized approach or methodology for the real-time use of Virtual Reality with Motion Capture. Currently, the are no commonly accepted procedures or methods for this area of study among academics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Angelov, V., Petkov, E., Shipkovenski, G., Kalushkov, T.: Modern virtual reality headsets. In: 2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), pp. 1–5. IEEE (2020) Angelov, V., Petkov, E., Shipkovenski, G., Kalushkov, T.: Modern virtual reality headsets. In: 2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), pp. 1–5. IEEE (2020)
2.
Zurück zum Zitat Dowlatabadi, Z., Winder, C.: Producing Animation, 3rd edn. CRC Press, Boca Raton (2020) Dowlatabadi, Z., Winder, C.: Producing Animation, 3rd edn. CRC Press, Boca Raton (2020)
3.
Zurück zum Zitat Farrell, W.A.: Learning becomes doing: applying augmented and virtual reality to improve performance. Perform. Improv. 57(4), 19–28 (2018)CrossRef Farrell, W.A.: Learning becomes doing: applying augmented and virtual reality to improve performance. Perform. Improv. 57(4), 19–28 (2018)CrossRef
4.
Zurück zum Zitat Gigante, M.A.: Virtual reality: definitions, history and applications. In: Virtual Reality Systems, pp. 3–14. Elsevier (1993) Gigante, M.A.: Virtual reality: definitions, history and applications. In: Virtual Reality Systems, pp. 3–14. Elsevier (1993)
5.
Zurück zum Zitat Harris, S.R., Kemmerling, R.L., North, M.M.: Brief virtual reality therapy for public speaking anxiety. Cyberpsychol. Behav. 5(6), 543–550 (2002)CrossRef Harris, S.R., Kemmerling, R.L., North, M.M.: Brief virtual reality therapy for public speaking anxiety. Cyberpsychol. Behav. 5(6), 543–550 (2002)CrossRef
6.
Zurück zum Zitat Hayes, D., Webster, C.: Acting and Performance for Animation. Taylor & Francis, Burlington (2013)CrossRef Hayes, D., Webster, C.: Acting and Performance for Animation. Taylor & Francis, Burlington (2013)CrossRef
7.
Zurück zum Zitat Iida, I.: Ergonomia: Projeto e Produção, 2nd edn. Blutcher, São Paulo (2005) Iida, I.: Ergonomia: Projeto e Produção, 2nd edn. Blutcher, São Paulo (2005)
8.
Zurück zum Zitat Jerald, J.: The VR Book: Human-Centered Design for Virtual Reality. Morgan & Claypool, New York (2015) Jerald, J.: The VR Book: Human-Centered Design for Virtual Reality. Morgan & Claypool, New York (2015)
9.
Zurück zum Zitat Kelley, B.: The rise of the ‘quarantine bar simulator’: the uses and gratifications of social VR during the Covid-19 pandemic. In: 2021 4th International Conference on Information and Computer Technologies (ICICT), pp. 216–221. IEEE (2021) Kelley, B.: The rise of the ‘quarantine bar simulator’: the uses and gratifications of social VR during the Covid-19 pandemic. In: 2021 4th International Conference on Information and Computer Technologies (ICICT), pp. 216–221. IEEE (2021)
10.
Zurück zum Zitat Kitagawa, M., Windsor, B.: MoCap for Artists: Workflow and Techniques for Motion Capture. Taylor & Francis, New York (2008) Kitagawa, M., Windsor, B.: MoCap for Artists: Workflow and Techniques for Motion Capture. Taylor & Francis, New York (2008)
11.
Zurück zum Zitat Klinger, E., et al.: Virtual reality therapy versus cognitive behavior therapy for social phobia: a preliminary controlled study. Cyberpsychol. Behav. 8(1), 76–88 (2005)CrossRef Klinger, E., et al.: Virtual reality therapy versus cognitive behavior therapy for social phobia: a preliminary controlled study. Cyberpsychol. Behav. 8(1), 76–88 (2005)CrossRef
12.
Zurück zum Zitat LaValle, S.: Virtual reality. National Programme on Technology Enhanced Learning (NPTEL) (2016) LaValle, S.: Virtual reality. National Programme on Technology Enhanced Learning (NPTEL) (2016)
13.
Zurück zum Zitat Lewis, M., Jacobson, J.: Introduction. Commun. ACM 45(1), 27–31 (2002)CrossRef Lewis, M., Jacobson, J.: Introduction. Commun. ACM 45(1), 27–31 (2002)CrossRef
14.
Zurück zum Zitat Pullen, K., Bregler, C.: Motion capture assisted animation: texturing and synthesis. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, pp. 501–508 (2002) Pullen, K., Bregler, C.: Motion capture assisted animation: texturing and synthesis. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, pp. 501–508 (2002)
15.
Zurück zum Zitat Rincon, A.L., Yamasaki, H., Shimoda, S.: Design of a video game for rehabilitation using motion capture, EMG analysis and virtual reality. In: 2016 International Conference on Electronics. Communications and Computers (CONIELECOMP), pp. 198–204. IEEE, Cholula (2016) Rincon, A.L., Yamasaki, H., Shimoda, S.: Design of a video game for rehabilitation using motion capture, EMG analysis and virtual reality. In: 2016 International Conference on Electronics. Communications and Computers (CONIELECOMP), pp. 198–204. IEEE, Cholula (2016)
16.
Zurück zum Zitat Rivera, F.: Using motion capture and virtual reality to test the advantages of human robot collaboration (2019) Rivera, F.: Using motion capture and virtual reality to test the advantages of human robot collaboration (2019)
17.
Zurück zum Zitat Romeiro, N.C.: Construção de cena para utilização da realidade virtual para o auxílio de atores na captura de movimentos. Ph.D. thesis, Universidade Federal de Santa Catarina (2023) Romeiro, N.C.: Construção de cena para utilização da realidade virtual para o auxílio de atores na captura de movimentos. Ph.D. thesis, Universidade Federal de Santa Catarina (2023)
18.
Zurück zum Zitat Roussou, M., Oliver, M., Slater, M.: The virtual playground: an educational virtual reality environment for evaluating interactivity and conceptual learning. Virtual Reality 10, 227–240 (2006)CrossRef Roussou, M., Oliver, M., Slater, M.: The virtual playground: an educational virtual reality environment for evaluating interactivity and conceptual learning. Virtual Reality 10, 227–240 (2006)CrossRef
19.
Zurück zum Zitat Rzeszewski, M., Evans, L.: Virtual place during quarantine-a curious case of VRChat. Rozwój Regionalny i Polityka Regionalna 51, 57–75 (2020)CrossRef Rzeszewski, M., Evans, L.: Virtual place during quarantine-a curious case of VRChat. Rozwój Regionalny i Polityka Regionalna 51, 57–75 (2020)CrossRef
20.
Zurück zum Zitat Salomão, A.: Treinamento baseado em design de jogos (2020) Salomão, A.: Treinamento baseado em design de jogos (2020)
21.
Zurück zum Zitat Salomão, A.: Procedimento para adaptacao de animacao 3D a realidade virtual. Ph.D. thesis, Universidade Federal de Santa Catarina (2024) Salomão, A.: Procedimento para adaptacao de animacao 3D a realidade virtual. Ph.D. thesis, Universidade Federal de Santa Catarina (2024)
22.
Zurück zum Zitat Salomão, A., Andaló, F., Prim, G., Horn Vieira, M.L., Romeiro, N.C.: Case studies of motion capture as a tool for human-computer interaction research in the areas of design and animation. In: Kurosu, M. (eds.) International Conference on Human-Computer Interaction, pp. 302–311. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-05311-5_21 Salomão, A., Andaló, F., Prim, G., Horn Vieira, M.L., Romeiro, N.C.: Case studies of motion capture as a tool for human-computer interaction research in the areas of design and animation. In: Kurosu, M. (eds.) International Conference on Human-Computer Interaction, pp. 302–311. Springer, Cham (2022). https://​doi.​org/​10.​1007/​978-3-031-05311-5_​21
23.
Zurück zum Zitat de Souza Braga, N.: Desenvolvimento de personagem 3D utilizando captura de movimento para jogos digitais (2017) de Souza Braga, N.: Desenvolvimento de personagem 3D utilizando captura de movimento para jogos digitais (2017)
24.
Zurück zum Zitat Won, A.S., Bailenson, J., Lee, J., Lanier, J.: Homuncular flexibility in virtual reality. J. Comput.-Mediat. Commun. 20(3), 241–259 (2015)CrossRef Won, A.S., Bailenson, J., Lee, J., Lanier, J.: Homuncular flexibility in virtual reality. J. Comput.-Mediat. Commun. 20(3), 241–259 (2015)CrossRef
25.
Zurück zum Zitat Àndal’o, F.: Desenvolvimento de procedimentos para utilização da captura de movimentos aplicada em personagens 3D. Ph.D. thesis, Universidade Federal de Santa Catarina (2019) Àndal’o, F.: Desenvolvimento de procedimentos para utilização da captura de movimentos aplicada em personagens 3D. Ph.D. thesis, Universidade Federal de Santa Catarina (2019)
Metadaten
Titel
Practices to MoCap Real-Time Streaming to VR
verfasst von
Nicolas Canale Romeiro
André Salomão
Letícia Maria Fraporti Zanini
Milton Luiz Horn Vieira
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-71707-9_4