Skip to main content
main-content

Tipp

Weitere Kapitel dieses Buchs durch Wischen aufrufen

2016 | OriginalPaper | Buchkapitel

Interactive Mixed Reality for Muscle Structure and Function Learning

verfasst von : Meng Ma, Philipp Jutzi, Felix Bork, Ina Seelbach, Anna Maria von der Heide, Nassir Navab, Pascal Fallavollita

Erschienen in: Medical Imaging and Augmented Reality

Verlag: Springer International Publishing

share
TEILEN

Abstract

Understanding the structure and function of the muscular system is important in many different medical scenarios, such as student and patient education, muscle training, and rehabilitation of patients with kinetic problems. The structure and function of muscles are difficult to learn as muscle movement is imperceptible using the traditional methods. In this paper, an interactive mixed reality system is proposed for facilitating the learning of the muscles of the upper extremities. The proposed system consists of two main components: an AR view, overlaying the virtual model of the arm on top of the video stream, and a VR view, providing a more detailed understanding of the muscles. The mixed reality view helps the user to mentally map the behaviour of muscles to his/her own body during different movements. A user study including twenty students was performed by a questionnaire framework. The results indicate that our system is useful for learning the structure and function of the muscle and can be a valuable supplement to established muscle learning paradigms.
Literatur
1.
Zurück zum Zitat Azer, S.A.: Can “YouTube” help students in learning surface anatomy? Surg. Radiol. Anat. 34(5), 465–468 (2012) CrossRef Azer, S.A.: Can “YouTube” help students in learning surface anatomy? Surg. Radiol. Anat. 34(5), 465–468 (2012) CrossRef
2.
Zurück zum Zitat Bacca, J., Baldiris, S., Fabregat, R., Graf, S.: Augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014) Bacca, J., Baldiris, S., Fabregat, R., Graf, S.: Augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014)
3.
Zurück zum Zitat Basdogan, C., Sedef, M., Harders, M., Wesarg, S.: VR-based simulators for training in minimally invasive surgery. IEEE Comput. Graph. Appl. 27(2), 54–66 (2007) CrossRef Basdogan, C., Sedef, M., Harders, M., Wesarg, S.: VR-based simulators for training in minimally invasive surgery. IEEE Comput. Graph. Appl. 27(2), 54–66 (2007) CrossRef
4.
Zurück zum Zitat Blum, T., Kleeberger, V., Bichlmeier, C., Navab, N.: Mirracle: an augmented reality magic mirror system for anatomy education. In: Proceedings of the IEEE Virtual Reality, pp. 115–116, March 2012 Blum, T., Kleeberger, V., Bichlmeier, C., Navab, N.: Mirracle: an augmented reality magic mirror system for anatomy education. In: Proceedings of the IEEE Virtual Reality, pp. 115–116, March 2012
5.
Zurück zum Zitat Chang, K.E., Chang, C.T., Hou, H.T., Sung, Y.T., Chao, H.L., Lee, C.M.: Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum. Comput. Educ. 71, 185–197 (2014, 2015) Chang, K.E., Chang, C.T., Hou, H.T., Sung, Y.T., Chao, H.L., Lee, C.M.: Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum. Comput. Educ. 71, 185–197 (2014, 2015)
6.
Zurück zum Zitat Chien, C.H., Chen, C.H., Jeng, T.S.: An interactive augmented reality system for learning anatomy structure. In: Proceedings of the International Multi Conference Engineers and Computer Scientists I (2010) Chien, C.H., Chen, C.H., Jeng, T.S.: An interactive augmented reality system for learning anatomy structure. In: Proceedings of the International Multi Conference Engineers and Computer Scientists I (2010)
7.
Zurück zum Zitat Davis, L., Hamza-Lup, F.G., Daly, J., Ha, Y., Frolich, S., Meyer, C., Martin, G., Norfleet, J., Lin, K.C., Imielinska, C., Rolland, J.P.: Application of augmented reality to visualizing anatomical airways. Proc. SPIE 4711, 400–405 (2002) CrossRef Davis, L., Hamza-Lup, F.G., Daly, J., Ha, Y., Frolich, S., Meyer, C., Martin, G., Norfleet, J., Lin, K.C., Imielinska, C., Rolland, J.P.: Application of augmented reality to visualizing anatomical airways. Proc. SPIE 4711, 400–405 (2002) CrossRef
8.
Zurück zum Zitat Di Serio, Á., Ibáñez, M.B., Kloos, C.D.: Impact of an augmented reality system on students’ motivation for a visual art course. Comput. Educ. 68, 585–596 (2013) CrossRef Di Serio, Á., Ibáñez, M.B., Kloos, C.D.: Impact of an augmented reality system on students’ motivation for a visual art course. Comput. Educ. 68, 585–596 (2013) CrossRef
9.
Zurück zum Zitat General Medical Council: Tomorrow’s Doctors - Outcomes and standards for undergraduate medical education. No. 1, UK: General Medical Council, Manchester (2009) General Medical Council: Tomorrow’s Doctors - Outcomes and standards for undergraduate medical education. No. 1, UK: General Medical Council, Manchester (2009)
10.
Zurück zum Zitat Johnson, L., Adams Becker, S., Estrada, V., Freeman, A.: The NMC Horizon Report: 2015 Higher Education Edition. The New Media Consortium, Austin (2015) Johnson, L., Adams Becker, S., Estrada, V., Freeman, A.: The NMC Horizon Report: 2015 Higher Education Edition. The New Media Consortium, Austin (2015)
11.
Zurück zum Zitat Juan, C., Beatrice, F., Cano, J.: An augmented reality system for learning the interior of the human body. In: Proceedings of the 8th IEEE International Conference on Advanced Learning Technologies ICALT 2008, pp. 186–188 (2008) Juan, C., Beatrice, F., Cano, J.: An augmented reality system for learning the interior of the human body. In: Proceedings of the 8th IEEE International Conference on Advanced Learning Technologies ICALT 2008, pp. 186–188 (2008)
12.
Zurück zum Zitat Lu, J., Pan, Z., Lin, H., Zhang, M., Shi, J.: Virtual learning environment for medical education based on VRML and VTK. Comput. Graph. 29(2), 283–288 (2005) CrossRef Lu, J., Pan, Z., Lin, H., Zhang, M., Shi, J.: Virtual learning environment for medical education based on VRML and VTK. Comput. Graph. 29(2), 283–288 (2005) CrossRef
13.
Zurück zum Zitat Ma, M., Fallavollita, P., Seelbach, I., Heide, A.M.V.D., Euler, E., Waschke, J., et al.: Personalized augmented reality for anatomy education. Clin. Anat. 29(4), 446–453 (2015) CrossRef Ma, M., Fallavollita, P., Seelbach, I., Heide, A.M.V.D., Euler, E., Waschke, J., et al.: Personalized augmented reality for anatomy education. Clin. Anat. 29(4), 446–453 (2015) CrossRef
14.
15.
Zurück zum Zitat McMenamin, P.G.: Body painting as a tool in clinical anatomy teaching. Anat. Sci. Educ. 1(4), 139–144 (2008) CrossRef McMenamin, P.G.: Body painting as a tool in clinical anatomy teaching. Anat. Sci. Educ. 1(4), 139–144 (2008) CrossRef
16.
Zurück zum Zitat Meng, M., Fallavollita, P., Blum, T., Eck, U., Sandor, C., Weidert, S., Waschke, J., Navab, N.: Kinect for interactive AR anatomy learning. In: 2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013, Adelaide, Australia, pp. 277–278, October 2013 Meng, M., Fallavollita, P., Blum, T., Eck, U., Sandor, C., Weidert, S., Waschke, J., Navab, N.: Kinect for interactive AR anatomy learning. In: 2013 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013, Adelaide, Australia, pp. 277–278, October 2013
17.
Zurück zum Zitat Navab, N., Blum, T., Wang, L., Okur, A., Wendler, T.: First deployments of augmented reality in operating rooms. Comput. (Long. Beach. Calif) 45(7), 48–55 (2012) Navab, N., Blum, T., Wang, L., Okur, A., Wendler, T.: First deployments of augmented reality in operating rooms. Comput. (Long. Beach. Calif) 45(7), 48–55 (2012)
18.
Zurück zum Zitat Ni, T., Karlson, A.K., Wigdor, D.: AnatOnMe. In: Proceedings of 2011 Annual Conference on Human Factors in Computing Systems, CHI 2011, p. 3333 (2011) Ni, T., Karlson, A.K., Wigdor, D.: AnatOnMe. In: Proceedings of 2011 Annual Conference on Human Factors in Computing Systems, CHI 2011, p. 3333 (2011)
19.
Zurück zum Zitat Thomas, R.G., John, N.W., Delieu, J.M.: Augmented reality for anatomical education. J. Vis. Commun. Med. 33(1), 6–15 (2010) CrossRef Thomas, R.G., John, N.W., Delieu, J.M.: Augmented reality for anatomical education. J. Vis. Commun. Med. 33(1), 6–15 (2010) CrossRef
Metadaten
Titel
Interactive Mixed Reality for Muscle Structure and Function Learning
verfasst von
Meng Ma
Philipp Jutzi
Felix Bork
Ina Seelbach
Anna Maria von der Heide
Nassir Navab
Pascal Fallavollita
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-43775-0_11

Premium Partner