Skip to main content
Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) 3/2020

12.08.2020 | Original Paper

Usability test with medical personnel of a hand-gesture control techniques for surgical environment

verfasst von: Luis Bautista, Fernanda Maradei, Gabriel Pedraza

Erschienen in: International Journal on Interactive Design and Manufacturing (IJIDeM) | Ausgabe 3/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Computer-assisted orthopedic surgery (CAOS) and augmented reality provides guidance for surgical environments in minimally invasive procedures. However, the surgeon’s interaction with those systems has limitations, because the surgical environment must be kept sterile. Two touch-less interaction techniques were evaluated within this research work, a vision-based technique used by META® glasses and electromyography-based used by MYO® arm-band. The research aim was to establish the most appropriate one touch-less interaction technique to manipulate a CAOS system. Usability was evaluated through an experiment with 4 orthopedic surgeons and 47 undergraduate students, in a simulated setting. The results suggest that both techniques can be relevant and useful in a surgical environment. However, the MYO was more efficient and possibly more effective to perform the manipulation tasks than META. In addition, the MYO arm-band was perceived as further satisfactory compared to META glasses and shown an improved overall behaviour in the CAOS system manipulations tasks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Alkhamisi, A.O., Monowa, M.M.: Rise of augmented reality, current and future application areas. Int. J. Internet Distrib. Syst. 1(4), 25–34 (2013)CrossRef Alkhamisi, A.O., Monowa, M.M.: Rise of augmented reality, current and future application areas. Int. J. Internet Distrib. Syst. 1(4), 25–34 (2013)CrossRef
2.
Zurück zum Zitat Brangier, É., Barcenilla, J.: Concevoir un produit facile à utiliser Adapter les technologies á l’homme. Éditions d’Organisation (2005) Brangier, É., Barcenilla, J.: Concevoir un produit facile à utiliser Adapter les technologies á l’homme. Éditions d’Organisation (2005)
3.
Zurück zum Zitat Bigdelou, A., Schwarz, L.A., Navab, N.: An adaptive solution for intra-operative gesture-based human-machine interaction. In: International Conference on Intelligent User Interfaces, Proceedings IU, vol. I, pp. 75–83 (2012) Bigdelou, A., Schwarz, L.A., Navab, N.: An adaptive solution for intra-operative gesture-based human-machine interaction. In: International Conference on Intelligent User Interfaces, Proceedings IU, vol. I, pp. 75–83 (2012)
4.
Zurück zum Zitat Ca\(\tilde{\rm N}\)as, J.W.Y.: Ergonomía Cognitiva. Panamericana, Madrid (2001) Ca\(\tilde{\rm N}\)as, J.W.Y.: Ergonomía Cognitiva. Panamericana, Madrid (2001)
5.
Zurück zum Zitat Chalil Madathil, K., Greenstein, J.S.: An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing. Appl. Ergon. 65, 501–514 (2017)CrossRef Chalil Madathil, K., Greenstein, J.S.: An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing. Appl. Ergon. 65, 501–514 (2017)CrossRef
6.
Zurück zum Zitat Chalmers, P.N., Mall, N.A., Cole, B.J., Verma, N.N., Bush-Joseph, C.A., Bach, B.R.: Anteromedial versus transtibial tunnel drilling in anterior cruciate ligament reconstructions: a systematic review. Arthrosc. J. Arthrosc. Related Surg. 29(7), 1235–1242 (2013)CrossRef Chalmers, P.N., Mall, N.A., Cole, B.J., Verma, N.N., Bush-Joseph, C.A., Bach, B.R.: Anteromedial versus transtibial tunnel drilling in anterior cruciate ligament reconstructions: a systematic review. Arthrosc. J. Arthrosc. Related Surg. 29(7), 1235–1242 (2013)CrossRef
7.
Zurück zum Zitat Chang, D., Dooley, L.T.J.: Gestalt theory in visual screen design: a new look at an old subject. In: Proceedings of the Seventh World Conference on Computers in Education Conference on Computers in Education: Australian Topics, vol. 8, pp. 5–12 (2002) Chang, D., Dooley, L.T.J.: Gestalt theory in visual screen design: a new look at an old subject. In: Proceedings of the Seventh World Conference on Computers in Education Conference on Computers in Education: Australian Topics, vol. 8, pp. 5–12 (2002)
8.
Zurück zum Zitat Christensen, G.L., Olson, J.C.: Mapping consumers’ mental models with ZMET. Psychol. Mark. 19(6), 477–502 (2002)CrossRef Christensen, G.L., Olson, J.C.: Mapping consumers’ mental models with ZMET. Psychol. Mark. 19(6), 477–502 (2002)CrossRef
9.
Zurück zum Zitat Graetzel, C., Fong, T.G.S.B.C.: A non-contact mouse for surgeon-computer interaction. Technol. Health Care 12(03), 245–257 (2004)CrossRef Graetzel, C., Fong, T.G.S.B.C.: A non-contact mouse for surgeon-computer interaction. Technol. Health Care 12(03), 245–257 (2004)CrossRef
10.
Zurück zum Zitat Helander, M.G., Zhang, L.: Field studies of comfort and discomfort in sitting. Ergonomics 40(9), 895–915 (1997)CrossRef Helander, M.G., Zhang, L.: Field studies of comfort and discomfort in sitting. Ergonomics 40(9), 895–915 (1997)CrossRef
11.
Zurück zum Zitat Iannessi, A., Marcy, P.Y., Clatz, O., Ayache, N., Fillard, P.: Touchless user interface for intraoperative image control: almost there. Radiographics 34(4), 1142–1144 (2014)CrossRef Iannessi, A., Marcy, P.Y., Clatz, O., Ayache, N., Fillard, P.: Touchless user interface for intraoperative image control: almost there. Radiographics 34(4), 1142–1144 (2014)CrossRef
12.
Zurück zum Zitat Jalaliniya, S., Smith, J., Sousa, M., Büthe, L., Pederson, T.: Touch-less interaction with medical images using hand & foot gestures. In: UbiComp 2013 Adjunct—Adjunct Publication of the 2013 ACM Conference on Ubiquitous Computing, pp. 1265–1274 (2013) Jalaliniya, S., Smith, J., Sousa, M., Büthe, L., Pederson, T.: Touch-less interaction with medical images using hand & foot gestures. In: UbiComp 2013 Adjunct—Adjunct Publication of the 2013 ACM Conference on Ubiquitous Computing, pp. 1265–1274 (2013)
13.
Zurück zum Zitat Johnson, R., O’Hara, K., Sellen, A., Cousins, C., Criminisi, A.: Exploring the potential for touchless interaction in image-guided interventional radiology. In: Conference on Human Factors in Computing Systems—Proceedings, pp. 3323–3332 (2011) Johnson, R., O’Hara, K., Sellen, A., Cousins, C., Criminisi, A.: Exploring the potential for touchless interaction in image-guided interventional radiology. In: Conference on Human Factors in Computing Systems—Proceedings, pp. 3323–3332 (2011)
14.
Zurück zum Zitat Karwowski, W., Marras, W.: The Occupational Ergonomics. Hand Book. CRC Press, Washington (1999) Karwowski, W., Marras, W.: The Occupational Ergonomics. Hand Book. CRC Press, Washington (1999)
15.
Zurück zum Zitat Kasahara, S., Miyamoto, K., Takahashi, M., Yamanaka, M., Takeda, N.: Lumbar-pelvic coordination in the sitting position. Gait Posture 28(2), 251–257 (2008)CrossRef Kasahara, S., Miyamoto, K., Takahashi, M., Yamanaka, M., Takeda, N.: Lumbar-pelvic coordination in the sitting position. Gait Posture 28(2), 251–257 (2008)CrossRef
16.
Zurück zum Zitat Kenngott, H.G., Wagner, M., Nickel, F., Wekerle, A.L., Preukschas, A., Apitz, M., Schulte, T., Rempel, R., Mietkowski, P., Wagner, F., Termer, A., Müller-Stich, B.P.: Computer-assisted abdominal surgery: new technologies. Langenbeck’s Arch. Surg. 400(3), 273–281 (2015)CrossRef Kenngott, H.G., Wagner, M., Nickel, F., Wekerle, A.L., Preukschas, A., Apitz, M., Schulte, T., Rempel, R., Mietkowski, P., Wagner, F., Termer, A., Müller-Stich, B.P.: Computer-assisted abdominal surgery: new technologies. Langenbeck’s Arch. Surg. 400(3), 273–281 (2015)CrossRef
17.
Zurück zum Zitat Ketabdar, H., Jahnbekam, A., Yüksel, K.A., Hirsch, T., Abolhassani, A.H.: MagiMusic: using embedded compass (magnetic) sensor for touch-less gesture based interaction with digital music instruments in mobile devices. In: Proceedings of the 5th International Conference on Tangible Embedded and Embodied Interaction, TEI’11, pp. 241–244 (2011) Ketabdar, H., Jahnbekam, A., Yüksel, K.A., Hirsch, T., Abolhassani, A.H.: MagiMusic: using embedded compass (magnetic) sensor for touch-less gesture based interaction with digital music instruments in mobile devices. In: Proceedings of the 5th International Conference on Tangible Embedded and Embodied Interaction, TEI’11, pp. 241–244 (2011)
18.
Zurück zum Zitat Koh, J., Marcus, M.S.: Computer-assisted Anterior Cruciate Ligament (ACL) Reconstruction: The US Perspective, pp. 206–214 Koh, J., Marcus, M.S.: Computer-assisted Anterior Cruciate Ligament (ACL) Reconstruction: The US Perspective, pp. 206–214
19.
Zurück zum Zitat Kong, Y.K., Lowe, B.D.: Optimal cylindrical handle diameter for grip force tasks. Int. J. Ind. Ergon. 35(6), 495–507 (2005)CrossRef Kong, Y.K., Lowe, B.D.: Optimal cylindrical handle diameter for grip force tasks. Int. J. Ind. Ergon. 35(6), 495–507 (2005)CrossRef
20.
Zurück zum Zitat Link, T., Kleiner, C., Mancuso, M.P., Dziadkowiec, O., Halverson-Carpenter, K.: Determining high touch areas in the operating room with levels of contamination. Am. J. Infect. Control 44(11), 1350–1355 (2016)CrossRef Link, T., Kleiner, C., Mancuso, M.P., Dziadkowiec, O., Halverson-Carpenter, K.: Determining high touch areas in the operating room with levels of contamination. Am. J. Infect. Control 44(11), 1350–1355 (2016)CrossRef
21.
Zurück zum Zitat Lopes, D.S., Parreira, P.D.d.F., Paulo, S.F., Nunes, V., Rego, P.A., Neves, M.C., Rodrigues, P.S., Jorge, J.A.: On the utility of 3D hand cursors to explore medical volume datasets with a touchless interface. J. Biomed. Inform. 72, 140–149 (2017) Lopes, D.S., Parreira, P.D.d.F., Paulo, S.F., Nunes, V., Rego, P.A., Neves, M.C., Rodrigues, P.S., Jorge, J.A.: On the utility of 3D hand cursors to explore medical volume datasets with a touchless interface. J. Biomed. Inform. 72, 140–149 (2017)
22.
Zurück zum Zitat Ma, M., Fallavollita, P., Habert, S., Weidert, S., Navab, N.: Device- and system-independent personal touchless user interface for operating rooms: one personal UI to control all displays in an operating room. Int. J. Computer Assist. Radiol. Surg. 11(6), 853–861 (2016)CrossRef Ma, M., Fallavollita, P., Habert, S., Weidert, S., Navab, N.: Device- and system-independent personal touchless user interface for operating rooms: one personal UI to control all displays in an operating room. Int. J. Computer Assist. Radiol. Surg. 11(6), 853–861 (2016)CrossRef
23.
Zurück zum Zitat Mewes, A., Hensen, B., Wacker, F., Hansen, C.: Touchless interaction with software in interventional radiology and surgery: a systematic literature review. Int. J. Comput. Assist. Radiol. Surg. 12(2), 291–305 (2017)CrossRef Mewes, A., Hensen, B., Wacker, F., Hansen, C.: Touchless interaction with software in interventional radiology and surgery: a systematic literature review. Int. J. Comput. Assist. Radiol. Surg. 12(2), 291–305 (2017)CrossRef
24.
Zurück zum Zitat Mishra, A.K., Wadhai, V.S.: Sterility testing of operation theatres in hospitals. Int. J. Curr. Microbiol. Appl. Sci. 5(5), 440–447 (2016)CrossRef Mishra, A.K., Wadhai, V.S.: Sterility testing of operation theatres in hospitals. Int. J. Curr. Microbiol. Appl. Sci. 5(5), 440–447 (2016)CrossRef
25.
Zurück zum Zitat Norman, D.: El diseño emocional: por qué nos gustan (o no) los objetos cotidianos. Ed. Paidós Ibérica, España (2005) Norman, D.: El diseño emocional: por qué nos gustan (o no) los objetos cotidianos. Ed. Paidós Ibérica, España (2005)
26.
Zurück zum Zitat Norman, D.: Some observations on mental models. In: Seel, N.M. (ed.) Mental Models. Springer, New York (2014) Norman, D.: Some observations on mental models. In: Seel, N.M. (ed.) Mental Models. Springer, New York (2014)
27.
Zurück zum Zitat Pedersen, I., Gale, N., Mirza-Babaei, P., Reid, S.: More than meets the eye: the benefits of augmented reality and holographic displays for digital cultural heritage. J. Comput. Cult. Heritage 10(2), 1–15 (2017)CrossRef Pedersen, I., Gale, N., Mirza-Babaei, P., Reid, S.: More than meets the eye: the benefits of augmented reality and holographic displays for digital cultural heritage. J. Comput. Cult. Heritage 10(2), 1–15 (2017)CrossRef
28.
Zurück zum Zitat Reinschluessel, A., Teuber, J., Herrlich, M., Bissel, J., Van Eikeren, M., Ganser, J., Koeller, F., Kollasch, F., Mildner, T., Raimondo, L., Reisig, L., Ruedel, M., Thieme, D., Vahl, T., Zachmann, G., Malaka, R.: Virtual reality for user-centered design and evaluation of touch-free interaction techniques for navigating medical images in the operating room. In: Conference on Human Factors in Computing Systems—Proceedings Part F, vol. 127655, pp. 2001–2009 (2017) Reinschluessel, A., Teuber, J., Herrlich, M., Bissel, J., Van Eikeren, M., Ganser, J., Koeller, F., Kollasch, F., Mildner, T., Raimondo, L., Reisig, L., Ruedel, M., Thieme, D., Vahl, T., Zachmann, G., Malaka, R.: Virtual reality for user-centered design and evaluation of touch-free interaction techniques for navigating medical images in the operating room. In: Conference on Human Factors in Computing Systems—Proceedings Part F, vol. 127655, pp. 2001–2009 (2017)
29.
Zurück zum Zitat Rosa, G.M., Elizondo, M.L.: Use of a gesture user interface as a touchless image navigation system in dental surgery: case series report. Imaging Sci. Dent. 44(2), 155–160 (2014)CrossRef Rosa, G.M., Elizondo, M.L.: Use of a gesture user interface as a touchless image navigation system in dental surgery: case series report. Imaging Sci. Dent. 44(2), 155–160 (2014)CrossRef
30.
Zurück zum Zitat San Martin, J., Miraut, D., Gomez, C., Bayona, S.: Design of an adaptable haptic device for an arthroscopy training environment. Int. J. Interact. Des. Manuf. (IJIDeM) 1(3), 169–173 (2007)CrossRef San Martin, J., Miraut, D., Gomez, C., Bayona, S.: Design of an adaptable haptic device for an arthroscopy training environment. Int. J. Interact. Des. Manuf. (IJIDeM) 1(3), 169–173 (2007)CrossRef
31.
Zurück zum Zitat Sánchez-Margallo, F.M., Sánchez-Margallo, J.A., Moyano-Cuevas, J.L., Pérez, E.M., Maestre, J.: Use of natural user interfaces for image navigation during laparoscopic surgery: initial experience. Minim. Invasive Therapy Allied Technol. 26(5), 253–261 (2017)CrossRef Sánchez-Margallo, F.M., Sánchez-Margallo, J.A., Moyano-Cuevas, J.L., Pérez, E.M., Maestre, J.: Use of natural user interfaces for image navigation during laparoscopic surgery: initial experience. Minim. Invasive Therapy Allied Technol. 26(5), 253–261 (2017)CrossRef
32.
Zurück zum Zitat Sathiyanarayanan, M., Rajan, S.: MYO Armband for physiotherapy healthcare: a case study using gesture recognition application. In: 2016 8th International Conference on Communication Systems and Networks, COMSNETS 2016, pp. 1–6 (2016) Sathiyanarayanan, M., Rajan, S.: MYO Armband for physiotherapy healthcare: a case study using gesture recognition application. In: 2016 8th International Conference on Communication Systems and Networks, COMSNETS 2016, pp. 1–6 (2016)
33.
Zurück zum Zitat Sielhorst, T., Feuerstein, M., Navab, N.: Advanced medical displays: a literature review of augmented reality. IEEE/OSA J. Display Technol. 4(4), 451–467 (2008)CrossRef Sielhorst, T., Feuerstein, M., Navab, N.: Advanced medical displays: a literature review of augmented reality. IEEE/OSA J. Display Technol. 4(4), 451–467 (2008)CrossRef
34.
Zurück zum Zitat Strickland, M., Tremaine, J., Brigley, G., Law, C.: Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field. Can. J. Surg. 56, 3 (2013)CrossRef Strickland, M., Tremaine, J., Brigley, G., Law, C.: Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field. Can. J. Surg. 56, 3 (2013)CrossRef
35.
Zurück zum Zitat Sun, H.M., Li, S.P., Zhu, Y.Q., Hsiao, B.: The effect of user’s perceived presence and promotion focus onusability for interacting in virtual environments. Appl. Ergon. 50, 126–132 (2015)CrossRef Sun, H.M., Li, S.P., Zhu, Y.Q., Hsiao, B.: The effect of user’s perceived presence and promotion focus onusability for interacting in virtual environments. Appl. Ergon. 50, 126–132 (2015)CrossRef
36.
Zurück zum Zitat Takahashi, H., Kawashima, T.: Touch-sensitive augmented reality system for development of handheld information appliances. Int. J. Interact. Des. Manuf. (IJIDeM) 4(1), 25–33 (2010)CrossRef Takahashi, H., Kawashima, T.: Touch-sensitive augmented reality system for development of handheld information appliances. Int. J. Interact. Des. Manuf. (IJIDeM) 4(1), 25–33 (2010)CrossRef
37.
Zurück zum Zitat Valentini, P.P.: Natural interface for interactive virtual assembly in augmented reality using Leap Motion Controller. Int. J. Interact. Des. Manuf. (IJIDeM) 12(4), 1157–1165 (2018)CrossRef Valentini, P.P.: Natural interface for interactive virtual assembly in augmented reality using Leap Motion Controller. Int. J. Interact. Des. Manuf. (IJIDeM) 12(4), 1157–1165 (2018)CrossRef
38.
Zurück zum Zitat Weick, K.E.: Mental models of high reliability systems. Org. Environ. 3(2), 127–142 (1989) Weick, K.E.: Mental models of high reliability systems. Org. Environ. 3(2), 127–142 (1989)
39.
Zurück zum Zitat Wiberg, M.: Interaction, new materials & computing—beyond the disappearing computer, towards material interactions. Mater. Des. 90, 1200–1206 (2014)CrossRef Wiberg, M.: Interaction, new materials & computing—beyond the disappearing computer, towards material interactions. Mater. Des. 90, 1200–1206 (2014)CrossRef
40.
Zurück zum Zitat Zinnen, A., Schiele, B., Ziegert, T.: Browsing patient records during ward rounds with a body worn gyroscope. In: Proceedings—International Symposium on Wearable Computers, ISWC, vol. 1, pp. 107–108 (2007) Zinnen, A., Schiele, B., Ziegert, T.: Browsing patient records during ward rounds with a body worn gyroscope. In: Proceedings—International Symposium on Wearable Computers, ISWC, vol. 1, pp. 107–108 (2007)
Metadaten
Titel
Usability test with medical personnel of a hand-gesture control techniques for surgical environment
verfasst von
Luis Bautista
Fernanda Maradei
Gabriel Pedraza
Publikationsdatum
12.08.2020
Verlag
Springer Paris
Erschienen in
International Journal on Interactive Design and Manufacturing (IJIDeM) / Ausgabe 3/2020
Print ISSN: 1955-2513
Elektronische ISSN: 1955-2505
DOI
https://doi.org/10.1007/s12008-020-00690-9

Weitere Artikel der Ausgabe 3/2020

International Journal on Interactive Design and Manufacturing (IJIDeM) 3/2020 Zur Ausgabe

Premium Partner