Skip to main content
Top

2023 | OriginalPaper | Chapter

Natural Surgeon Interfaces: Perspectives and Examples of Intuitive Laser Control Systems in the μRALP Project

Authors : Giacinto Barresi, Darwin G. Caldwell, Leonardo S. Mattos

Published in: Ergonomics and Nudging for Health, Safety and Happiness

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper aims at discussing the opportunities offered by the perspectives of natural and reality-based interaction design in robot-assisted microsurgery. Specifically, it presents the “Natural Surgeon Interfaces” (NSIs) designed during μRALP (European project on Micro-Technologies and Systems for Robot-Assisted Endoscopic Laser Microsurgery). The goal was to make the experience of controlling a laser similar to handling a scalpel. In terms of cognitive ergonomics and neuroergonomics, the NSI systems in μRALP were based on the enactive coupling of perception and action that occurs when humans handle a tool. Accordingly, μRALP proposed a Virtual Scalpel and a Haptic Scalpel, which became part of a Neurotraining Scalpel setup too. Such exemplary cases of visuo-haptic paradigms of μRALP can truly make a physician a “natural surgeon”.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Acemoglu, A., Deshpande, N., Lee, J., Caldwell, D.G., Mattos, L.S.: The CALM system: new generation computer-assisted laser microsurgery. In: 2019 19th International Conference on Advanced Robotics (ICAR) (2019) Acemoglu, A., Deshpande, N., Lee, J., Caldwell, D.G., Mattos, L.S.: The CALM system: new generation computer-assisted laser microsurgery. In: 2019 19th International Conference on Advanced Robotics (ICAR) (2019)
go back to reference Acemoglu, A., et al.: 5G robotic telesurgery: Remote transoral laser microsurgeries on a cadaver. IEEE Trans. Med. Robot. Bionics 2(4), 511–518 (2020)CrossRef Acemoglu, A., et al.: 5G robotic telesurgery: Remote transoral laser microsurgeries on a cadaver. IEEE Trans. Med. Robot. Bionics 2(4), 511–518 (2020)CrossRef
go back to reference Barresi, G., et al.: Comparative usability and performance evaluation of surgeon interfaces in laser phonomicrosurgery. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (2013) Barresi, G., et al.: Comparative usability and performance evaluation of surgeon interfaces in laser phonomicrosurgery. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (2013)
go back to reference Barresi, G., Olivieri, E., Caldwell, D.G., Mattos, L.S.: Brain-controlled AR feedback design for user's training in surgical HRI. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics (2015) Barresi, G., Olivieri, E., Caldwell, D.G., Mattos, L.S.: Brain-controlled AR feedback design for user's training in surgical HRI. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics (2015)
go back to reference Berger, J., Unger, M., Landgraf, L., Bieck, R., Neumuth, T., Melzer, A.: Assessment of natural user interactions for robot-assisted interventions. Curr. Dir. Biomed. Eng. 4(1), 165–168 (2018)CrossRef Berger, J., Unger, M., Landgraf, L., Bieck, R., Neumuth, T., Melzer, A.: Assessment of natural user interactions for robot-assisted interventions. Curr. Dir. Biomed. Eng. 4(1), 165–168 (2018)CrossRef
go back to reference Deshpande, N., et al.: Imaging based metrics for performance assessment in laser phonomicrosurgery. In: 2013 IEEE International Conference on Robotics and Automation (2013) Deshpande, N., et al.: Imaging based metrics for performance assessment in laser phonomicrosurgery. In: 2013 IEEE International Conference on Robotics and Automation (2013)
go back to reference Deshpande, N., Ortiz, J., Caldwell, D.G., Mattos, L.S.: Enhanced computer-assisted laser microsurgeries with a “virtual microscope” based surgical system. In: 2014 IEEE International Conference on Robotics and Automation (ICRA) (2014) Deshpande, N., Ortiz, J., Caldwell, D.G., Mattos, L.S.: Enhanced computer-assisted laser microsurgeries with a “virtual microscope” based surgical system. In: 2014 IEEE International Conference on Robotics and Automation (ICRA) (2014)
go back to reference Fichera, L.: Bringing the light inside the body to perform better surgery. Sci. Robot. 6(50), eabf1523 (2021) Fichera, L.: Bringing the light inside the body to perform better surgery. Sci. Robot. 6(50), eabf1523 (2021)
go back to reference Fichera, L., Pacchierotti, C., Olivieri, E., Prattichizzo, D., Mattos, L.S.: Kinesthetic and vibrotactile haptic feedback improves the performance of laser microsurgery. In: 2016 IEEE Haptics Symposium (HAPTICS) (2016) Fichera, L., Pacchierotti, C., Olivieri, E., Prattichizzo, D., Mattos, L.S.: Kinesthetic and vibrotactile haptic feedback improves the performance of laser microsurgery. In: 2016 IEEE Haptics Symposium (HAPTICS) (2016)
go back to reference Gallagher, S.: The enactive hand. The hand, an organ of the mind: what the manual tells the mental, 209–225 (2013) Gallagher, S.: The enactive hand. The hand, an organ of the mind: what the manual tells the mental, 209–225 (2013)
go back to reference Hedge, A.: Design of hand-operated devices. Human Fact. Cons. Prod. 1, 203–222 (1998) Hedge, A.: Design of hand-operated devices. Human Fact. Cons. Prod. 1, 203–222 (1998)
go back to reference Hipólito, I., Baltieri, M., Friston, K., Ramstead, M.J.: Embodied skillful performance: where the action is. Synthese 199(1), 4457–4481 (2021)CrossRef Hipólito, I., Baltieri, M., Friston, K., Ramstead, M.J.: Embodied skillful performance: where the action is. Synthese 199(1), 4457–4481 (2021)CrossRef
go back to reference Jacob, R.J., et al.: Reality-based interaction: a framework for post-WIMP interfaces. In: Proceedings of the SIGCHI Conference On Human Factors In Computing Systems (2008) Jacob, R.J., et al.: Reality-based interaction: a framework for post-WIMP interfaces. In: Proceedings of the SIGCHI Conference On Human Factors In Computing Systems (2008)
go back to reference Liu, W.: Natural user interface-next mainstream product user interface. In: 2010 IEEE 11th International Conference on Computer-Aided Industrial Design & Conceptual Design 1 (2010) Liu, W.: Natural user interface-next mainstream product user interface. In: 2010 IEEE 11th International Conference on Computer-Aided Industrial Design & Conceptual Design 1 (2010)
go back to reference Malizia, A., Bellucci, A.: The artificiality of natural user interfaces. Commun. ACM 55(3), 36–38 (2012)CrossRef Malizia, A., Bellucci, A.: The artificiality of natural user interfaces. Commun. ACM 55(3), 36–38 (2012)CrossRef
go back to reference Maronnat, F., Davesne, F., Otmane, S.: Cognitive assessment in virtual environments: how to choose the natural user interfaces? Virtual Reality International Conference Vric Convrgence 2022 Proceedings (2022) Maronnat, F., Davesne, F., Otmane, S.: Cognitive assessment in virtual environments: how to choose the natural user interfaces? Virtual Reality International Conference Vric Convrgence 2022 Proceedings (2022)
go back to reference Mattos, L., Andreff, N.: The µRALP project: new technologies and systems for robot-assisted laser phonomicrosurgery. In: 3rd Joint Workshop on New Technologies for Computer/Robot Assisted Surgery (2013) Mattos, L., Andreff, N.: The µRALP project: new technologies and systems for robot-assisted laser phonomicrosurgery. In: 3rd Joint Workshop on New Technologies for Computer/Robot Assisted Surgery (2013)
go back to reference Mattos, L.S., Caldwell, D.G., Peretti, G., Mora, F., Guastini, L., Cingolani, R.: Microsurgery robots: addressing the needs of high-precision surgical interventions. Swiss medical weekly (43) (2016) Mattos, L.S., Caldwell, D.G., Peretti, G., Mora, F., Guastini, L., Cingolani, R.: Microsurgery robots: addressing the needs of high-precision surgical interventions. Swiss medical weekly (43) (2016)
go back to reference Mattos, L.S., Dagnino, G., Becattini, G., Dellepiane, M., Caldwell, D.G.: A virtual scalpel system for computer-assisted laser microsurgery. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (2011) Mattos, L.S., Dagnino, G., Becattini, G., Dellepiane, M., Caldwell, D.G.: A virtual scalpel system for computer-assisted laser microsurgery. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (2011)
go back to reference Mattos, L.S., Deshpande, N., Barresi, G., Guastini, L., Peretti, G.: A novel computerized surgeon–machine interface for robot-assisted laser phonomicrosurgery. Laryngoscope 124(8), 1887–1894 (2014)CrossRef Mattos, L.S., Deshpande, N., Barresi, G., Guastini, L., Peretti, G.: A novel computerized surgeon–machine interface for robot-assisted laser phonomicrosurgery. Laryngoscope 124(8), 1887–1894 (2014)CrossRef
go back to reference Mattos, L.S., et al.: Microsurgery systems. The E-Medicine, E-Heath, M-Health, Telemedicine, and Telehealth Handbook 2, 61–89 (2015) Mattos, L.S., et al.: Microsurgery systems. The E-Medicine, E-Heath, M-Health, Telemedicine, and Telehealth Handbook 2, 61–89 (2015)
go back to reference Olivieri, E., Barresi, G., Caldwell, D.G., Mattos, L.S.: Haptic feedback for control and active constraints in contactless laser surgery: concept, implementation, and evaluation. IEEE Trans. Haptics 11(2), 241–254 (2017)CrossRef Olivieri, E., Barresi, G., Caldwell, D.G., Mattos, L.S.: Haptic feedback for control and active constraints in contactless laser surgery: concept, implementation, and evaluation. IEEE Trans. Haptics 11(2), 241–254 (2017)CrossRef
go back to reference Olivieri, E., Barresi, G., Mattos, L.S.: BCI-based user training in surgical robotics. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (2015) Olivieri, E., Barresi, G., Mattos, L.S.: BCI-based user training in surgical robotics. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (2015)
go back to reference Park, G.D., Strom, M., Reed, C.L.: To the end! Distribution of attention along a tool in peri-and extrapersonal space. Exp. Brain Res. 227(4), 423–432 (2013)CrossRef Park, G.D., Strom, M., Reed, C.L.: To the end! Distribution of attention along a tool in peri-and extrapersonal space. Exp. Brain Res. 227(4), 423–432 (2013)CrossRef
go back to reference Renevier, R., Tamadazte, B., Rabenorosoa, K., Tavernier, L., Andreff, N.: Endoscopic laser surgery: design, modeling, and control. IEEE/ASME Trans. Mechatron. 22(1), 99–106 (2016)CrossRef Renevier, R., Tamadazte, B., Rabenorosoa, K., Tavernier, L., Andreff, N.: Endoscopic laser surgery: design, modeling, and control. IEEE/ASME Trans. Mechatron. 22(1), 99–106 (2016)CrossRef
go back to reference Varela, F.J., Thompson, E., Rosch, E.: The embodied mind, revised edition: Cognitive science and human experience. MIT press (2017) Varela, F.J., Thompson, E., Rosch, E.: The embodied mind, revised edition: Cognitive science and human experience. MIT press (2017)
go back to reference Wang, J.-R., Hsieh, S.: Neurofeedback training improves attention and working memory performance. Clin. Neurophysiol. 124(12), 2406–2420 (2013)CrossRef Wang, J.-R., Hsieh, S.: Neurofeedback training improves attention and working memory performance. Clin. Neurophysiol. 124(12), 2406–2420 (2013)CrossRef
go back to reference Worringham, C.J., Beringer, D.B.: Directional stimulus-response compatibility: a test of three alternative principles. Ergonomics 41(6), 864–880 (1998)CrossRef Worringham, C.J., Beringer, D.B.: Directional stimulus-response compatibility: a test of three alternative principles. Ergonomics 41(6), 864–880 (1998)CrossRef
go back to reference Wu, X., Thomson, G., Tang, B.: An investigation into the impact of safety features on the ergonomics of surgical scalpels. Appl. Ergon. 40(3), 424–432 (2009)CrossRef Wu, X., Thomson, G., Tang, B.: An investigation into the impact of safety features on the ergonomics of surgical scalpels. Appl. Ergon. 40(3), 424–432 (2009)CrossRef
Metadata
Title
Natural Surgeon Interfaces: Perspectives and Examples of Intuitive Laser Control Systems in the μRALP Project
Authors
Giacinto Barresi
Darwin G. Caldwell
Leonardo S. Mattos
Copyright Year
2023
DOI
https://doi.org/10.1007/978-3-031-28390-1_12