Skip to main content

2016 | OriginalPaper | Buchkapitel

Tactile Augmented Reality for Arteries Palpation in Open Surgery Training

verfasst von : Sara Condino, Rosanna Maria Viglialoro, Simone Fani, Matteo Bianchi, Luca Morelli, Mauro Ferrari, Antonio Bicchi, Vincenzo Ferrari

Erschienen in: Medical Imaging and Augmented Reality

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Palpation is an essential step of several open surgical procedures for locating arteries by arterial pulse detection. In this context, surgical simulation would ideally provide realistic haptic sensations to the operator. This paper presents a proof of concept implementation of tactile augmented reality for open-surgery training. The system is based on the integration of a wearable tactile device into an augmented physical simulator which allows the real time tracking of artery reproductions and the user finger and provides pulse feedback during palpation. Preliminary qualitative test showed a general consensus among surgeons regarding the realism of the arterial pulse feedback and the usefulness of tactile augmented reality in open-surgery simulators.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Poorten, V.E., Demeester, E., Lammertse, P.: Haptic feedback for medical applications, a survey. In: Proceedings of the Actuator, pp. 18–20 (2012) Poorten, V.E., Demeester, E., Lammertse, P.: Haptic feedback for medical applications, a survey. In: Proceedings of the Actuator, pp. 18–20 (2012)
2.
Zurück zum Zitat Hu, J., Chang, C.Y., Tardella, N., Pratt, J., English, J.: Effectiveness of haptic feedback in open surgery simulation and training systems. Stud. Health Technol. 119, 213–218 (2006) Hu, J., Chang, C.Y., Tardella, N., Pratt, J., English, J.: Effectiveness of haptic feedback in open surgery simulation and training systems. Stud. Health Technol. 119, 213–218 (2006)
3.
Zurück zum Zitat Ullrich, S., Kuhlen, T.: Haptic palpation for medical simulation in virtual environments. IEEE Trans. Vis. Comput. Graph. 18, 617–625 (2012)CrossRef Ullrich, S., Kuhlen, T.: Haptic palpation for medical simulation in virtual environments. IEEE Trans. Vis. Comput. Graph. 18, 617–625 (2012)CrossRef
4.
Zurück zum Zitat Coles, T., John, N.W., Gould, D.A., Caldwell, D.G.: Haptic palpation for the femoral pulse in virtual interventional radiology. In: Second International Conferences on Advances in Computer-Human Interactions, ACHI 2009, pp. 193–198 (2009) Coles, T., John, N.W., Gould, D.A., Caldwell, D.G.: Haptic palpation for the femoral pulse in virtual interventional radiology. In: Second International Conferences on Advances in Computer-Human Interactions, ACHI 2009, pp. 193–198 (2009)
5.
Zurück zum Zitat Luboz, V., Zhang, Y., Johnson, S., Song, Y., Kilkenny, C., Hunt, C., Woolnough, H., Guediri, S., Zhai, J., Odetoyinbo, T., Littler, P., Fisher, A., Hughes, C., Chalmers, N., Kessel, D., Clough, P.J., Ward, J., Phillips, R., How, T., Bulpitt, A., John, N.W., Bello, F., Gould, D.: ImaGiNe Seldinger: first simulator for Seldinger technique and angiography training. Comput. Methods Programs Biomed. 111, 419–434 (2013)CrossRef Luboz, V., Zhang, Y., Johnson, S., Song, Y., Kilkenny, C., Hunt, C., Woolnough, H., Guediri, S., Zhai, J., Odetoyinbo, T., Littler, P., Fisher, A., Hughes, C., Chalmers, N., Kessel, D., Clough, P.J., Ward, J., Phillips, R., How, T., Bulpitt, A., John, N.W., Bello, F., Gould, D.: ImaGiNe Seldinger: first simulator for Seldinger technique and angiography training. Comput. Methods Programs Biomed. 111, 419–434 (2013)CrossRef
6.
Zurück zum Zitat Coles, T.R., John, N.W., Gould, D.A., Caldwell, D.G.: Integrating haptics with augmented reality in a femoral palpation and needle insertion training simulation. IEEE Trans. Haptics 4, 199–209 (2011)CrossRef Coles, T.R., John, N.W., Gould, D.A., Caldwell, D.G.: Integrating haptics with augmented reality in a femoral palpation and needle insertion training simulation. IEEE Trans. Haptics 4, 199–209 (2011)CrossRef
7.
Zurück zum Zitat Iwamoto, T., Tatezono, M., Shinoda, H.: Non-contact method for producing tactile sensation using airborne ultrasound. In: Ferre, M. (ed.) EuroHaptics 2008. LNCS, vol. 5024, pp. 504–513. Springer, Heidelberg (2008)CrossRef Iwamoto, T., Tatezono, M., Shinoda, H.: Non-contact method for producing tactile sensation using airborne ultrasound. In: Ferre, M. (ed.) EuroHaptics 2008. LNCS, vol. 5024, pp. 504–513. Springer, Heidelberg (2008)CrossRef
8.
Zurück zum Zitat Hung, G.M., John, N.W., Hancock, C., Hoshi, T.: Using and validating airborne ultrasound as a tactile interface within medical training simulators. In: Bello, F., Cotin, S. (eds.) ISBMS 2014. LNCS, vol. 8789, pp. 30–39. Springer, Heidelberg (2014) Hung, G.M., John, N.W., Hancock, C., Hoshi, T.: Using and validating airborne ultrasound as a tactile interface within medical training simulators. In: Bello, F., Cotin, S. (eds.) ISBMS 2014. LNCS, vol. 8789, pp. 30–39. Springer, Heidelberg (2014)
9.
Zurück zum Zitat Ferrari, V., Viglialoro, R.M., Nicoli, P., Cutolo, F., Condino, S., Carbone, M., Siesto, M., Ferrari, M.: Augmented reality visualization of deformable tubular structures for surgical simulation. Int. J. Med. Robot. Comput. Assist. Surg. 12, 231–240 (2016) Ferrari, V., Viglialoro, R.M., Nicoli, P., Cutolo, F., Condino, S., Carbone, M., Siesto, M., Ferrari, M.: Augmented reality visualization of deformable tubular structures for surgical simulation. Int. J. Med. Robot. Comput. Assist. Surg. 12, 231–240 (2016)
10.
Zurück zum Zitat Maria Viglialoro, R., Condino, S., Gesi, M., Ferrari, M., Ferrari, V.: Augmented reality simulator for laparoscopic cholecystectomy training. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2014. LNCS, vol. 8853, pp. 428–433. Springer, Heidelberg (2014) Maria Viglialoro, R., Condino, S., Gesi, M., Ferrari, M., Ferrari, V.: Augmented reality simulator for laparoscopic cholecystectomy training. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2014. LNCS, vol. 8853, pp. 428–433. Springer, Heidelberg (2014)
11.
Zurück zum Zitat Viglialoro, R., Condino, S., Gesi, M., Ferrari, M., Ferrari, V., Freschi, C., Cutolo, F.: AR visualization of “synthetic Calot’s triangle” for training in cholecystectomy. In: 12th IASTED International Conference on Biomedical Engineering, BioMed 2016 (2016) Viglialoro, R., Condino, S., Gesi, M., Ferrari, M., Ferrari, V., Freschi, C., Cutolo, F.: AR visualization of “synthetic Calot’s triangle” for training in cholecystectomy. In: 12th IASTED International Conference on Biomedical Engineering, BioMed 2016 (2016)
12.
Zurück zum Zitat Abdalla, S., Pierre, S., Ellis, H.: Calot’s triangle. Clin. Anat. 26, 493–501 (2013)CrossRef Abdalla, S., Pierre, S., Ellis, H.: Calot’s triangle. Clin. Anat. 26, 493–501 (2013)CrossRef
13.
Zurück zum Zitat Bianchi, M., Battaglia, E., Poggiani, M., Ciotti, S., Bicchi, A.: A wearable fabric-based display for haptic multi-cue delivery. In: 2016 IEEE Haptics Symposium (HAPTICS), pp. 277–283 (2016) Bianchi, M., Battaglia, E., Poggiani, M., Ciotti, S., Bicchi, A.: A wearable fabric-based display for haptic multi-cue delivery. In: 2016 IEEE Haptics Symposium (HAPTICS), pp. 277–283 (2016)
14.
Zurück zum Zitat Bianchi, M., Scilingo, E.P., Serio, A., Bicchi, A.: A new softness display based on bi-elastic fabric. In: EuroHaptics Conference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, World Haptics 2009, Third Joint, pp. 382–383 (2009) Bianchi, M., Scilingo, E.P., Serio, A., Bicchi, A.: A new softness display based on bi-elastic fabric. In: EuroHaptics Conference, 2009 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, World Haptics 2009, Third Joint, pp. 382–383 (2009)
15.
Zurück zum Zitat Bianchi, M., Serio, A., Scilingo, E.P., Bicchi, A.: A new fabric-based softness display. In: 2010 IEEE Haptics Symposium, pp. 105–112 (2010) Bianchi, M., Serio, A., Scilingo, E.P., Bicchi, A.: A new fabric-based softness display. In: 2010 IEEE Haptics Symposium, pp. 105–112 (2010)
16.
Zurück zum Zitat Serio, A., Bianchi, M., Biechi, A.: A device for mimicking the contact force/contact area relationship of different materials with applications to softness rendering. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4484–4490 (2013) Serio, A., Bianchi, M., Biechi, A.: A device for mimicking the contact force/contact area relationship of different materials with applications to softness rendering. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4484–4490 (2013)
17.
Zurück zum Zitat Bianchi, M., Serio, A.: Design and characterization of a fabric-based softness display. IEEE Trans. Haptics 8, 152–163 (2015)CrossRef Bianchi, M., Serio, A.: Design and characterization of a fabric-based softness display. IEEE Trans. Haptics 8, 152–163 (2015)CrossRef
18.
Zurück zum Zitat Minamizawa, K., Fukamachi, S., Kajimoto, H., Kawakami, N., Tachi, S.: Gravity grabber: wearable haptic display to present virtual mass sensation. In: ACM SIGGRAPH 2007 Emerging Technologies, San Diego, California, p. 8. ACM (2007) Minamizawa, K., Fukamachi, S., Kajimoto, H., Kawakami, N., Tachi, S.: Gravity grabber: wearable haptic display to present virtual mass sensation. In: ACM SIGGRAPH 2007 Emerging Technologies, San Diego, California, p. 8. ACM (2007)
19.
Zurück zum Zitat Ullrich, S., Mendoza, J., Ntouba, A., Rossaint, R., Kuhlen, T.: Haptic pulse simulation for virtual palpation. In: Tolxdorff, T., Braun, J., Deserno, T.M., Horsch, A., Handels, H., Meinzer, H.-P. (eds.) Bildverarbeitung für die Medizin 2008: Algorithmen — Systeme — Anwendungen Proceedings des Workshops vom 6. bis 8. April 2008 in Berlin, pp. 187–191. Springer, Heidelberg (2008)CrossRef Ullrich, S., Mendoza, J., Ntouba, A., Rossaint, R., Kuhlen, T.: Haptic pulse simulation for virtual palpation. In: Tolxdorff, T., Braun, J., Deserno, T.M., Horsch, A., Handels, H., Meinzer, H.-P. (eds.) Bildverarbeitung für die Medizin 2008: Algorithmen — Systeme — Anwendungen Proceedings des Workshops vom 6. bis 8. April 2008 in Berlin, pp. 187–191. Springer, Heidelberg (2008)CrossRef
20.
Zurück zum Zitat O’Leary, E., Hubbard, K., Tormey, W., Cunningham, A.J.: Laparoscopic cholecystectomy: haemodynamic and neuroendocrine responses after pneumoperitoneum and changes in position. Br. J. Anaesth. 76, 640–644 (1996)CrossRef O’Leary, E., Hubbard, K., Tormey, W., Cunningham, A.J.: Laparoscopic cholecystectomy: haemodynamic and neuroendocrine responses after pneumoperitoneum and changes in position. Br. J. Anaesth. 76, 640–644 (1996)CrossRef
21.
Zurück zum Zitat Nafis, C., Jensen, V., Beauregard, L., Anderson, P.: Method for estimating dynamic EM tracking accuracy of surgical navigation tools - art. no. 61410K. In: Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display, vol. 6141, pp. 152–167 (2006) Nafis, C., Jensen, V., Beauregard, L., Anderson, P.: Method for estimating dynamic EM tracking accuracy of surgical navigation tools - art. no. 61410K. In: Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display, vol. 6141, pp. 152–167 (2006)
22.
Zurück zum Zitat Bia, D., Aguirre, I., Zocalo, Y., Devera, L., Cabrera Fischer, E., Armentano, R.: Regional differences in viscosity, elasticity and wall buffering function in systemic arteries: pulse wave analysis of the arterial pressure-diameter relationship. Rev. Esp. Cardiol. 58, 167–174 (2005)CrossRef Bia, D., Aguirre, I., Zocalo, Y., Devera, L., Cabrera Fischer, E., Armentano, R.: Regional differences in viscosity, elasticity and wall buffering function in systemic arteries: pulse wave analysis of the arterial pressure-diameter relationship. Rev. Esp. Cardiol. 58, 167–174 (2005)CrossRef
23.
Zurück zum Zitat Benetos, A., Laurent, S., Hoeks, A.P., Boutouyrie, P.H., Safar, M.E.: Arterial alterations with aging and high blood pressure. A noninvasive study of carotid and femoral arteries. Arterioscler. Thromb. J. Vasc. Biol./Am. Heart Assoc. 13, 90–97 (1993)CrossRef Benetos, A., Laurent, S., Hoeks, A.P., Boutouyrie, P.H., Safar, M.E.: Arterial alterations with aging and high blood pressure. A noninvasive study of carotid and femoral arteries. Arterioscler. Thromb. J. Vasc. Biol./Am. Heart Assoc. 13, 90–97 (1993)CrossRef
Metadaten
Titel
Tactile Augmented Reality for Arteries Palpation in Open Surgery Training
verfasst von
Sara Condino
Rosanna Maria Viglialoro
Simone Fani
Matteo Bianchi
Luca Morelli
Mauro Ferrari
Antonio Bicchi
Vincenzo Ferrari
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-43775-0_17