Skip to main content
Erschienen in: Soft Computing 8/2020

17.09.2019 | Focus

Development and assessment of a haptic-enabled holographic surgical simulator for renal biopsy training

verfasst von: Zhaoxiang Guo, Yonghang Tai, Zhibao Qin, Xiaoqiao Huang, Qiong Li, Jun Peng, Junsheng Shi

Erschienen in: Soft Computing | Ausgabe 8/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, a high-immersive surgical training system for renal biopsy using holographic demonstration and haptic feedback is presented to push the limitation of virtual medical training development. Proposed system is including: holographic visual rendering pipeline reconstructed by the patient-specific CT images; haptic rendering pipeline implemented by the dual-hands 6-DOF haptic devices connected with surgical instruments of image guide and immersive 3D display learning operating room environment. Twenty-four medical students and eight experienced thoracic surgeons from the Yunnan First People’s Hospital are invited to evaluate our holographic-based training system through the subjective and objective assessment test, respectively. Experiment result from the face, content, improvement, and construct evaluations demonstrated a high performance than the existing VR-based trainer, especially the puncture accuracy of medical students’ group, was improved by 30.8% after training.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Al-Ayyoub M, AlZu’bi S, Jararweh Y, Shehab MA, Gupta BB (2018) Accelerating 3D medical volume segmentation using GPUs. Multimed Tools Appl 77:4939–4958CrossRef Al-Ayyoub M, AlZu’bi S, Jararweh Y, Shehab MA, Gupta BB (2018) Accelerating 3D medical volume segmentation using GPUs. Multimed Tools Appl 77:4939–4958CrossRef
Zurück zum Zitat Atat R, Liu L, Wu J, Li G, Ye C, Yang Y (2018) Big data meet cyber-physical systems: a panoramic survey. IEEE Access 6:73603–73636CrossRef Atat R, Liu L, Wu J, Li G, Ye C, Yang Y (2018) Big data meet cyber-physical systems: a panoramic survey. IEEE Access 6:73603–73636CrossRef
Zurück zum Zitat Brinkman WM, Tjiam IM, Buzink SN (2013) Assessment of basic laparoscopic skills on virtual reality simulator or box trainer. Surg Endosc 27(10):3584–3590CrossRef Brinkman WM, Tjiam IM, Buzink SN (2013) Assessment of basic laparoscopic skills on virtual reality simulator or box trainer. Surg Endosc 27(10):3584–3590CrossRef
Zurück zum Zitat Bucioli AAB et al (2018) Holographic real time 3D heart visualization from coronary tomography for multi-place medical diagnostics. In: Proceedings—2017 IEEE 15th international conference on dependable, autonomic secure computing 2017 IEEE 15th international conference on pervasive intelligence and computing 2017 IEEE 3rd international conference on big data intelligence and computing, vol 2018, pp 239–244 Bucioli AAB et al (2018) Holographic real time 3D heart visualization from coronary tomography for multi-place medical diagnostics. In: Proceedings—2017 IEEE 15th international conference on dependable, autonomic secure computing 2017 IEEE 15th international conference on pervasive intelligence and computing 2017 IEEE 3rd international conference on big data intelligence and computing, vol 2018, pp 239–244
Zurück zum Zitat Chen X, Lin Y, Wang C, Shen G, Wang X (2012) A virtual training system using a force feedback haptic device for oral implantology. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) Chen X, Lin Y, Wang C, Shen G, Wang X (2012) A virtual training system using a force feedback haptic device for oral implantology. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
Zurück zum Zitat Coles TR, Meglan D, Member S, John NW (2011) The role of haptics in medical training simulators: a survey of the state of the art. IEEE Trans Haptics 4(1):51–66CrossRef Coles TR, Meglan D, Member S, John NW (2011) The role of haptics in medical training simulators: a survey of the state of the art. IEEE Trans Haptics 4(1):51–66CrossRef
Zurück zum Zitat Dorgham O, Al-Rahamneh B, Almomani A, Al-Hadidi M, Khatatneh KF (2017) Enhancing the security of exchanging and storing DICOM medical images on the cloud. Int J Cloud Appl Comput 8:154–172 Dorgham O, Al-Rahamneh B, Almomani A, Al-Hadidi M, Khatatneh KF (2017) Enhancing the security of exchanging and storing DICOM medical images on the cloud. Int J Cloud Appl Comput 8:154–172
Zurück zum Zitat Flora A et al (2018) Intelligent medical record management: a diagnosis support system. Int J High Perform Comput Netw 12(4):391–399CrossRef Flora A et al (2018) Intelligent medical record management: a diagnosis support system. Int J High Perform Comput Netw 12(4):391–399CrossRef
Zurück zum Zitat Fortmeier D, Mastmeyer A, Schröder J, Handels H (2016) A virtual reality system for PTCD simulation using direct visuo-haptic rendering of partially segmented image data. IEEE J Biomed Health Inform 20(1):355–366CrossRef Fortmeier D, Mastmeyer A, Schröder J, Handels H (2016) A virtual reality system for PTCD simulation using direct visuo-haptic rendering of partially segmented image data. IEEE J Biomed Health Inform 20(1):355–366CrossRef
Zurück zum Zitat Goléa NEH, Melkemi KE (2019) ROI-based fragile watermarking for medical image tamper detection. Int J High Perform Comput Netw 13:199–210CrossRef Goléa NEH, Melkemi KE (2019) ROI-based fragile watermarking for medical image tamper detection. Int J High Perform Comput Netw 13:199–210CrossRef
Zurück zum Zitat Halic T, De S (2010) Lightweight bleeding and smoke effect for surgical simulators, In: Proceedings—IEEE virtual reality, pp 271–272 Halic T, De S (2010) Lightweight bleeding and smoke effect for surgical simulators, In: Proceedings—IEEE virtual reality, pp 271–272
Zurück zum Zitat Incekara F, Smits M, Dirven C, Vincent A (2018) Clinical feasibility of a wearable mixed-reality device in neurosurgery. World Neurosurg 118:e422–e427CrossRef Incekara F, Smits M, Dirven C, Vincent A (2018) Clinical feasibility of a wearable mixed-reality device in neurosurgery. World Neurosurg 118:e422–e427CrossRef
Zurück zum Zitat Iversen P, Brun C (1951) Aspiration biopsy of the kidney. Am J Med 11(3):324–330CrossRef Iversen P, Brun C (1951) Aspiration biopsy of the kidney. Am J Med 11(3):324–330CrossRef
Zurück zum Zitat Jan S (2019) Assessing complex evolving cyber-physical systems (case study: smart medical devices). Int J High Perform Comput Netw 13(3):294–303CrossRef Jan S (2019) Assessing complex evolving cyber-physical systems (case study: smart medical devices). Int J High Perform Comput Netw 13(3):294–303CrossRef
Zurück zum Zitat Jarillo-Silva A, Domínguez-Ramírez OA, Parra-Vega V, Ordaz-Oliver JP (2009) Phantom omni haptic device: kinematic and manipulability. In: CERMA 2009—electronics, Robotics and automotive mechanics conference, pp 193–198 Jarillo-Silva A, Domínguez-Ramírez OA, Parra-Vega V, Ordaz-Oliver JP (2009) Phantom omni haptic device: kinematic and manipulability. In: CERMA 2009—electronics, Robotics and automotive mechanics conference, pp 193–198
Zurück zum Zitat Korbet SM (2002) Percutaneous renal biopsy. In: Seminars in nephrology Korbet SM (2002) Percutaneous renal biopsy. In: Seminars in nephrology
Zurück zum Zitat Kuzhagaliyev T et al (2018) Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. In: Medical imaging 2018 image-guided procedures, robotic interventions, and modeling, vol 10576, p 30 Kuzhagaliyev T et al (2018) Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. In: Medical imaging 2018 image-guided procedures, robotic interventions, and modeling, vol 10576, p 30
Zurück zum Zitat Mahmood F et al (2018) Augmented reality and ultrasound education: initial experience. J Cardiothorac Vasc Anesth 32(3):1363–1367CrossRef Mahmood F et al (2018) Augmented reality and ultrasound education: initial experience. J Cardiothorac Vasc Anesth 32(3):1363–1367CrossRef
Zurück zum Zitat Martín JS, Triviño G, San Martin J, Trivino G (2006) A study of the manipulability of the PHANToM TM OMNI TM Haptic Interface. In: Omni Martín JS, Triviño G, San Martin J, Trivino G (2006) A study of the manipulability of the PHANToM TM OMNI TM Haptic Interface. In: Omni
Zurück zum Zitat Matell MS, Jacoby J (1971) Is there an optimal number of alternatives for Likert scale items? Study 1: reliability and validity. Educ Psychol Meas 31:657–674CrossRef Matell MS, Jacoby J (1971) Is there an optimal number of alternatives for Likert scale items? Study 1: reliability and validity. Educ Psychol Meas 31:657–674CrossRef
Zurück zum Zitat Mrug M, Bissler JJ (2010) Simulation of real-time ultrasound-guided renal biopsy. Kidney Int 78:705–707CrossRef Mrug M, Bissler JJ (2010) Simulation of real-time ultrasound-guided renal biopsy. Kidney Int 78:705–707CrossRef
Zurück zum Zitat Muhammad G, Alhamid MF, Alsulaiman M, Gupta B (2018) Edge computing with cloud for voice disorder assessment and treatment. IEEE Commun Mag 56(4):60–65CrossRef Muhammad G, Alhamid MF, Alsulaiman M, Gupta B (2018) Edge computing with cloud for voice disorder assessment and treatment. IEEE Commun Mag 56(4):60–65CrossRef
Zurück zum Zitat Ni D et al (2011) A virtual reality simulator for ultrasound-guided biopsy training. IEEE Comput Graph Appl 31(2):36–48CrossRef Ni D et al (2011) A virtual reality simulator for ultrasound-guided biopsy training. IEEE Comput Graph Appl 31(2):36–48CrossRef
Zurück zum Zitat Noureldin YA, Fahmy N, Anidjar M, Andonian S (2016) Is there a place for virtual reality simulators in assessment of competency in percutaneous renal access? World J Urol 34:733–739CrossRef Noureldin YA, Fahmy N, Anidjar M, Andonian S (2016) Is there a place for virtual reality simulators in assessment of competency in percutaneous renal access? World J Urol 34:733–739CrossRef
Zurück zum Zitat Page M (2017) Visualization of complex medical data using next-generation holographic techniques Page M (2017) Visualization of complex medical data using next-generation holographic techniques
Zurück zum Zitat Pham T, Tang A, Jacob C (2017) User-defined gestures for holographic medical analytics Pham T, Tang A, Jacob C (2017) User-defined gestures for holographic medical analytics
Zurück zum Zitat Selmi SY, Fiard G, Promayon E, Vadcard L, Troccaz J (2013) A virtual reality simulator combining a learning environment and clinical case database for image-guided prostate biopsy. In: Proceedings of CBMS 2013—26th IEEE international symposium on computer-based medical systems Selmi SY, Fiard G, Promayon E, Vadcard L, Troccaz J (2013) A virtual reality simulator combining a learning environment and clinical case database for image-guided prostate biopsy. In: Proceedings of CBMS 2013—26th IEEE international symposium on computer-based medical systems
Zurück zum Zitat Soler L, Marescaux J (2016) Virtual surgical simulation: the first steps in a new training. Springer, Berlin Soler L, Marescaux J (2016) Virtual surgical simulation: the first steps in a new training. Springer, Berlin
Zurück zum Zitat Stern J, Zeltser IS, Pearle MS (2007) Percutaneous renal access simulators. J Endourol 21:270–273CrossRef Stern J, Zeltser IS, Pearle MS (2007) Percutaneous renal access simulators. J Endourol 21:270–273CrossRef
Zurück zum Zitat Tse B, Harwin W, Barrow A, Quinn B, Diego JS, Cox M (2010) Design and development of a haptic dental training system—hapTEL. In: International conference, Eurohaptics 2010, Amsterdam, the Netherlands, July 8–10, 2010. Proceedings, pp 101–108 Tse B, Harwin W, Barrow A, Quinn B, Diego JS, Cox M (2010) Design and development of a haptic dental training system—hapTEL. In: International conference, Eurohaptics 2010, Amsterdam, the Netherlands, July 8–10, 2010. Proceedings, pp 101–108
Zurück zum Zitat Ullrich S, Kuhlen T (2012) Haptic palpation for medical simulation in virtual environments. IEEE Trans Vis Comput Graph 18(4):617–625CrossRef Ullrich S, Kuhlen T (2012) Haptic palpation for medical simulation in virtual environments. IEEE Trans Vis Comput Graph 18(4):617–625CrossRef
Zurück zum Zitat Wang L, Sun Y (2015) Research on evaluation system of upper limb rehabilitation training based on virtual reality interaction. In: Proceedings of the World congress intelligent control and automation, vol 2015, March, pp 2798–2803 Wang L, Sun Y (2015) Research on evaluation system of upper limb rehabilitation training based on virtual reality interaction. In: Proceedings of the World congress intelligent control and automation, vol 2015, March, pp 2798–2803
Zurück zum Zitat Wei L, Najdovski Z, Abdelrahman W, Nahavandi S, Weisinger H (2012) Augmented optometry training simulator with multi-point haptics. In: Conference proceedings—IEEE international conference on systems, man, and cybernetics, pp 2991–2997 Wei L, Najdovski Z, Abdelrahman W, Nahavandi S, Weisinger H (2012) Augmented optometry training simulator with multi-point haptics. In: Conference proceedings—IEEE international conference on systems, man, and cybernetics, pp 2991–2997
Zurück zum Zitat Wu J, Guo S, Huang H, Liu W, Xiang Y (2018) Information and communications technologies for sustainable development goals: state-of-the-art, needs and perspectives. IEEE Commun Surv Tutor 20:2389–2406CrossRef Wu J, Guo S, Huang H, Liu W, Xiang Y (2018) Information and communications technologies for sustainable development goals: state-of-the-art, needs and perspectives. IEEE Commun Surv Tutor 20:2389–2406CrossRef
Zurück zum Zitat Xie T, Islam MM, Lumsden AB, Kakadiaris IA (2017) Holographic iRay: exploring augmentation for medical applications. In: Adjunt proceedings 2017 IEEE international symposium on mixed and augmented reality, ISMAR-adjunct 2017, pp 220–222 Xie T, Islam MM, Lumsden AB, Kakadiaris IA (2017) Holographic iRay: exploring augmentation for medical applications. In: Adjunt proceedings 2017 IEEE international symposium on mixed and augmented reality, ISMAR-adjunct 2017, pp 220–222
Zurück zum Zitat Yamaguchi T, Yoshikawa H (2018) High resolution computer-generated rainbow hologram. Appl Sci 8(10):1955CrossRef Yamaguchi T, Yoshikawa H (2018) High resolution computer-generated rainbow hologram. Appl Sci 8(10):1955CrossRef
Zurück zum Zitat Yi N, Guo XJ, Li XR, Xu XF, Ma WJ (2010) The implementation of haptic interaction in virtual surgery, In: Proceedings—international conference on electrical and control engineering ICECE 2010, pp 2351–2354 Yi N, Guo XJ, Li XR, Xu XF, Ma WJ (2010) The implementation of haptic interaction in virtual surgery, In: Proceedings—international conference on electrical and control engineering ICECE 2010, pp 2351–2354
Zurück zum Zitat Zhang Y, Yu CF, Liu JS, Wang G, Zhu H, Na YQ (2013) Training for percutaneous renal access on a virtual reality simulator. Chin Med J (Engl) 126:1528–1531 Zhang Y, Yu CF, Liu JS, Wang G, Zhu H, Na YQ (2013) Training for percutaneous renal access on a virtual reality simulator. Chin Med J (Engl) 126:1528–1531
Metadaten
Titel
Development and assessment of a haptic-enabled holographic surgical simulator for renal biopsy training
verfasst von
Zhaoxiang Guo
Yonghang Tai
Zhibao Qin
Xiaoqiao Huang
Qiong Li
Jun Peng
Junsheng Shi
Publikationsdatum
17.09.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 8/2020
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-019-04341-4

Weitere Artikel der Ausgabe 8/2020

Soft Computing 8/2020 Zur Ausgabe