Skip to main content
Top
Published in: Soft Computing 8/2020

17-09-2019 | Focus

Development and assessment of a haptic-enabled holographic surgical simulator for renal biopsy training

Authors: Zhaoxiang Guo, Yonghang Tai, Zhibao Qin, Xiaoqiao Huang, Qiong Li, Jun Peng, Junsheng Shi

Published in: Soft Computing | Issue 8/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, a high-immersive surgical training system for renal biopsy using holographic demonstration and haptic feedback is presented to push the limitation of virtual medical training development. Proposed system is including: holographic visual rendering pipeline reconstructed by the patient-specific CT images; haptic rendering pipeline implemented by the dual-hands 6-DOF haptic devices connected with surgical instruments of image guide and immersive 3D display learning operating room environment. Twenty-four medical students and eight experienced thoracic surgeons from the Yunnan First People’s Hospital are invited to evaluate our holographic-based training system through the subjective and objective assessment test, respectively. Experiment result from the face, content, improvement, and construct evaluations demonstrated a high performance than the existing VR-based trainer, especially the puncture accuracy of medical students’ group, was improved by 30.8% after training.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Al-Ayyoub M, AlZu’bi S, Jararweh Y, Shehab MA, Gupta BB (2018) Accelerating 3D medical volume segmentation using GPUs. Multimed Tools Appl 77:4939–4958CrossRef Al-Ayyoub M, AlZu’bi S, Jararweh Y, Shehab MA, Gupta BB (2018) Accelerating 3D medical volume segmentation using GPUs. Multimed Tools Appl 77:4939–4958CrossRef
go back to reference Atat R, Liu L, Wu J, Li G, Ye C, Yang Y (2018) Big data meet cyber-physical systems: a panoramic survey. IEEE Access 6:73603–73636CrossRef Atat R, Liu L, Wu J, Li G, Ye C, Yang Y (2018) Big data meet cyber-physical systems: a panoramic survey. IEEE Access 6:73603–73636CrossRef
go back to reference Brinkman WM, Tjiam IM, Buzink SN (2013) Assessment of basic laparoscopic skills on virtual reality simulator or box trainer. Surg Endosc 27(10):3584–3590CrossRef Brinkman WM, Tjiam IM, Buzink SN (2013) Assessment of basic laparoscopic skills on virtual reality simulator or box trainer. Surg Endosc 27(10):3584–3590CrossRef
go back to reference Bucioli AAB et al (2018) Holographic real time 3D heart visualization from coronary tomography for multi-place medical diagnostics. In: Proceedings—2017 IEEE 15th international conference on dependable, autonomic secure computing 2017 IEEE 15th international conference on pervasive intelligence and computing 2017 IEEE 3rd international conference on big data intelligence and computing, vol 2018, pp 239–244 Bucioli AAB et al (2018) Holographic real time 3D heart visualization from coronary tomography for multi-place medical diagnostics. In: Proceedings—2017 IEEE 15th international conference on dependable, autonomic secure computing 2017 IEEE 15th international conference on pervasive intelligence and computing 2017 IEEE 3rd international conference on big data intelligence and computing, vol 2018, pp 239–244
go back to reference Chen X, Lin Y, Wang C, Shen G, Wang X (2012) A virtual training system using a force feedback haptic device for oral implantology. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) Chen X, Lin Y, Wang C, Shen G, Wang X (2012) A virtual training system using a force feedback haptic device for oral implantology. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
go back to reference Coles TR, Meglan D, Member S, John NW (2011) The role of haptics in medical training simulators: a survey of the state of the art. IEEE Trans Haptics 4(1):51–66CrossRef Coles TR, Meglan D, Member S, John NW (2011) The role of haptics in medical training simulators: a survey of the state of the art. IEEE Trans Haptics 4(1):51–66CrossRef
go back to reference Dorgham O, Al-Rahamneh B, Almomani A, Al-Hadidi M, Khatatneh KF (2017) Enhancing the security of exchanging and storing DICOM medical images on the cloud. Int J Cloud Appl Comput 8:154–172 Dorgham O, Al-Rahamneh B, Almomani A, Al-Hadidi M, Khatatneh KF (2017) Enhancing the security of exchanging and storing DICOM medical images on the cloud. Int J Cloud Appl Comput 8:154–172
go back to reference Flora A et al (2018) Intelligent medical record management: a diagnosis support system. Int J High Perform Comput Netw 12(4):391–399CrossRef Flora A et al (2018) Intelligent medical record management: a diagnosis support system. Int J High Perform Comput Netw 12(4):391–399CrossRef
go back to reference Fortmeier D, Mastmeyer A, Schröder J, Handels H (2016) A virtual reality system for PTCD simulation using direct visuo-haptic rendering of partially segmented image data. IEEE J Biomed Health Inform 20(1):355–366CrossRef Fortmeier D, Mastmeyer A, Schröder J, Handels H (2016) A virtual reality system for PTCD simulation using direct visuo-haptic rendering of partially segmented image data. IEEE J Biomed Health Inform 20(1):355–366CrossRef
go back to reference Goléa NEH, Melkemi KE (2019) ROI-based fragile watermarking for medical image tamper detection. Int J High Perform Comput Netw 13:199–210CrossRef Goléa NEH, Melkemi KE (2019) ROI-based fragile watermarking for medical image tamper detection. Int J High Perform Comput Netw 13:199–210CrossRef
go back to reference Halic T, De S (2010) Lightweight bleeding and smoke effect for surgical simulators, In: Proceedings—IEEE virtual reality, pp 271–272 Halic T, De S (2010) Lightweight bleeding and smoke effect for surgical simulators, In: Proceedings—IEEE virtual reality, pp 271–272
go back to reference Incekara F, Smits M, Dirven C, Vincent A (2018) Clinical feasibility of a wearable mixed-reality device in neurosurgery. World Neurosurg 118:e422–e427CrossRef Incekara F, Smits M, Dirven C, Vincent A (2018) Clinical feasibility of a wearable mixed-reality device in neurosurgery. World Neurosurg 118:e422–e427CrossRef
go back to reference Iversen P, Brun C (1951) Aspiration biopsy of the kidney. Am J Med 11(3):324–330CrossRef Iversen P, Brun C (1951) Aspiration biopsy of the kidney. Am J Med 11(3):324–330CrossRef
go back to reference Jan S (2019) Assessing complex evolving cyber-physical systems (case study: smart medical devices). Int J High Perform Comput Netw 13(3):294–303CrossRef Jan S (2019) Assessing complex evolving cyber-physical systems (case study: smart medical devices). Int J High Perform Comput Netw 13(3):294–303CrossRef
go back to reference Jarillo-Silva A, Domínguez-Ramírez OA, Parra-Vega V, Ordaz-Oliver JP (2009) Phantom omni haptic device: kinematic and manipulability. In: CERMA 2009—electronics, Robotics and automotive mechanics conference, pp 193–198 Jarillo-Silva A, Domínguez-Ramírez OA, Parra-Vega V, Ordaz-Oliver JP (2009) Phantom omni haptic device: kinematic and manipulability. In: CERMA 2009—electronics, Robotics and automotive mechanics conference, pp 193–198
go back to reference Korbet SM (2002) Percutaneous renal biopsy. In: Seminars in nephrology Korbet SM (2002) Percutaneous renal biopsy. In: Seminars in nephrology
go back to reference Kuzhagaliyev T et al (2018) Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. In: Medical imaging 2018 image-guided procedures, robotic interventions, and modeling, vol 10576, p 30 Kuzhagaliyev T et al (2018) Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. In: Medical imaging 2018 image-guided procedures, robotic interventions, and modeling, vol 10576, p 30
go back to reference Mahmood F et al (2018) Augmented reality and ultrasound education: initial experience. J Cardiothorac Vasc Anesth 32(3):1363–1367CrossRef Mahmood F et al (2018) Augmented reality and ultrasound education: initial experience. J Cardiothorac Vasc Anesth 32(3):1363–1367CrossRef
go back to reference Martín JS, Triviño G, San Martin J, Trivino G (2006) A study of the manipulability of the PHANToM TM OMNI TM Haptic Interface. In: Omni Martín JS, Triviño G, San Martin J, Trivino G (2006) A study of the manipulability of the PHANToM TM OMNI TM Haptic Interface. In: Omni
go back to reference Matell MS, Jacoby J (1971) Is there an optimal number of alternatives for Likert scale items? Study 1: reliability and validity. Educ Psychol Meas 31:657–674CrossRef Matell MS, Jacoby J (1971) Is there an optimal number of alternatives for Likert scale items? Study 1: reliability and validity. Educ Psychol Meas 31:657–674CrossRef
go back to reference Mrug M, Bissler JJ (2010) Simulation of real-time ultrasound-guided renal biopsy. Kidney Int 78:705–707CrossRef Mrug M, Bissler JJ (2010) Simulation of real-time ultrasound-guided renal biopsy. Kidney Int 78:705–707CrossRef
go back to reference Muhammad G, Alhamid MF, Alsulaiman M, Gupta B (2018) Edge computing with cloud for voice disorder assessment and treatment. IEEE Commun Mag 56(4):60–65CrossRef Muhammad G, Alhamid MF, Alsulaiman M, Gupta B (2018) Edge computing with cloud for voice disorder assessment and treatment. IEEE Commun Mag 56(4):60–65CrossRef
go back to reference Ni D et al (2011) A virtual reality simulator for ultrasound-guided biopsy training. IEEE Comput Graph Appl 31(2):36–48CrossRef Ni D et al (2011) A virtual reality simulator for ultrasound-guided biopsy training. IEEE Comput Graph Appl 31(2):36–48CrossRef
go back to reference Noureldin YA, Fahmy N, Anidjar M, Andonian S (2016) Is there a place for virtual reality simulators in assessment of competency in percutaneous renal access? World J Urol 34:733–739CrossRef Noureldin YA, Fahmy N, Anidjar M, Andonian S (2016) Is there a place for virtual reality simulators in assessment of competency in percutaneous renal access? World J Urol 34:733–739CrossRef
go back to reference Page M (2017) Visualization of complex medical data using next-generation holographic techniques Page M (2017) Visualization of complex medical data using next-generation holographic techniques
go back to reference Pham T, Tang A, Jacob C (2017) User-defined gestures for holographic medical analytics Pham T, Tang A, Jacob C (2017) User-defined gestures for holographic medical analytics
go back to reference Selmi SY, Fiard G, Promayon E, Vadcard L, Troccaz J (2013) A virtual reality simulator combining a learning environment and clinical case database for image-guided prostate biopsy. In: Proceedings of CBMS 2013—26th IEEE international symposium on computer-based medical systems Selmi SY, Fiard G, Promayon E, Vadcard L, Troccaz J (2013) A virtual reality simulator combining a learning environment and clinical case database for image-guided prostate biopsy. In: Proceedings of CBMS 2013—26th IEEE international symposium on computer-based medical systems
go back to reference Soler L, Marescaux J (2016) Virtual surgical simulation: the first steps in a new training. Springer, Berlin Soler L, Marescaux J (2016) Virtual surgical simulation: the first steps in a new training. Springer, Berlin
go back to reference Stern J, Zeltser IS, Pearle MS (2007) Percutaneous renal access simulators. J Endourol 21:270–273CrossRef Stern J, Zeltser IS, Pearle MS (2007) Percutaneous renal access simulators. J Endourol 21:270–273CrossRef
go back to reference Tse B, Harwin W, Barrow A, Quinn B, Diego JS, Cox M (2010) Design and development of a haptic dental training system—hapTEL. In: International conference, Eurohaptics 2010, Amsterdam, the Netherlands, July 8–10, 2010. Proceedings, pp 101–108 Tse B, Harwin W, Barrow A, Quinn B, Diego JS, Cox M (2010) Design and development of a haptic dental training system—hapTEL. In: International conference, Eurohaptics 2010, Amsterdam, the Netherlands, July 8–10, 2010. Proceedings, pp 101–108
go back to reference Ullrich S, Kuhlen T (2012) Haptic palpation for medical simulation in virtual environments. IEEE Trans Vis Comput Graph 18(4):617–625CrossRef Ullrich S, Kuhlen T (2012) Haptic palpation for medical simulation in virtual environments. IEEE Trans Vis Comput Graph 18(4):617–625CrossRef
go back to reference Wang L, Sun Y (2015) Research on evaluation system of upper limb rehabilitation training based on virtual reality interaction. In: Proceedings of the World congress intelligent control and automation, vol 2015, March, pp 2798–2803 Wang L, Sun Y (2015) Research on evaluation system of upper limb rehabilitation training based on virtual reality interaction. In: Proceedings of the World congress intelligent control and automation, vol 2015, March, pp 2798–2803
go back to reference Wei L, Najdovski Z, Abdelrahman W, Nahavandi S, Weisinger H (2012) Augmented optometry training simulator with multi-point haptics. In: Conference proceedings—IEEE international conference on systems, man, and cybernetics, pp 2991–2997 Wei L, Najdovski Z, Abdelrahman W, Nahavandi S, Weisinger H (2012) Augmented optometry training simulator with multi-point haptics. In: Conference proceedings—IEEE international conference on systems, man, and cybernetics, pp 2991–2997
go back to reference Wu J, Guo S, Huang H, Liu W, Xiang Y (2018) Information and communications technologies for sustainable development goals: state-of-the-art, needs and perspectives. IEEE Commun Surv Tutor 20:2389–2406CrossRef Wu J, Guo S, Huang H, Liu W, Xiang Y (2018) Information and communications technologies for sustainable development goals: state-of-the-art, needs and perspectives. IEEE Commun Surv Tutor 20:2389–2406CrossRef
go back to reference Xie T, Islam MM, Lumsden AB, Kakadiaris IA (2017) Holographic iRay: exploring augmentation for medical applications. In: Adjunt proceedings 2017 IEEE international symposium on mixed and augmented reality, ISMAR-adjunct 2017, pp 220–222 Xie T, Islam MM, Lumsden AB, Kakadiaris IA (2017) Holographic iRay: exploring augmentation for medical applications. In: Adjunt proceedings 2017 IEEE international symposium on mixed and augmented reality, ISMAR-adjunct 2017, pp 220–222
go back to reference Yamaguchi T, Yoshikawa H (2018) High resolution computer-generated rainbow hologram. Appl Sci 8(10):1955CrossRef Yamaguchi T, Yoshikawa H (2018) High resolution computer-generated rainbow hologram. Appl Sci 8(10):1955CrossRef
go back to reference Yi N, Guo XJ, Li XR, Xu XF, Ma WJ (2010) The implementation of haptic interaction in virtual surgery, In: Proceedings—international conference on electrical and control engineering ICECE 2010, pp 2351–2354 Yi N, Guo XJ, Li XR, Xu XF, Ma WJ (2010) The implementation of haptic interaction in virtual surgery, In: Proceedings—international conference on electrical and control engineering ICECE 2010, pp 2351–2354
go back to reference Zhang Y, Yu CF, Liu JS, Wang G, Zhu H, Na YQ (2013) Training for percutaneous renal access on a virtual reality simulator. Chin Med J (Engl) 126:1528–1531 Zhang Y, Yu CF, Liu JS, Wang G, Zhu H, Na YQ (2013) Training for percutaneous renal access on a virtual reality simulator. Chin Med J (Engl) 126:1528–1531
Metadata
Title
Development and assessment of a haptic-enabled holographic surgical simulator for renal biopsy training
Authors
Zhaoxiang Guo
Yonghang Tai
Zhibao Qin
Xiaoqiao Huang
Qiong Li
Jun Peng
Junsheng Shi
Publication date
17-09-2019
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 8/2020
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-019-04341-4

Other articles of this Issue 8/2020

Soft Computing 8/2020 Go to the issue

Premium Partner