Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 1/2015

01.01.2015 | Original Article

A system for context-aware intraoperative augmented reality in dental implant surgery

verfasst von: Darko Katić, Patrick Spengler, Sebastian Bodenstedt, Gregor Castrillon-Oberndorfer, Robin Seeberger, Juergen Hoffmann, Ruediger Dillmann, Stefanie Speidel

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 1/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose   

Large volumes of information in the OR are ignored by surgeons when the amount outpaces human mental processing abilities. We developed an augmented reality (AR) system for dental implant surgery that acts as an automatic information filter, selectively displaying only relevant information. The purpose is to reduce information overflow and offer intuitive image guidance. The system was evaluated in a pig cadaver experiment.

Methods   

Information filtering is implemented via rule-based situation interpretation with description logics. The interpretation is based on intraoperative distances measurement between anatomical structures and the dental drill with optical tracking. For AR, a head-mounted display is used, which was calibrated with a novel method based on SPAAM. To adapt to surgeon specific preferences, we offer two alternative display formats: one with static and another with contact analog AR.

Results   

The system made the surgery easier and showed ergonomical benefits, as assessed by a questionnaire. All relevant phases were recognized reliably. The new calibration showed significant improvements, while the deviation of the realized implants was \(<\)2.5 mm.

Conclusion   

The system allowed the surgeon to fully concentrate on the surgery itself. It offered greater flexibility since the surgeon received all relevant information, but was free to deviate from it. Accuracy of the realized implants remains an open issue and part of future work.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ewers R, Schicho K, Truppe M, Seemann R, Reichwein A et al (2004) Computer-aided navigation in dental implantology: 7 years of clinical experience. J Oral Maxillofac Surg 62(3):329–334PubMedCrossRef Ewers R, Schicho K, Truppe M, Seemann R, Reichwein A et al (2004) Computer-aided navigation in dental implantology: 7 years of clinical experience. J Oral Maxillofac Surg 62(3):329–334PubMedCrossRef
2.
Zurück zum Zitat Hassfeld S, Muehling J (2001) Computer assisted oral and maxillofacial surgery a review and an assessment of technology. J Oral Maxillofac Surg 30(1):2–13CrossRef Hassfeld S, Muehling J (2001) Computer assisted oral and maxillofacial surgery a review and an assessment of technology. J Oral Maxillofac Surg 30(1):2–13CrossRef
3.
Zurück zum Zitat Kersten-Oertel M, Jannin P, Collins DL (2013) The state of the art of visualization in mixed reality image guided surgery. Comput Med Imaging Graph 37(2):98–112PubMedCrossRef Kersten-Oertel M, Jannin P, Collins DL (2013) The state of the art of visualization in mixed reality image guided surgery. Comput Med Imaging Graph 37(2):98–112PubMedCrossRef
4.
Zurück zum Zitat Woods DD, Patterson ES, Roth EM (2002) Can we ever escape from data overload? A cognitive systems diagnosis. Cognit Technol Work 4(1):22–36CrossRef Woods DD, Patterson ES, Roth EM (2002) Can we ever escape from data overload? A cognitive systems diagnosis. Cognit Technol Work 4(1):22–36CrossRef
5.
Zurück zum Zitat Yamaguchi S, Ohtani T, Yatani H, Sohmura T (2009) Augmented reality system for dental implant surgery. HCI 13:633–638 Yamaguchi S, Ohtani T, Yatani H, Sohmura T (2009) Augmented reality system for dental implant surgery. HCI 13:633–638
6.
Zurück zum Zitat Yamaguchi S, Ohtani T, Ono S, Yamanishi Y, Sohmura T, Yatani H (2011) Intuitive surgical navigation system for dental implantology by using retinal imaging display, implant dentistry—a rapidly evolving practice Prof. Ilser Turkyilmaz (Ed.), ISBN: 978-953-307-658-4, InTech. doi:10.5772/19034 Yamaguchi S, Ohtani T, Ono S, Yamanishi Y, Sohmura T, Yatani H (2011) Intuitive surgical navigation system for dental implantology by using retinal imaging display, implant dentistry—a rapidly evolving practice Prof. Ilser Turkyilmaz (Ed.), ISBN: 978-953-307-658-4, InTech. doi:10.​5772/​19034
7.
Zurück zum Zitat Ploder O, Wagner A, Enislidis G, Ewers R (1995) Computer-assisted intraoperative visualization of dental implants. Augmented reality in medicine. Radiologe 35(9):569–572PubMed Ploder O, Wagner A, Enislidis G, Ewers R (1995) Computer-assisted intraoperative visualization of dental implants. Augmented reality in medicine. Radiologe 35(9):569–572PubMed
8.
Zurück zum Zitat Wanschitz F, Birkfellner W, Figl M, Patruta S, Wagner A, Watzinger F, Yerit K et al (2002) Computer-enhanced stereoscopic vision in a head-mounted display for oral implant surgery. Clin Oral Implant Res 13(6):610–616CrossRef Wanschitz F, Birkfellner W, Figl M, Patruta S, Wagner A, Watzinger F, Yerit K et al (2002) Computer-enhanced stereoscopic vision in a head-mounted display for oral implant surgery. Clin Oral Implant Res 13(6):610–616CrossRef
9.
Zurück zum Zitat Tran HH, Suenaga H, Kuwana K, Masamune K, Dohi T, Nakajima S, Liao H (2011) Augmented reality system for oral surgery using 3D auto stereoscopic visualization medical image computing and computer-assisted intervention—MICCAI 2011 LNCS 6891, 81-88 Tran HH, Suenaga H, Kuwana K, Masamune K, Dohi T, Nakajima S, Liao H (2011) Augmented reality system for oral surgery using 3D auto stereoscopic visualization medical image computing and computer-assisted intervention—MICCAI 2011 LNCS 6891, 81-88
10.
Zurück zum Zitat Lin YK, Yau HT, Wang IC, Zheng C, Chung KH (2013) A novel dental implant guided surgery based on integration of surgical template and augmented reality, Clin Implant Dent Relat Res. doi:10.1111/cid.12119 Lin YK, Yau HT, Wang IC, Zheng C, Chung KH (2013) A novel dental implant guided surgery based on integration of surgical template and augmented reality, Clin Implant Dent Relat Res. doi:10.​1111/​cid.​12119
11.
Zurück zum Zitat Phattanapon R, Kugamoorthy G, Peter H, Matthew D, Siriwan S (2010) Augmented reality haptics system for dental surgical skills training VRST ’10. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology 97–98 Phattanapon R, Kugamoorthy G, Peter H, Matthew D, Siriwan S (2010) Augmented reality haptics system for dental surgical skills training VRST ’10. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology 97–98
12.
Zurück zum Zitat Behringer R, Christian J, Holzinger A, Wilkinson S (2007) Some usability Issues of augmented and mixed reality for e-health applications in the medical domain. USAB 255–266 Behringer R, Christian J, Holzinger A, Wilkinson S (2007) Some usability Issues of augmented and mixed reality for e-health applications in the medical domain. USAB 255–266
13.
Zurück zum Zitat Adam EC (1993) Fighter cockpits of the future. In: proceedings of 12th IEEE/AIAA digital avionics systems conference (DASC), Int J Comput Assist Radiol Surg, 318–323 Adam EC (1993) Fighter cockpits of the future. In: proceedings of 12th IEEE/AIAA digital avionics systems conference (DASC), Int J Comput Assist Radiol Surg, 318–323
14.
Zurück zum Zitat Lalys F, Jannin P (2013) Surgical process modelling: a review. Int J Comput Assist Radiol Surg [Epub ahead of print] Lalys F, Jannin P (2013) Surgical process modelling: a review. Int J Comput Assist Radiol Surg [Epub ahead of print]
15.
Zurück zum Zitat Blum T, Feuner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video MICCAI 2010 Blum T, Feuner H, Navab N (2010) Modeling and segmentation of surgical workflow from laparoscopic video MICCAI 2010
16.
Zurück zum Zitat Padoy N, Blum T, Ahmadi A, Feuner H, Berger MO, Navab N (2010) Statistical modeling and recognition of surgical workflow, medical image analysis (2010) Padoy N, Blum T, Ahmadi A, Feuner H, Berger MO, Navab N (2010) Statistical modeling and recognition of surgical workflow, medical image analysis (2010)
17.
Zurück zum Zitat Lalys F, Riaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining SVM and HMM medical computer vision. MCV’10 proceedings of the 2010 international MICCAI conference on Medical computer vision: recognition techniques and applications in medical imaging Lalys F, Riaud L, Morandi X, Jannin P (2011) Surgical phases detection from microscope videos by combining SVM and HMM medical computer vision. MCV’10 proceedings of the 2010 international MICCAI conference on Medical computer vision: recognition techniques and applications in medical imaging
18.
Zurück zum Zitat Bouarfa L, Jonkera PP, Dankelmana J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform Bouarfa L, Jonkera PP, Dankelmana J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform
19.
Zurück zum Zitat James A, Vieira D, Lo B, Darzi A, Yang GZ (2007) Eye-gaze driven surgical workflow segmentation MICCAI 2007 James A, Vieira D, Lo B, Darzi A, Yang GZ (2007) Eye-gaze driven surgical workflow segmentation MICCAI 2007
20.
Zurück zum Zitat Jannin P, Morandi X (2007) Surgical models for computer-assisted neurosurgery. Neuroimage 37:783–791PubMedCrossRef Jannin P, Morandi X (2007) Surgical models for computer-assisted neurosurgery. Neuroimage 37:783–791PubMedCrossRef
21.
Zurück zum Zitat Neumuth T, Jannin P, Schlomberg J, Meixensberger J, Wiedemann P, Burgert O (2010) Analysis of surgical intervention populations using generic surgical process models. Int J Comput Assist Radiol Surg 6(1):59–71PubMedCentralPubMedCrossRef Neumuth T, Jannin P, Schlomberg J, Meixensberger J, Wiedemann P, Burgert O (2010) Analysis of surgical intervention populations using generic surgical process models. Int J Comput Assist Radiol Surg 6(1):59–71PubMedCentralPubMedCrossRef
22.
Zurück zum Zitat Baader F, Calvanese D, McGuinness DL, Nardi D, Patel-Schneider PF (2003) The description logic handbook: theory, implementation, applications. Cambridge University Press, Cambridge Baader F, Calvanese D, McGuinness DL, Nardi D, Patel-Schneider PF (2003) The description logic handbook: theory, implementation, applications. Cambridge University Press, Cambridge
23.
Zurück zum Zitat Neumuth T, Strau G, Meixensberger J, Lemke HU, Burgert O (2006) Acquisition of process descriptions from surgical interventions. DEXA2006, LNCS(4080) Neumuth T, Strau G, Meixensberger J, Lemke HU, Burgert O (2006) Acquisition of process descriptions from surgical interventions. DEXA2006, LNCS(4080)
24.
Zurück zum Zitat Katic D, Wekerle AL, Bodenstedt S, Kenngott H, Mueller-Stich BP, Dillmann R, Speidel S (2011) Logic-based situation interpretation with real-valued sensor data for laparoscopic surgery. M2CAI 2011–2nd workshop on modeling and monitoring of computer assisted interventions Katic D, Wekerle AL, Bodenstedt S, Kenngott H, Mueller-Stich BP, Dillmann R, Speidel S (2011) Logic-based situation interpretation with real-valued sensor data for laparoscopic surgery. M2CAI 2011–2nd workshop on modeling and monitoring of computer assisted interventions
25.
Zurück zum Zitat Katic D, Wekerle AL, Grtler J, Spengler P, Bodenstedt S, Rhl S, Suwelack S, Kenngott HG, Wagner M, Mueller-Stich BP, Dillmann R, Speidel S (2013) Context-aware augmented reality in laparoscopic surgery. Comp Med Imag Graph 37(2):174–182CrossRef Katic D, Wekerle AL, Grtler J, Spengler P, Bodenstedt S, Rhl S, Suwelack S, Kenngott HG, Wagner M, Mueller-Stich BP, Dillmann R, Speidel S (2013) Context-aware augmented reality in laparoscopic surgery. Comp Med Imag Graph 37(2):174–182CrossRef
26.
Zurück zum Zitat Katic D, Sudra G, Speidel S, Castrillon-Oberndorfer G, Eggers G, Dillmann R (2010) Knowledge-based situation interpretation for context-aware augmented reality in dental implant surgery MIAR 2010 Katic D, Sudra G, Speidel S, Castrillon-Oberndorfer G, Eggers G, Dillmann R (2010) Knowledge-based situation interpretation for context-aware augmented reality in dental implant surgery MIAR 2010
27.
Zurück zum Zitat Tuceryan M, Navab N (2000) Single point active alignment method (SPAAM) for optical see-through HMD calibration for AR IEEE and ACM international symposium on augmented reality Tuceryan M, Navab N (2000) Single point active alignment method (SPAAM) for optical see-through HMD calibration for AR IEEE and ACM international symposium on augmented reality
28.
Zurück zum Zitat Katic D, Christian T, Castrillon-Oberndorfer G, Hoffmann J, Eggers G, Dillmann R, Speidel S (2011) Calibration of see-through-goggles for a context-aware augmented reality system computer assisted radiology and surgery Katic D, Christian T, Castrillon-Oberndorfer G, Hoffmann J, Eggers G, Dillmann R, Speidel S (2011) Calibration of see-through-goggles for a context-aware augmented reality system computer assisted radiology and surgery
Metadaten
Titel
A system for context-aware intraoperative augmented reality in dental implant surgery
verfasst von
Darko Katić
Patrick Spengler
Sebastian Bodenstedt
Gregor Castrillon-Oberndorfer
Robin Seeberger
Juergen Hoffmann
Ruediger Dillmann
Stefanie Speidel
Publikationsdatum
01.01.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 1/2015
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-014-1005-0

Weitere Artikel der Ausgabe 1/2015

International Journal of Computer Assisted Radiology and Surgery 1/2015 Zur Ausgabe