Structure Sensor for mobile markerless augmented reality

T. Kilgus; R. Bux; A. M. Franz; W. Johnen; E. Heim; M. Fangerau; M. Müller; K. Yen; L. Maier-Hein

doi:10.1117/12.2216057

18 March 2016 Structure Sensor for mobile markerless augmented reality

T. Kilgus, R. Bux, A. M. Franz, W. Johnen, E. Heim, M. Fangerau, M. Müller, K. Yen, L. Maier-Hein

Proceedings Volume 9786, Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling; 97861L (2016) https://doi.org/10.1117/12.2216057
Event: SPIE Medical Imaging, 2016, San Diego, California, United States

Abstract

3D Visualization of anatomical data is an integral part of diagnostics and treatment in many medical disciplines, such as radiology, surgery and forensic medicine. To enable intuitive interaction with the data, we recently proposed a new concept for on-patient visualization of medical data which involves rendering of subsurface structures on a mobile display that can be moved along the human body. The data fusion is achieved with a range imaging device attached to the display. The range data is used to register static 3D medical imaging data with the patient body based on a surface matching algorithm. However, our previous prototype was based on the Microsoft Kinect camera and thus required a cable connection to acquire color and depth data. The contribution of this paper is two-fold. Firstly, we replace the Kinect with the Structure Sensor - a novel cable-free range imaging device - to improve handling and user experience and show that the resulting accuracy (target registration error: 4.8±1.5 mm) is comparable to that achieved with the Kinect. Secondly, a new approach to visualizing complex 3D anatomy based on this device, as well as 3D printed models of anatomical surfaces, is presented. We demonstrate that our concept can be applied to in vivo data and to a 3D printed skull of a forensic case. Our new device is the next step towards clinical integration and shows that the concept cannot only be applied during autopsy but also for presentation of forensic data to laypeople in court or medical education.

Citation Download Citation

T. Kilgus, R. Bux, A. M. Franz, W. Johnen, E. Heim, M. Fangerau, M. Müller, K. Yen, and L. Maier-Hein "Structure Sensor for mobile markerless augmented reality", Proc. SPIE 9786, Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling, 97861L (18 March 2016); https://doi.org/10.1117/12.2216057

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available