Augmented Reality Image Overlay Projection for Image Guided Open Liver Ablation of Metastatic Liver Cancer

This work presents an evaluation of a novel augmented reality approach for the visualisation of real time guidance of an ablation tool to a tumor in open liver surgery. The approach uses a portable image overlay device, directly integrated into a liver surgical navigation system, to display guidance graphics along with underlying anatomical structures directly on the liver surface. The guidance application generates trajectories from the current ablation needle tip to the centre of the tumor. Needle alignment guidance and depth information are displayed directly on the liver surface, providing intuitive real-time feedback for guiding the ablation tool tip to the targeted tumor. Validation of the guidance visual feedback on porcine liver tissue showed that the system was useful in trajectory planning and tumor targeting. The augmented reality guidance was easily visible, removed the need for sight diversion and was implemented without imposing any timely or procedural overhead when compared to a navigated procedure itself.