3D landmark detection for augmented reality based otologic procedures

TL;DR

This paper introduces a convolutional neural network method for detecting ear landmarks in CT images to enable augmented reality visualization of cochlear structures during ear surgeries.

Contribution

It presents a novel CNN-based approach for landmark detection in ear CT scans and integrates it into an AR system for surgical guidance.

Findings

Successful CNN landmark detection in ear CT images

AR system visualizes cochlear axis during surgery

Potential to improve otologic surgical accuracy

Abstract

Ear consists of the smallest bones in the human body and does not contain significant amount of distinct landmark points that may be used to register a preoperative CT-scan with the surgical video in an augmented reality framework. Learning based algorithms may be used to help the surgeons to identify landmark points. This paper presents a convolutional neural network approach to landmark detection in preoperative ear CT images and then discusses an augmented reality system that can be used to visualize the cochlear axis on an otologic surgical video.