Optical Tag-Based Neuronavigation and Augmentation System for Non-Invasive Brain Stimulation

TL;DR

This paper introduces a cost-effective, real-time computer vision system with AR integration for precise, user-friendly neuronavigation in non-invasive brain stimulation, improving accuracy and usability.

Contribution

It presents a novel optical tracking system with AR for neuronavigation, combining consumer hardware and digital twin technology for enhanced TMS targeting.

Findings

Improved spatial precision and accuracy in coil placement.

Real-time visualization of stimulation targets.

Enhanced usability through AR projection.

Abstract

Accurate neuronavigation is critical for effective transcranial magnetic stimulation (TMS), as stimulation outcomes depend directly on precise coil placement. Existing neuronavigation systems are often costly, complex, and prone to tracking errors. To address these limitations, we present a computer vision based neuronavigation system that enables real time tracking of the patient and TMS instrumentation. The system integrates a multi camera optical tracking setup with consumer grade hardware and visible markers to drive a digital twin of the stimulation process. A dynamic 3D brain model in Unity updates in real time to visualize coil position and estimated stimulation targets. Augmented reality (AR) is further incorporated to project this model directly onto the patient's head, enabling intuitive, in situ coil adjustment without reliance on abstract numerical displays. Overall, the proposed approach improves spatial precision and accuracy while enhancing usability.