An innovative mixed reality approach for Robotics Surgery

TL;DR

This paper presents a novel mixed reality system using Hololens 2 to enhance visualization and planning in robotic-assisted surgery, aiming to improve surgical outcomes and user experience.

Contribution

It introduces an innovative mixed reality application that integrates preoperative planning and intraoperative visualization for robotic surgery.

Findings

Positive laboratory test results

Enhanced 3D anatomical perception

Improved surgical planning capabilities

Abstract

Robotic-assisted procedures offer numerous advantages over traditional approaches, including improved dexterity, reduced fatigue, minimized trauma, and superior outcomes. However, the main challenge of these systems remains the poor visualization and perception of the surgical field. The goal of this paper is to provide an innovative approach concerning an application able to improve the surgical procedures offering assistance in both preplanning and intraoperative steps of the surgery. The system has been designed to offer a better understanding of the patient through techniques that provide medical images visualization, 3D anatomical structures perception and robotic planning. The application was designed to be intuitive and user friendly, providing an augmented reality experience through the Hololens 2 device. It was tested in laboratory conditions, yielding positive results.