ArthroPhase: A Novel Dataset and Method for Phase Recognition in Arthroscopic Video

TL;DR

This paper introduces the first arthroscopic surgery dataset and a transformer-based model for surgical phase recognition, achieving promising accuracy and offering a new benchmark for future research in arthroscopic video analysis.

Contribution

The study provides a novel dataset (ACL27) and a transformer-based model that effectively recognizes surgical phases in arthroscopic videos, addressing specific challenges like occlusions and visual distortions.

Findings

Achieved 72.91% accuracy on ACL27 dataset.

Model performance comparable to state-of-the-art on Cholec80.

Surgical Progress Index (SPI) reliably estimates surgery progression.

Abstract

This study aims to advance surgical phase recognition in arthroscopic procedures, specifically Anterior Cruciate Ligament (ACL) reconstruction, by introducing the first arthroscopy dataset and developing a novel transformer-based model. We aim to establish a benchmark for arthroscopic surgical phase recognition by leveraging spatio-temporal features to address the specific challenges of arthroscopic videos including limited field of view, occlusions, and visual distortions. We developed the ACL27 dataset, comprising 27 videos of ACL surgeries, each labeled with surgical phases. Our model employs a transformer-based architecture, utilizing temporal-aware frame-wise feature extraction through a ResNet-50 and transformer layers. This approach integrates spatio-temporal features and introduces a Surgical Progress Index (SPI) to quantify surgery progression. The model's performance was evaluated using accuracy, precision, recall, and Jaccard Index on the ACL27 and Cholec80 datasets. The proposed model achieved an overall accuracy of 72.91% on the ACL27 dataset. On the Cholec80 dataset, the model achieved a comparable performance with the state-of-the-art methods with an accuracy of 92.4%. The SPI demonstrated an output error of 10.6% and 9.86% on ACL27 and Cholec80 datasets respectively, indicating reliable surgery progression estimation. This study introduces a significant advancement in surgical phase recognition for arthroscopy, providing a comprehensive dataset and a robust transformer-based model. The results validate the model's effectiveness and generalizability, highlighting its potential to improve surgical training, real-time assistance, and operational efficiency in orthopedic surgery. The publicly available dataset and code will facilitate future research and development in this critical field.