OphEdit: Training-Free Text-Guided Editing of Ophthalmic Surgical Videos

TL;DR

OphEdit is a training-free, text-guided framework for editing ophthalmic surgical videos that preserves anatomical accuracy while enabling semantic modifications.

Contribution

It introduces a novel second-order ODE inversion pipeline and a selective tensor injection method for precise, training-free surgical video editing.

Findings

Effectively handles complex surgical transformations.

Maintains anatomical geometry and temporal consistency.

First application of training-free video editing in ophthalmology.

Abstract

High-fidelity surgical video generation can greatly improve medical training and the development of AI, adapting these generative models for precise video editing remains a formidable challenge. Modifying surgical attributes, such as instrument tissue interactions or procedural phases is challenging due to the strict anatomical and temporal constraints. In this paper, we propose OphEdit, a novel training-free framework for the text-guided editing of ophthalmic surgical videos. Our approach leverages a deterministic second-order ODE inversion pipeline to capture Attention Value (V) tensors from the original video. By selectively injecting these stored tensors into the conditional Classifier-Free Guidance (CFG) branch during the denoising phase, OphEdit rigorously preserves the intricate anatomical geometry of the eye while seamlessly mapping text-driven semantic modifications onto the video stream. Clinical evaluations demonstrates that OphEdit effectively handles complex surgical transformations, such as instrument swaps and procedural variations, with superior structural fidelity and temporal consistency compared to natural-domain video editors. Our work represents the first application of training-free video editing in the ophthalmic surgical domain, offering a scalable solution for generating diverse, annotated medical datasets without the need for exhaustive manual recording or costly model fine-tuning. The code and prompts can be accessed at https://github.com/ophedit/OphEdit