EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing

TL;DR

EditTransfer++ introduces a visually grounded, efficient image editing framework that improves faithfulness and speed by decoupling text conditioning and refining denoising trajectories.

Contribution

The paper proposes a novel training and inference scheme that enhances visual prompt faithfulness and efficiency in image editing, surpassing prior diffusion transformer-based methods.

Findings

Achieves state-of-the-art visual prompt faithfulness.

Enables high-resolution editing with 1024-pixel edges.

Offers faster inference compared to previous approaches.

Abstract

Visual-prompt-guided edit transfer aims to learn image transformations directly from example pairs, offering more precise and controllable editing than purely text-driven approaches. However, existing diffusion transformer-based methods often fail to faithfully reproduce the demonstrated edits due to structural mismatches between the task and the backbone, including a pretrained bias toward textual conditioning and inherent stochastic instability during sampling. To bridge this gap, we present EditTransfer++, a framework that combines progressively structured training with an efficient conditioning scheme to improve both visual prompt faithfulness and inference efficiency. We first mitigate textual dominance with a text-decoupled training strategy that removes text conditioning during fine-tuning, compelling the model to infer transformations solely from visual evidence while still supporting optional text guidance at inference. On top of this visually grounded model, a best-worst contrastive refinement mechanism reshapes the denoising trajectories to suppress unfaithful generations and improve consistency across random seeds. To alleviate the computational bottleneck of high-resolution in-context editing, we further introduce a condition compression and reuse strategy that reduces token redundancy and enables efficient generation of images with a 1024-pixel long edge. Extensive experiments on existing benchmarks and the proposed EditTransfer-Bench show that EditTransfer++ achieves state-of-the-art visual prompt faithfulness with substantially faster inference than prior methods, suggesting a promising direction for scalable prompt-guided image editing and broader visual in-context learning.