DNAEdit: Direct Noise Alignment for Text-Guided Rectified Flow Editing

TL;DR

DNAEdit introduces a direct noise alignment technique that refines Gaussian noise in the noise domain, significantly reducing error accumulation in text-guided image editing with diffusion models.

Contribution

The paper proposes DNA, a novel method for noise refinement in rectified flow-based image editing, and introduces MVG for better control, along with a new benchmark for evaluation.

Findings

DNA achieves superior editing accuracy over state-of-the-art methods.

The method reduces noise estimation errors and improves image fidelity.

DNAEdit demonstrates effective prompt-guided image editing with balanced control.

Abstract

Leveraging the powerful generation capability of large-scale pretrained text-to-image models, training-free methods have demonstrated impressive image editing results. Conventional diffusion-based methods, as well as recent rectified flow (RF)-based methods, typically reverse synthesis trajectories by gradually adding noise to clean images, during which the noisy latent at the current timestep is used to approximate that at the next timesteps, introducing accumulated drift and degrading reconstruction accuracy. Considering the fact that in RF the noisy latent is estimated through direct interpolation between Gaussian noises and clean images at each timestep, we propose Direct Noise Alignment (DNA), which directly refines the desired Gaussian noise in the noise domain, significantly reducing the error accumulation in previous methods. Specifically, DNA estimates the velocity field of the interpolated noised latent at each timestep and adjusts the Gaussian noise by computing the difference between the predicted and expected velocity field. We validate the effectiveness of DNA and reveal its relationship with existing RF-based inversion methods. Additionally, we introduce a Mobile Velocity Guidance (MVG) to control the target prompt-guided generation process, balancing image background preservation and target object editability. DNA and MVG collectively constitute our proposed method, namely DNAEdit. Finally, we introduce DNA-Bench, a long-prompt benchmark, to evaluate the performance of advanced image editing models. Experimental results demonstrate that our DNAEdit achieves superior performance to state-of-the-art text-guided editing methods. Codes and benchmark will be available at \href{ https://xiechenxi99.github.io/DNAEdit/}{https://xiechenxi99.github.io/DNAEdit/}.