Delta Denoising Score
Amir Hertz, Kfir Aberman, Daniel Cohen-Or

TL;DR
Delta Denoising Score (DDS) is a new scoring function that improves text-based image editing by guiding minimal modifications using diffusion models, addressing noise issues in existing methods and enabling effective zero-shot translation.
Contribution
The paper introduces DDS, a novel scoring function that enhances image editing stability and quality by refining score distillation sampling with prompt matching.
Findings
DDS outperforms existing methods in stability and quality
DDS enables effective zero-shot image translation
DDS reduces noise and blurriness in edited images
Abstract
We introduce Delta Denoising Score (DDS), a novel scoring function for text-based image editing that guides minimal modifications of an input image towards the content described in a target prompt. DDS leverages the rich generative prior of text-to-image diffusion models and can be used as a loss term in an optimization problem to steer an image towards a desired direction dictated by a text. DDS utilizes the Score Distillation Sampling (SDS) mechanism for the purpose of image editing. We show that using only SDS often produces non-detailed and blurry outputs due to noisy gradients. To address this issue, DDS uses a prompt that matches the input image to identify and remove undesired erroneous directions of SDS. Our key premise is that SDS should be zero when calculated on pairs of matched prompts and images, meaning that if the score is non-zero, its gradients can be attributed to the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Mycobacterium research and diagnosis · Cell Image Analysis Techniques
MethodsDiffusion
