InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention
Howard Zhang, Yuval Alaluf, Sizhuo Ma, Achuta Kadambi, Jian Wang, Kfir, Aberman

TL;DR
InstantRestore is a fast, scalable face restoration framework that uses a single-step diffusion model and attention-sharing to enhance degraded images while preserving identity features, achieving near real-time performance.
Contribution
It introduces a novel single-step diffusion-based framework with shared attention and landmark loss for efficient, personalized face restoration without per-identity tuning.
Findings
Outperforms existing methods in quality and speed
Achieves near real-time restoration with small reference sets
Effectively preserves identity details during restoration
Abstract
Face image restoration aims to enhance degraded facial images while addressing challenges such as diverse degradation types, real-time processing demands, and, most crucially, the preservation of identity-specific features. Existing methods often struggle with slow processing times and suboptimal restoration, especially under severe degradation, failing to accurately reconstruct finer-level identity details. To address these issues, we introduce InstantRestore, a novel framework that leverages a single-step image diffusion model and an attention-sharing mechanism for fast and personalized face restoration. Additionally, InstantRestore incorporates a novel landmark attention loss, aligning key facial landmarks to refine the attention maps, enhancing identity preservation. At inference time, given a degraded input and a small (~4) set of reference images, InstantRestore performs a single…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFace recognition and analysis · Facial Rejuvenation and Surgery Techniques · Facial Nerve Paralysis Treatment and Research
MethodsSoftmax · Attention Is All You Need · Sparse Evolutionary Training · Diffusion
