PromptArtisan: Multi-instruction Image Editing in Single Pass with Complete Attention Control

TL;DR

PromptArtisan introduces a single-pass, multi-instruction image editing method that offers precise, complex transformations with complete attention control, eliminating iterative refinement and requiring no additional training.

Contribution

It presents a novel Complete Attention Control Mechanism enabling multi-instruction, mask-based image editing in a single pass without extra training.

Findings

Achieves complex, multi-instruction edits in one pass

Provides fine-grained control over image transformations

Operates zero-shot without additional training

Abstract

We present PromptArtisan, a groundbreaking approach to multi-instruction image editing that achieves remarkable results in a single pass, eliminating the need for time-consuming iterative refinement. Our method empowers users to provide multiple editing instructions, each associated with a specific mask within the image. This flexibility allows for complex edits involving mask intersections or overlaps, enabling the realization of intricate and nuanced image transformations. PromptArtisan leverages a pre-trained InstructPix2Pix model in conjunction with a novel Complete Attention Control Mechanism (CACM). This mechanism ensures precise adherence to user instructions, granting fine-grained control over the editing process. Furthermore, our approach is zero-shot, requiring no additional training, and boasts improved processing complexity compared to traditional iterative methods. By seamlessly integrating multi-instruction capabilities, single-pass efficiency, and complete attention control, PromptArtisan unlocks new possibilities for creative and efficient image editing workflows, catering to both novice and expert users alike.