# CraftGraffiti: Exploring Human Identity with Custom Graffiti Art via Facial-Preserving Diffusion Models

**Authors:** Ayan Banerjee, Fernando Vilari\~no, Josep Llad\'os

arXiv: 2508.20640 · 2026-04-14

## TL;DR

CraftGraffiti is a novel AI framework that generates graffiti art from text prompts, preserving facial identity and allowing pose customization without keypoints, validated through quantitative and real-world tests.

## Contribution

It introduces a face-preserving diffusion-based graffiti generation method with pose control, advancing identity fidelity in stylized AI art.

## Key findings

- Achieves high facial feature consistency in graffiti images.
- Outperforms existing methods in aesthetic and human preference scores.
- Demonstrates real-world creative impact through festival deployment.

## Abstract

Preserving facial identity under extreme stylistic transformation remains a major challenge in generative art. In graffiti, a high-contrast, abstract medium, subtle distortions to the eyes, nose, or mouth can erase the subject's recognizability, undermining both personal and cultural authenticity. We present CraftGraffiti, an end-to-end text-guided graffiti generation framework designed with facial feature preservation as a primary objective. Given an input image and a style and pose descriptive prompt, CraftGraffiti first applies graffiti style transfer via LoRA-fine-tuned pretrained diffusion transformer, then enforces identity fidelity through a face-consistent self-attention mechanism that augments attention layers with explicit identity embeddings. Pose customization is achieved without keypoints, using CLIP-guided prompt extension to enable dynamic re-posing while retaining facial coherence. We formally justify and empirically validate the "style-first, identity-after" paradigm, showing it reduces attribute drift compared to the reverse order. Quantitative results demonstrate competitive facial feature consistency and state-of-the-art aesthetic and human preference scores, while qualitative analyses and a live deployment at the Cruilla Festival highlight the system's real-world creative impact. CraftGraffiti advances the goal of identity-respectful AI-assisted artistry, offering a principled approach for blending stylistic freedom with recognizability in creative AI applications.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/2508.20640/full.md

## Figures

12 figures with captions in the complete paper: https://tomesphere.com/paper/2508.20640/full.md

## References

59 references — full list in the complete paper: https://tomesphere.com/paper/2508.20640/full.md

---
Source: https://tomesphere.com/paper/2508.20640