EasyPhoto: Your Smart AI Photo Generator

TL;DR

EasyPhoto is a novel WebUI plugin that enables personalized AI portrait generation by finetuning models with user images, supporting multiple persons, styles, and diverse templates for enhanced photo synthesis.

Contribution

It introduces a new WebUI plugin that allows personalized AI portrait generation through model finetuning with user images, supporting multiple persons and styles.

Findings

Supports generation of personalized AI portraits.

Enables modification of multiple persons and styles.

Provides a webui-free version using diffusers.

Abstract

Stable Diffusion web UI (SD-WebUI) is a comprehensive project that provides a browser interface based on Gradio library for Stable Diffusion models. In this paper, We propose a novel WebUI plugin called EasyPhoto, which enables the generation of AI portraits. By training a digital doppelganger of a specific user ID using 5 to 20 relevant images, the finetuned model (according to the trained LoRA model) allows for the generation of AI photos using arbitrary templates. Our current implementation supports the modification of multiple persons and different photo styles. Furthermore, we allow users to generate fantastic template image with the strong SDXL model, enhancing EasyPhoto's capabilities to deliver more diverse and satisfactory results. The source code for EasyPhoto is available at: https://github.com/aigc-apps/sd-webui-EasyPhoto. We also support a webui-free version by using diffusers: https://github.com/aigc-apps/EasyPhoto. We are continuously enhancing our efforts to expand the EasyPhoto pipeline, making it suitable for any identification (not limited to just the face), and we enthusiastically welcome any intriguing ideas or suggestions.