AutoPP: Towards Automated Product Poster Generation and Optimization

TL;DR

AutoPP is an automated system that generates and optimizes product posters using online feedback, significantly reducing manual effort and achieving state-of-the-art results in poster design and performance enhancement.

Contribution

We introduce AutoPP, the first fully automated pipeline for product poster creation and optimization leveraging online feedback and a large-scale dataset.

Findings

AutoPP outperforms existing methods in offline evaluations.

AutoPP achieves higher CTR in online deployment.

The dataset AutoPP1M enables robust poster generation and optimization.

Abstract

Product posters blend striking visuals with informative text to highlight the product and capture customer attention. However, crafting appealing posters and manually optimizing them based on online performance is laborious and resource-consuming. To address this, we introduce AutoPP, an automated pipeline for product poster generation and optimization that eliminates the need for human intervention. Specifically, the generator, relying solely on basic product information, first uses a unified design module to integrate the three key elements of a poster (background, text, and layout) into a cohesive output. Then, an element rendering module encodes these elements into condition tokens, efficiently and controllably generating the product poster. Based on the generated poster, the optimizer enhances its Click-Through Rate (CTR) by leveraging online feedback. It systematically replaces elements to gather fine-grained CTR comparisons and utilizes Isolated Direct Preference Optimization (IDPO) to attribute CTR gains to isolated elements. Our work is supported by AutoPP1M, the largest dataset specifically designed for product poster generation and optimization, which contains one million high-quality posters and feedback collected from over one million users. Experiments demonstrate that AutoPP achieves state-of-the-art results in both offline and online settings. Our code and dataset are publicly available at: https://github.com/JD-GenX/AutoPP