SVGDreamer: Text Guided SVG Generation with Diffusion Model

TL;DR

SVGDreamer introduces a novel text-guided SVG generation framework that enhances structural control, visual quality, and diversity through semantic vectorization and particle-based score distillation.

Contribution

It proposes SIVE for controllable vectorization and VPSD for improved quality and diversity, outperforming existing methods in text-guided SVG synthesis.

Findings

Outperforms baselines in editability, visual quality, and diversity.

Uses SIVE for fine-grained control of vector elements.

Employs VPSD for better shape and color quality, faster convergence.

Abstract

Text-guided scalable vector graphics (SVG) synthesis has broad applications in icon and sketch generation. However, existing text-to-SVG methods often suffer from limited editability, suboptimal visual quality, and low sample diversity. To address these challenges, we propose \textbf{SVGDreamer}, a novel framework for text-guided vector graphics synthesis. Our method introduces a \textbf{semantic-driven image vectorization (SIVE)} process, which decomposes the generation procedure into foreground objects and background elements, thereby improving structural controllability and editability. In particular, SIVE incorporates attention-based primitive control and an attention-mask loss to facilitate fine-grained manipulation of individual vector elements. To further improve generation quality and diversity, we propose \textbf{Vectorized Particle-based Score Distillation (VPSD)}, which models SVGs as distributions over control points and colors. Compared with existing text-to-SVG optimization methods, VPSD alleviates over-smoothed shapes, over-saturated colors, limited diversity, and slow convergence. Moreover, VPSD leverages a reward model to reweight vector particles, leading to better visual aesthetics and faster convergence. Extensive experiments demonstrate that SVGDreamer consistently outperforms existing baselines in editability, visual quality, and diversity. Project page: https://ximinng.github.io/SVGDreamer-project/