A Survey on Generative Diffusion Model

TL;DR

This survey comprehensively reviews the development, algorithms, and applications of diffusion models, highlighting their role in advancing generative AI across various domains and future research directions.

Contribution

It provides an in-depth, structured overview of diffusion models' evolution, algorithmic improvements, and diverse applications, offering valuable insights for future research.

Findings

Diffusion models are pivotal in generative AI across multiple domains.

The survey details recent algorithmic enhancements and their impact.

Future directions include improving efficiency and expanding applications.

Abstract

Deep generative models have unlocked another profound realm of human creativity. By capturing and generalizing patterns within data, we have entered the epoch of all-encompassing Artificial Intelligence for General Creativity (AIGC). Notably, diffusion models, recognized as one of the paramount generative models, materialize human ideation into tangible instances across diverse domains, encompassing imagery, text, speech, biology, and healthcare. To provide advanced and comprehensive insights into diffusion, this survey comprehensively elucidates its developmental trajectory and future directions from three distinct angles: the fundamental formulation of diffusion, algorithmic enhancements, and the manifold applications of diffusion. Each layer is meticulously explored to offer a profound comprehension of its evolution. Structured and summarized approaches are presented in https://github.com/chq1155/A-Survey-on-Generative-Diffusion-Model.