A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT
Yihan Cao, Siyu Li, Yixin Liu, Zhiling Yan, Yutong Dai, Philip S. Yu,, Lichao Sun

TL;DR
This survey reviews the evolution of AI-generated content, highlighting recent advances in large-scale models and multimodal generation, and discusses open challenges and future directions in the field.
Contribution
It provides a comprehensive overview of the history, components, and recent progress in AIGC, including unimodal and multimodal generation techniques.
Findings
Large-scale models improve content realism and quality.
Multimodal interactions enable cross-application of text and image generation.
Open problems include model interpretability and ethical considerations.
Abstract
Recently, ChatGPT, along with DALL-E-2 and Codex,has been gaining significant attention from society. As a result, many individuals have become interested in related resources and are seeking to uncover the background and secrets behind its impressive performance. In fact, ChatGPT and other Generative AI (GAI) techniques belong to the category of Artificial Intelligence Generated Content (AIGC), which involves the creation of digital content, such as images, music, and natural language, through AI models. The goal of AIGC is to make the content creation process more efficient and accessible, allowing for the production of high-quality content at a faster pace. AIGC is achieved by extracting and understanding intent information from instructions provided by human, and generating the content according to its knowledge and the intent information. In recent years, large-scale models have…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Natural Language Processing Techniques · Multimodal Machine Learning Applications
MethodsCosine Annealing · Inverse Square Root Schedule · Adafactor · Linear Layer · SentencePiece · Gated Linear Unit · T5 · CodeT5 · Linear Warmup With Linear Decay · WordPiece
