Creative Captioning: An AI Grand Challenge Based on the Dixit Board Game

TL;DR

This paper introduces the concept of creative captioning as a grand challenge in AI, using the Dixit board game as a testbed to develop and evaluate AI systems capable of generating and understanding clever, abstract, and culturally rich image captions.

Contribution

It defines creative captioning as a new AI challenge, proposing Dixit as a benchmark to foster research across vision, NLP, and reasoning domains.

Findings

Dixit can serve as an engaging benchmark for creative captioning.

Creative captioning requires integration of vision, language, and cultural knowledge.

The proposed challenge aims to motivate long-term AI research in creativity and understanding.

Abstract

We propose a new class of "grand challenge" AI problems that we call creative captioning---generating clever, interesting, or abstract captions for images, as well as understanding such captions. Creative captioning draws on core AI research areas of vision, natural language processing, narrative reasoning, and social reasoning, and across all these areas, it requires sophisticated uses of common sense and cultural knowledge. In this paper, we analyze several specific research problems that fall under creative captioning, using the popular board game Dixit as both inspiration and proposed testing ground. We expect that Dixit could serve as an engaging and motivating benchmark for creative captioning across numerous AI research communities for the coming 1-2 decades.