Mutltimodal AI Companion for Interactive Fairytale Co-creation
Ruiyang Liu, Predrag K. Nikolic

TL;DR
This paper introduces AI.R Taletorium, a multimodal AI system that actively involves children in creating fairy tales through interactive storytelling and visualization, enhancing early childhood education and engagement.
Contribution
The work presents a novel multimodal AI companion with a bidirectional connection mechanism, enabling interactive fairy tale co-creation using text and doodles, which was not addressed in prior systems.
Findings
Generated meaningful and vivid fairy tales with limited training data.
Successfully completed full interaction cycle with various inputs.
Enhanced engagement in early childhood education through multimodal interaction.
Abstract
AI fairy tale companions play an important role in early childhood education as an augmentation for parents' efforts to close the participation gap and boost kids' mental and language development. Existing systems are generally designed to provide vivid materials as unidirectional entertaining reading environments, e.g, visualizing inputting texts. However, due to the limited vocabulary of kids, these systems failed to afford effective interaction to motivate kids to write their own fairy tales. In this work, we propose AI.R Taletorium, an illustrative, immersive, and inclusive multimodal AI companion, for interactive fairy tale co-creation that actively involves kids to create fairy tales with both the AI agent and their normal peers. AI.R Taletorium consists a neural story generator and a doodler-based fairy tale visualizer. We design a character-centric bidirectional connection…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMultimodal Machine Learning Applications · Artificial Intelligence in Games · Topic Modeling
