"See What I Imagine, Imagine What I See": Human-AI Co-Creation System for 360$^\circ$ Panoramic Video Generation in VR

TL;DR

Imagine360 is a novel human-AI co-creation system that enables users to generate and customize 360-degree panoramic VR videos through speech prompts and real-time adjustments, enhancing creative control and immersion.

Contribution

This paper introduces Imagine360, a pioneering VR system integrating AI for co-creative panoramic video generation, allowing seamless user interaction and dynamic environment customization.

Findings

Co-creation enhances user engagement in VR.

AI-driven workflow improves creative control.

User study shows positive reception of co-creative VR.

Abstract

The emerging field of panoramic video generation from text and image prompts unlocks new creative possibilities in virtual reality (VR), addressing the limitations of current immersive experiences, which are constrained by pre-designed environments that restrict user creativity. To advance this frontier, we present Imagine360, a proof-of-concept prototype that integrates co-creation principles with AI agents. This system enables refined speech-based text prompts, egocentric perspective adjustments, and real-time customization of virtual surroundings based on user perception and intent. An eight-participant pilot study comparing non-AI and linear AI-driven workflows demonstrates that Imagine360's co-creative approach effectively integrates temporal and spatial creative controls. This introduces a transformative VR paradigm, allowing users to seamlessly transition between 'seeing' and 'imagining,' thereby shaping virtual reality through the creations of their minds.