Everyday AR through AI-in-the-Loop

TL;DR

This paper discusses the integration of AI into augmented reality to create seamless, adaptive, and context-aware everyday AR experiences, highlighting recent advancements and future research directions.

Contribution

It introduces a framework for AI-in-the-loop AR, emphasizing new opportunities for adaptive content, accessible design, and real-world AI agents in daily AR applications.

Findings

AI enables adaptive and context-aware AR experiences

Generative AR content creation is feasible with current AI tech

AI-driven assistants enhance everyday AR usability

Abstract

This workshop brings together experts and practitioners from augmented reality (AR) and artificial intelligence (AI) to shape the future of AI-in-the-loop everyday AR experiences. With recent advancements in both AR hardware and AI capabilities, we envision that everyday AR -- always-available and seamlessly integrated into users' daily environments -- is becoming increasingly feasible. This workshop will explore how AI can drive such everyday AR experiences. We discuss a range of topics, including adaptive and context-aware AR, generative AR content creation, always-on AI assistants, AI-driven accessible design, and real-world-oriented AI agents. Our goal is to identify the opportunities and challenges in AI-enabled AR, focusing on creating novel AR experiences that seamlessly blend the digital and physical worlds. Through the workshop, we aim to foster collaboration, inspire future research, and build a community to advance the research field of AI-enhanced AR.