A Framework for Computational Design and Adaptation of Extended Reality User Interfaces

TL;DR

This paper proposes a comprehensive framework for designing adaptive user interfaces in extended reality environments, addressing the unique challenges of immersive content presentation and user interaction.

Contribution

It introduces a novel framework with five key considerations for adaptive XR UI design, integrating literature review and identifying future research directions.

Findings

Identifies key considerations for adaptive XR UI design

Reviews existing approaches and highlights gaps in current research

Suggests directions for developing computational adaptation methods

Abstract

To facilitate high quality interaction during the regular use of computing systems, it is essential that the user interface (UI) deliver content and components in an appropriate manner. Although extended reality (XR) is emerging as a new computing platform, we still have a limited understanding of how best to design and present interactive content to users in such immersive environments. Adaptive UIs offer a promising approach for optimal presentation in XR as the user's environment, tasks, capabilities, and preferences vary under changing context. In this position paper, we present a design framework for adapting various characteristics of content presented in XR. We frame these as five considerations that need to be taken into account for adaptive XR UIs: What?, How Much?, Where?, How?, and When?. With this framework, we review literature on UI design and adaptation to reflect on approaches that have been adopted or developed in the past towards identifying current gaps and challenges, and opportunities for applying such approaches in XR. Using our framework, future work could identify and develop novel computational approaches for achieving successful adaptive user interfaces in such immersive environments.