Augmenting Human Cognition through Everyday AR

TL;DR

This paper discusses how augmented reality (AR) integrated with multimodal large language models (LLMs) can serve as an intuitive, context-aware thinking tool that enhances human cognition and task performance in everyday environments.

Contribution

It introduces a framework for embedding semantic and context-aware intelligence into AR to enable seamless, proactive interactions that augment human cognition.

Findings

AR can serve as an intuitive thinking tool

Embedding semantic intelligence enhances task performance

Proactive AR interactions improve understanding

Abstract

As spatial computing and multimodal LLMs mature, AR is tending to become an intuitive "thinking tool," embedding semantic and context-aware intelligence directly into everyday environments. This paper explores how always-on AR can seamlessly bridge digital cognition and physical affordances, enabling proactive, context-sensitive interactions that enhance human task performance and understanding.