Gaze Archive: Enhancing Human Memory through Active Visual Logging on Smart Glasses

TL;DR

Gaze Archive uses smart glasses and gaze tracking to passively and accurately log important visual information, improving memory aid with minimal effort and high user preference.

Contribution

It introduces Gaze Archive, a novel gaze-based visual logging paradigm and GAHMA framework for intent-aligned, unobtrusive memory enhancement on smart glasses.

Findings

GAHMA achieves more intent-precise logging than non-gaze methods.

User studies show Gaze Archive is more effortless and preferred over existing methods.

Demonstrated effectiveness in real-world scenarios.

Abstract

People today are overwhelmed by massive amounts of information, leading to cognitive overload and memory burden. Traditional visual memory augmentation methods are either effortful and disruptive or fail to align with user intent. To address these limitations, we propose Gaze Archive, a novel visual memory enhancement paradigm through active logging on smart glasses. It leverages human gaze as a natural attention indicator, enabling both intent-precise capture and effortless-and-unobtrusive interaction. To implement Gaze Archive, we develop GAHMA, a technical framework that enables compact yet intent-aligned memory encoding and intuitive memory recall based on natural language queries. Quantitative experiments on our newly constructed GAVER dataset show that GAHMA achieves more intent-precise logging than non-gaze baselines. Through extensive user studies in both laboratory and real-world scenarios, we compare Gaze Archive with other existing memory augmentation methods. Results demonstrate its advantages in perceived effortlessness, unobtrusiveness and overall preference, showing strong potential for real-world deployment.