iTrace: Click-Based Gaze Visualization on the Apple Vision Pro
Esra Mehmedova, Santiago Berrezueta-Guzman, Stefan Wagner

TL;DR
iTrace is a click-based gaze visualization tool for Apple Vision Pro that overcomes privacy restrictions, enabling detailed attention analysis through manual and automatic click methods with high gaze accuracy.
Contribution
The paper introduces iTrace, a novel system that extracts gaze data via click-based methods on Apple Vision Pro, providing dynamic heatmaps despite privacy restrictions.
Findings
Higher data collection rate with gaming controller (14.22 clicks/sec) compared to dwell control (0.45 clicks/sec).
Heatmaps reveal distinct attention patterns in different tasks.
Gaze accuracy maintained at 91%.
Abstract
The Apple Vision Pro is equipped with accurate eye-tracking capabilities, yet the privacy restrictions on the device prevent direct access to continuous user gaze data. This study introduces iTrace, a novel application that overcomes these limitations through click-based gaze extraction techniques, including manual methods like a pinch gesture, and automatic approaches utilizing dwell control or a gaming controller. We developed a system with a client-server architecture that captures the gaze coordinates and transforms them into dynamic heatmaps for video and spatial eye tracking. The system can generate individual and averaged heatmaps, enabling analysis of personal and collective attention patterns. To demonstrate its effectiveness and evaluate the usability and performance, a study was conducted with two groups of 10 participants, each testing different clicking methods. The…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
