Aria Everyday Activities Dataset
Zhaoyang Lv, Nicholas Charron, Pierre Moulon, Alexander Gamino, Cheng, Peng, Chris Sweeney, Edward Miller, Huixuan Tang, Jeff Meissner, Jing Dong,, Kiran Somasundaram, Luis Pesqueira, Mark Schwesinger, Omkar Parkhi, Qiao Gu,, Renzo De Nardi, Shangyi Cheng, Steve Saarinen

TL;DR
The Aria Everyday Activities Dataset is a comprehensive egocentric multimodal dataset capturing daily activities with diverse sensor data, enabling research in neural scene reconstruction and segmentation.
Contribution
This paper introduces the first open-source egocentric multimodal dataset with diverse sensor modalities and multiple research applications.
Findings
Dataset includes 143 activity sequences from diverse indoor locations.
Provides high-frequency 3D trajectories, scene point clouds, eye gaze, and speech data.
Demonstrates applications in neural scene reconstruction and segmentation.
Abstract
We present Aria Everyday Activities (AEA) Dataset, an egocentric multimodal open dataset recorded using Project Aria glasses. AEA contains 143 daily activity sequences recorded by multiple wearers in five geographically diverse indoor locations. Each of the recording contains multimodal sensor data recorded through the Project Aria glasses. In addition, AEA provides machine perception data including high frequency globally aligned 3D trajectories, scene point cloud, per-frame 3D eye gaze vector and time aligned speech transcription. In this paper, we demonstrate a few exemplar research applications enabled by this dataset, including neural scene reconstruction and prompted segmentation. AEA is an open source dataset that can be downloaded from https://www.projectaria.com/datasets/aea/. We are also providing open-source implementations and examples of how to use the dataset in Project…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAnomaly Detection Techniques and Applications · Data Stream Mining Techniques · Traffic Prediction and Management Techniques
MethodsAdaptive Richard's Curve Weighted Activation
