Dynamic Environment Mapping for Augmented Reality Applications on Mobile Devices
Rafael Monroy, Matis Hudon, Aljosa Smolic

TL;DR
This paper introduces a real-time environment mapping pipeline for mobile AR that efficiently captures and updates scene data using a depth sensor, enabling high-quality virtual object rendering with minimal user interaction.
Contribution
A novel mobile AR environment mapping method that combines scene scanning, adaptive updates, and efficient irradiance rendering using spherical harmonics.
Findings
Achieves 31Hz frame rate on mobile devices.
Supports dynamic scene updates.
Provides high-quality virtual object integration.
Abstract
Augmented Reality is a topic of foremost interest nowadays. Its main goal is to seamlessly blend virtual content in real-world scenes. Due to the lack of computational power in mobile devices, rendering a virtual object with high-quality, coherent appearance and in real-time, remains an area of active research. In this work, we present a novel pipeline that allows for coupled environment acquisition and virtual object rendering on a mobile device equipped with a depth sensor. While keeping human interaction to a minimum, our system can scan a real scene and project it onto a two-dimensional environment map containing RGB+Depth data. Furthermore, we define a set of criteria that allows for an adaptive update of the environment map to account for dynamic changes in the scene. Then, under the assumption of diffuse surfaces and distant illumination, our method exploits an analytic…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Vision and Imaging · Computer Graphics and Visualization Techniques · Robotics and Sensor-Based Localization
