Hologram: Realtime Holographic Overlays via LiDAR Augmented Reconstruction

TL;DR

This paper introduces a real-time holographic overlay system using LiDAR augmented 3D reconstruction on portable devices, enabling immersive AR experiences without extensive calibration or high computational costs.

Contribution

It presents three high-fidelity, portable LiDAR-based reconstruction tools that operate on devices like the iPhone 14 Pro, facilitating dynamic holographic overlays.

Findings

Achieved real-time holographic overlays on portable devices.

Enabled metric accurate facial reconstructions.

Supported interactive AR, telepresence, and entertainment applications.

Abstract

Guided by the hologram technology of the infamous Star Wars franchise, I present an application that creates real-time holographic overlays using LiDAR augmented 3D reconstruction. Prior attempts involve SLAM or NeRFs which either require highly calibrated scenes, incur steep computation costs, or fail to render dynamic scenes. I propose 3 high-fidelity reconstruction tools that can run on a portable device, such as a iPhone 14 Pro, which can allow for metric accurate facial reconstructions. My systems enable interactive and immersive holographic experiences that can be used for a wide range of applications, including augmented reality, telepresence, and entertainment.