SLAMCast: Large-Scale, Real-Time 3D Reconstruction and Streaming for Immersive Multi-Client Live Telepresence
Patrick Stotko, Stefan Krumpen, Matthias B. Hullin, Michael Weinmann,, Reinhard Klein

TL;DR
SLAMCast is a practical, scalable system enabling real-time, multi-user 3D scene reconstruction and streaming for immersive telepresence, using innovative GPU data structures and efficient data transmission to operate on consumer hardware.
Contribution
The paper introduces a novel thread-safe GPU hash map and a bandwidth-efficient transmission scheme, enabling real-time multi-client 3D reconstruction and exploration on consumer devices.
Findings
Achieves state-of-the-art accuracy in 3D scene representation.
Supports any number of clients with lag-free experience.
Operates effectively on mobile and consumer-grade hardware.
Abstract
Real-time 3D scene reconstruction from RGB-D sensor data, as well as the exploration of such data in VR/AR settings, has seen tremendous progress in recent years. The combination of both these components into telepresence systems, however, comes with significant technical challenges. All approaches proposed so far are extremely demanding on input and output devices, compute resources and transmission bandwidth, and they do not reach the level of immediacy required for applications such as remote collaboration. Here, we introduce what we believe is the first practical client-server system for real-time capture and many-user exploration of static 3D scenes. Our system is based on the observation that interactive frame rates are sufficient for capturing and reconstruction, and real-time performance is only required on the client site to achieve lag-free view updates when rendering the 3D…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
