Differentiable Mobile Display Photometric Stereo
Gawoon Ban, Hyeongjun Kim, Seokjun Choi, Seungwoo Yoon, Seung-Hwan, Baek

TL;DR
This paper introduces a practical mobile-based differentiable photometric stereo method that uses a phone's display and camera to accurately reconstruct 3D surface normals and albedos of objects in real-world settings.
Contribution
It presents a mobile app and method enabling real-time display pattern learning and HDR image capture for physics-based photometric stereo on mobile devices.
Findings
Successfully reconstructed surface normals and albedos of 3D-printed objects.
Captured and analyzed fallen leaves for surface normal estimation.
Demonstrated practicality of mobile photometric stereo in real-world scenarios.
Abstract
Display photometric stereo uses a display as a programmable light source to illuminate a scene with diverse illumination conditions. Recently, differentiable display photometric stereo (DDPS) demonstrated improved normal reconstruction accuracy by using learned display patterns. However, DDPS faced limitations in practicality, requiring a fixed desktop imaging setup using a polarization camera and a desktop-scale monitor. In this paper, we propose a more practical physics-based photometric stereo, differentiable mobile display photometric stereo (DMDPS), that leverages a mobile phone consisting of a display and a camera. We overcome the limitations of using a mobile device by developing a mobile app and method that simultaneously displays patterns and captures high-quality HDR images. Using this technique, we capture real-world 3D-printed objects and learn display patterns via a…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsInteractive and Immersive Displays · Advanced Optical Imaging Technologies · Computer Graphics and Visualization Techniques
Methods+ ( 1 ) ⟷ 888 ⟷ ( 829 ) ⟷ 0881||How do I resolve a dispute on Expedia?
