3D Face Reconstruction With Geometry Details From a Single Color Image Under Occluded Scenes
Dapeng Zhao, Yue Qi

TL;DR
This paper presents a unified 3D face reconstruction method that adds detailed geometry from a single color image, effectively handling occlusions like hair, glasses, and palms, and outperforming previous approaches in complex scenarios.
Contribution
The paper introduces a novel framework that incorporates bump mapping and occlusion handling to improve 3D face reconstruction under occluded conditions.
Findings
High-quality geometry details achieved in occluded scenes
Effective handling of multiple occlusion types simultaneously
Outperforms existing methods in diverse occlusion scenarios
Abstract
3D face reconstruction technology aims to generate a face stereo model naturally and realistically. Previous deep face reconstruction approaches are typically designed to generate convincing textures and cannot generalize well to multiple occluded scenarios simultaneously. By introducing bump mapping, we successfully added mid-level details to coarse 3D faces. More innovatively, our method takes into account occlusion scenarios. Thus on top of common 3D face reconstruction approaches, we in this paper propose a unified framework to handle multiple types of obstruction simultaneously (e.g., hair, palms and glasses et al.).Extensive experiments and comparisons demonstrate that our method can generate high-quality reconstruction results with geometry details from captured facial images under occluded scenes.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsFace recognition and analysis
