3D Face Reconstruction With Geometry Details From a Single Color Image Under Occluded Scenes

TL;DR

This paper presents a unified 3D face reconstruction method that adds detailed geometry from a single color image, effectively handling occlusions like hair, glasses, and palms, and outperforming previous approaches in complex scenarios.

Contribution

The paper introduces a novel framework that incorporates bump mapping and occlusion handling to improve 3D face reconstruction under occluded conditions.

Findings

High-quality geometry details achieved in occluded scenes

Effective handling of multiple occlusion types simultaneously

Outperforms existing methods in diverse occlusion scenarios

Abstract

3D face reconstruction technology aims to generate a face stereo model naturally and realistically. Previous deep face reconstruction approaches are typically designed to generate convincing textures and cannot generalize well to multiple occluded scenarios simultaneously. By introducing bump mapping, we successfully added mid-level details to coarse 3D faces. More innovatively, our method takes into account occlusion scenarios. Thus on top of common 3D face reconstruction approaches, we in this paper propose a unified framework to handle multiple types of obstruction simultaneously (e.g., hair, palms and glasses et al.).Extensive experiments and comparisons demonstrate that our method can generate high-quality reconstruction results with geometry details from captured facial images under occluded scenes.