Generative Face Parsing Map Guided 3D Face Reconstruction Under Occluded Scenes

TL;DR

This paper introduces a novel 3D face reconstruction approach that effectively handles occlusions by generating face parsing maps guided by landmarks, improving the authenticity and robustness of reconstructed faces.

Contribution

The paper proposes a complete face parsing map generation method guided by landmarks for occluded face reconstruction, enhancing the accuracy and robustness over existing methods.

Findings

Demonstrates superior reconstruction quality under occlusion.

Shows improved robustness compared to existing methods.

Provides quantitative evidence of enhanced face texture authenticity.

Abstract

Over the past few years, single-view 3D face reconstruction methods can produce beautiful 3D models. Nevertheless,the input of these works is unobstructed faces.We describe a system designed to reconstruct convincing face texture in the case of occlusion.Motivated by parsing facial features,we propose a complete face parsing map generation method guided by landmarks.We estimate the 2D face structure of the reasonable position of the occlusion area,which is used for the construction of 3D texture.An excellent anti-occlusion face reconstruction method should ensure the authenticity of the output,including the topological structure between the eyes,nose, and mouth. We extensively tested our method and its components, qualitatively demonstrating the rationality of our estimated facial structure. We conduct extensive experiments on general 3D face reconstruction tasks as concrete examples to demonstrate the method's superior regulation ability over existing methods often break down.We further provide numerous quantitative examples showing that our method advances both the quality and the robustness of 3D face reconstruction under occlusion scenes.