Analysis and approximation of some Shape-from-Shading models for non-Lambertian surfaces

TL;DR

This paper develops a unified mathematical framework and approximation scheme for non-Lambertian Shape-from-Shading models, specifically Oren-Nayar and Phong, to better handle realistic surface reflectance in 3D reconstruction.

Contribution

It introduces a unified PDE formulation for non-Lambertian SfS models and proposes a semi-Lagrangian numerical scheme with convergence proof.

Findings

Effective numerical scheme for non-Lambertian SfS models

Successful application to synthetic and real images

Improved results over previous Lambertian-based methods

Abstract

The reconstruction of a 3D object or a scene is a classical inverse problem in Computer Vision. In the case of a single image this is called the Shape-from-Shading (SfS) problem and it is known to be ill-posed even in a simplified version like the vertical light source case. A huge number of works deals with the orthographic SfS problem based on the Lambertian reflectance model, the most common and simplest model which leads to an eikonal type equation when the light source is on the vertical axis. In this paper we want to study non-Lambertian models since they are more realistic and suitable whenever one has to deal with different kind of surfaces, rough or specular. We will present a unified mathematical formulation of some popular orthographic non-Lambertian models, considering vertical and oblique light directions as well as different viewer positions. These models lead to more complex stationary nonlinear partial differential equations of Hamilton-Jacobi type which can be regarded as the generalization of the classical eikonal equation corresponding to the Lambertian case. However, all the equations corresponding to the models considered here (Oren-Nayar and Phong) have a similar structure so we can look for weak solutions to this class in the viscosity solution framework. Via this unified approach, we are able to develop a semi-Lagrangian approximation scheme for the Oren-Nayar and the Phong model and to prove a general convergence result. Numerical simulations on synthetic and real images will illustrate the effectiveness of this approach and the main features of the scheme, also comparing the results with previous results in the literature.