The importance of silhouette optimization in 3D shape reconstruction system from multiple object scenes

TL;DR

This paper improves 3D shape reconstruction from multiple views by optimizing silhouettes to handle occlusions, shadows, and reflections, resulting in more accurate and robust models.

Contribution

It introduces a multi-stage silhouette optimization process that enhances shape-from-silhouette reconstruction accuracy and robustness in complex scenes.

Findings

Enhanced reconstruction accuracy demonstrated through experiments

Improved robustness to silhouette errors and occlusions

Reduced computational cost compared to existing methods

Abstract

This paper presents a multi stage 3D shape reconstruction system of multiple object scenes by considering the silhouette inconsistencies in shape-from silhouette SFS method. These inconsistencies are common in multiple view images due to object occlusions in different views, segmentation and shadows or reflection due to objects or light directions. These factors raise huge challenges when attempting to construct the 3D shape by using existing approaches which reconstruct only that part of the volume which projects consistently in all the silhouettes, leaving the rest unreconstructed. As a result, final shape are not robust due to multi view objects occlusion and shadows. In this regard, we consider the primary factors affecting reconstruction by analyzing the multiple images and perform pre-processing steps to optimize the silhouettes. Finally, the 3D shape is reconstructed by using the volumetric approach SFS. Theory and experimental results show that, the performance of the modified algorithm was efficiently improved, which can improve the accuracy of the reconstructed shape and being robust to errors in the silhouettes, volume and computational inexpensive.