TetraTSDF: 3D human reconstruction from a single image with a tetrahedral outer shell
Hayato Onizuka, Zehra Hayirci, Diego Thomas, Akihiro Sugimoto, Hideaki, Uchiyama, Rin-ichiro Taniguchi

TL;DR
This paper introduces TetraTSDF, a compact tetrahedral volumetric model, and PCN, a network for detailed 3D human shape reconstruction from single images, overcoming memory and detail limitations of previous methods.
Contribution
The paper presents a novel tetrahedral TSDF model and a part connection network for accurate, detailed 3D human reconstruction from a single RGB image.
Findings
Reconstructs detailed human shapes with loose clothing from single images.
Achieves compact and dense 3D representations suitable for CNN regression.
Outperforms existing methods in detail preservation and efficiency.
Abstract
Recovering the 3D shape of a person from its 2D appearance is ill-posed due to ambiguities. Nevertheless, with the help of convolutional neural networks (CNN) and prior knowledge on the 3D human body, it is possible to overcome such ambiguities to recover detailed 3D shapes of human bodies from single images. Current solutions, however, fail to reconstruct all the details of a person wearing loose clothes. This is because of either (a) huge memory requirement that cannot be maintained even on modern GPUs or (b) the compact 3D representation that cannot encode all the details. In this paper, we propose the tetrahedral outer shell volumetric truncated signed distance function (TetraTSDF) model for the human body, and its corresponding part connection network (PCN) for 3D human body shape regression. Our proposed model is compact, dense, accurate, and yet well suited for CNN-based…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
TetraTSDF: 3D Human Reconstruction From a Single Image With a Tetrahedral Outer Shell· youtube
Taxonomy
Topics3D Shape Modeling and Analysis · Human Pose and Action Recognition · Advanced Vision and Imaging
