A Lightweight UDF Learning Framework for 3D Reconstruction Based on Local Shape Functions

TL;DR

This paper introduces LoSF-UDF, a lightweight neural framework for 3D surface reconstruction from point clouds that learns unsigned distance functions using local shape functions, requiring minimal training data and exhibiting robustness to noise.

Contribution

The paper presents a novel, highly lightweight UDF learning framework that does not require shape-specific training and effectively handles noisy point clouds using local shape functions and attention mechanisms.

Findings

Achieves accurate surface reconstruction with only 653 KB of parameters.

Demonstrates robustness to noise and outliers in point cloud data.

Provides rapid initialization for iterative reconstruction methods.

Abstract

Unsigned distance fields (UDFs) provide a versatile framework for representing a diverse array of 3D shapes, encompassing both watertight and non-watertight geometries. Traditional UDF learning methods typically require extensive training on large 3D shape datasets, which is costly and necessitates re-training for new datasets. This paper presents a novel neural framework, LoSF-UDF, for reconstructing surfaces from 3D point clouds by leveraging local shape functions to learn UDFs. We observe that 3D shapes manifest simple patterns in localized regions, prompting us to develop a training dataset of point cloud patches characterized by mathematical functions that represent a continuum from smooth surfaces to sharp edges and corners. Our approach learns features within a specific radius around each query point and utilizes an attention mechanism to focus on the crucial features for UDF estimation. Despite being highly lightweight, with only 653 KB of trainable parameters and a modest-sized training dataset with 0.5 GB storage, our method enables efficient and robust surface reconstruction from point clouds without requiring for shape-specific training. Furthermore, our method exhibits enhanced resilience to noise and outliers in point clouds compared to existing methods. We conduct comprehensive experiments and comparisons across various datasets, including synthetic and real-scanned point clouds, to validate our method's efficacy. Notably, our lightweight framework offers rapid and reliable initialization for other unsupervised iterative approaches, improving both the efficiency and accuracy of their reconstructions. Our project and code are available at https://jbhu67.github.io/LoSF-UDF.github.io.