3D Neural Sculpting (3DNS): Editing Neural Signed Distance Functions

TL;DR

This paper introduces a novel interactive editing method for neural signed distance functions, enabling free-form 3D shape modifications inspired by traditional sculpting tools, with high accuracy and preservation of unaffected geometry.

Contribution

It presents the first efficient, interactive sculpting framework for neural implicit surfaces, combining intuitive brush-based editing with surface sampling and network weight adaptation.

Findings

High accuracy in achieving desired shape edits

Preservation of geometry outside interaction areas

Effective editing across various 3D objects

Abstract

In recent years, implicit surface representations through neural networks that encode the signed distance have gained popularity and have achieved state-of-the-art results in various tasks (e.g. shape representation, shape reconstruction, and learning shape priors). However, in contrast to conventional shape representations such as polygon meshes, the implicit representations cannot be easily edited and existing works that attempt to address this problem are extremely limited. In this work, we propose the first method for efficient interactive editing of signed distance functions expressed through neural networks, allowing free-form editing. Inspired by 3D sculpting software for meshes, we use a brush-based framework that is intuitive and can in the future be used by sculptors and digital artists. In order to localize the desired surface deformations, we regulate the network by using a copy of it to sample the previously expressed surface. We introduce a novel framework for simulating sculpting-style surface edits, in conjunction with interactive surface sampling and efficient adaptation of network weights. We qualitatively and quantitatively evaluate our method in various different 3D objects and under many different edits. The reported results clearly show that our method yields high accuracy, in terms of achieving the desired edits, while at the same time preserving the geometry outside the interaction areas.