Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan,, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath, Sridhar

TL;DR
This paper provides a comprehensive review of neural fields, a class of coordinate-based neural networks, highlighting their techniques, applications in visual computing and beyond, and offering a living, community-updated resource.
Contribution
It offers the first extensive review and mathematical grounding of neural fields, covering techniques, applications, and future directions in visual computing and related areas.
Findings
Neural fields improve quality and flexibility in visual computing tasks.
They enable applications like 3D reconstruction, shape synthesis, and pose estimation.
The review includes a living online resource for ongoing updates.
Abstract
Recent advances in machine learning have created increasing interest in solving visual computing problems using a class of coordinate-based neural networks that parametrize physical properties of scenes or objects across space and time. These methods, which we call neural fields, have seen successful application in the synthesis of 3D shapes and image, animation of human bodies, 3D reconstruction, and pose estimation. However, due to rapid progress in a short time, many papers exist but a comprehensive review and formulation of the problem has not yet emerged. In this report, we address this limitation by providing context, mathematical grounding, and an extensive review of literature on neural fields. This report covers research along two dimensions. In Part I, we focus on techniques in neural fields by identifying common components of neural field methods, including different…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Vision and Imaging · Computer Graphics and Visualization Techniques · 3D Shape Modeling and Analysis
