Learning Large-scale Neural Fields via Context Pruned Meta-Learning

TL;DR

This paper presents a memory-efficient meta-learning approach for large-scale neural fields that selectively focuses on the most impactful data points, enabling faster and higher-quality signal reconstruction across diverse datasets.

Contribution

The authors introduce a novel context point selection and bootstrap correction method that enhances meta-learning for neural fields, reducing memory usage and improving reconstruction quality.

Findings

Achieves state-of-the-art results on nine diverse datasets.

Significantly reduces memory requirements during training.

Enables rapid high-quality neural field modeling.

Abstract

We introduce an efficient optimization-based meta-learning technique for large-scale neural field training by realizing significant memory savings through automated online context point selection. This is achieved by focusing each learning step on the subset of data with the highest expected immediate improvement in model quality, resulting in the almost instantaneous modeling of global structure and subsequent refinement of high-frequency details. We further improve the quality of our meta-learned initialization by introducing a bootstrap correction resulting in the minimization of any error introduced by reduced context sets while simultaneously mitigating the well-known myopia of optimization-based meta-learning. Finally, we show how gradient re-scaling at meta-test time allows the learning of extremely high-quality neural fields in significantly shortened optimization procedures. Our framework is model-agnostic, intuitive, straightforward to implement, and shows significant reconstruction improvements for a wide range of signals. We provide an extensive empirical evaluation on nine datasets across multiple multiple modalities, demonstrating state-of-the-art results while providing additional insight through careful analysis of the algorithmic components constituting our method. Code is available at https://github.com/jihoontack/GradNCP