Meta-Learning Probabilistic Inference For Prediction

TL;DR

This paper presents ML-PIP, a probabilistic meta-learning framework, and VERSA, an inference network that achieves state-of-the-art results in few-shot learning and shape reconstruction tasks.

Contribution

The paper introduces ML-PIP, a broad probabilistic meta-learning framework, and VERSA, a versatile inference network that improves few-shot learning efficiency and performance.

Findings

VERSA achieves state-of-the-art results on benchmark datasets.

VERSA handles arbitrary numbers of shots and classes.

The approach demonstrates strong performance on shape reconstruction tasks.

Abstract

This paper introduces a new framework for data efficient and versatile learning. Specifically: 1) We develop ML-PIP, a general framework for Meta-Learning approximate Probabilistic Inference for Prediction. ML-PIP extends existing probabilistic interpretations of meta-learning to cover a broad class of methods. 2) We introduce VERSA, an instance of the framework employing a flexible and versatile amortization network that takes few-shot learning datasets as inputs, with arbitrary numbers of shots, and outputs a distribution over task-specific parameters in a single forward pass. VERSA substitutes optimization at test time with forward passes through inference networks, amortizing the cost of inference and relieving the need for second derivatives during training. 3) We evaluate VERSA on benchmark datasets where the method sets new state-of-the-art results, handles arbitrary numbers of shots, and for classification, arbitrary numbers of classes at train and test time. The power of the approach is then demonstrated through a challenging few-shot ShapeNet view reconstruction task.