Bayesian Regression and Classification Using Gaussian Process Priors Indexed by Probability Density Functions

TL;DR

This paper proposes a novel Gaussian process framework indexed by probability density functions, enhancing Bayesian regression and classification on nonlinear data spaces with improved efficiency and effectiveness.

Contribution

It introduces Gaussian processes indexed by probability density functions, utilizing information geometry to improve Bayesian inference on complex data manifolds.

Findings

Effective classification and inference on nonlinear subspaces.

Enhanced computational efficiency over existing methods.

Superior performance demonstrated on synthetic and real datasets.

Abstract

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the computational aspects of the Bayesian learning model. We particularly show how a Bayesian inference with a Gaussian process prior (covariance parameters estimation and prediction) can be put into action on the space of probability density functions. Our framework has the capacity of classifiying and infering on data observations that lie on nonlinear subspaces. Extensive experiments on multiple synthetic, semi-synthetic and real data demonstrate the effectiveness and the efficiency of the proposed methods in comparison with current state-of-the-art methods.