Exact Inference in Networks with Discrete Children of Continuous Parents

TL;DR

This paper introduces the first exact inference algorithm for augmented hybrid Bayesian Networks that include discrete children of continuous parents, improving accuracy over previous approximate methods.

Contribution

It generalizes Lauritzen's algorithm to handle networks with discrete children of continuous variables, enabling exact inference in these complex models.

Findings

Achieves higher accuracy than previous approximate algorithms.

Provides an exact inference method for augmented CLG networks.

Algorithm is simple to implement and computationally comparable to Lauritzen's algorithm.

Abstract

Many real life domains contain a mixture of discrete and continuous variables and can be modeled as hybrid Bayesian Networks. Animportant subclass of hybrid BNs are conditional linear Gaussian (CLG) networks, where the conditional distribution of the continuous variables given an assignment to the discrete variables is a multivariate Gaussian. Lauritzen's extension to the clique tree algorithm can be used for exact inference in CLG networks. However, many domains also include discrete variables that depend on continuous ones, and CLG networks do not allow such dependencies to berepresented. No exact inference algorithm has been proposed for these enhanced CLG networks. In this paper, we generalize Lauritzen's algorithm, providing the first "exact" inference algorithm for augmented CLG networks - networks where continuous nodes are conditional linear Gaussians but that also allow discrete children ofcontinuous parents. Our algorithm is exact in the sense that it computes the exact distributions over the discrete nodes, and the exact first and second moments of the continuous ones, up to the accuracy obtained by numerical integration used within thealgorithm. When the discrete children are modeled with softmax CPDs (as is the case in many real world domains) the approximation of the continuous distributions using the first two moments is particularly accurate. Our algorithm is simple to implement and often comparable in its complexity to Lauritzen's algorithm. We show empirically that it achieves substantially higher accuracy than previous approximate algorithms.