The Bayesian Structural EM Algorithm
Nir Friedman

TL;DR
This paper introduces an extension of the Structural EM algorithm that directly incorporates Bayesian model selection, enabling efficient learning of Bayesian network structures from incomplete data with proven convergence.
Contribution
The paper extends Structural EM to handle Bayesian model selection directly, with convergence proof and applicability to various probabilistic models.
Findings
Proves convergence of the extended Structural EM algorithm.
Demonstrates applicability to Bayesian networks and variants.
Enables learning from incomplete data with Bayesian criteria.
Abstract
In recent years there has been a flurry of works on learning Bayesian networks from data. One of the hard problems in this area is how to effectively learn the structure of a belief network from incomplete data- that is, in the presence of missing values or hidden variables. In a recent paper, I introduced an algorithm called Structural EM that combines the standard Expectation Maximization (EM) algorithm, which optimizes parameters, with structure search for model selection. That algorithm learns networks based on penalized likelihood scores, which include the BIC/MDL score and various approximations to the Bayesian score. In this paper, I extend Structural EM to deal directly with Bayesian model selection. I prove the convergence of the resulting algorithm and show how to apply it for learning a large class of probabilistic models, including Bayesian networks and some variants thereof.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBayesian Modeling and Causal Inference · Neural Networks and Applications · AI-based Problem Solving and Planning
