# Best-Choice Edge Grafting for Efficient Structure Learning of Markov Random Fields

## TL;DR

This paper introduces best-choice edge grafting, an incremental method for structure learning of Markov random fields that activates edges in groups, significantly improving speed and efficiency while maintaining learning quality.

## Contribution

It proposes a novel structured incremental approach that activates edges as groups, addressing computational bottlenecks in existing methods.

## Key findings

- Significant speedup in structure learning process.
- Effective trade-off between speed and learning quality.
- Utilization of heuristics improves search efficiency.

## Abstract

Incremental methods for structure learning of pairwise Markov random fields (MRFs), such as grafting, improve scalability by avoiding inference over the entire feature space in each optimization step. Instead, inference is performed over an incrementally grown active set of features. In this paper, we address key computational bottlenecks that current incremental techniques still suffer by introducing best-choice edge grafting, an incremental, structured method that activates edges as groups of features in a streaming setting. The method uses a reservoir of edges that satisfy an activation condition, approximating the search for the optimal edge to activate. It also reorganizes the search space using search-history and structure heuristics. Experiments show a significant speedup for structure learning and a controllable trade-off between the speed and quality of learning.