Learning with Structure: Computing Consistent Subsets on Structurally-Regular Graphs

TL;DR

This paper introduces fixed-parameter tractable algorithms for the Minimum Consistent Subset problem on graphs, leveraging graph parameters like vertex cover number and neighborhood diversity, thus enabling efficient solutions even with many labels.

Contribution

The work develops new FPT algorithms for MCS on graphs parameterized by vertex cover and neighborhood diversity, extending previous NP-hard results.

Findings

Algorithms run in time $vc^{O(vc)} imes poly(n,c)$ and $nd^{O(nd)} imes poly(n,c)$.

MCS is fixed-parameter tractable with respect to vertex cover and neighborhood diversity.

Algorithms are efficient regardless of the number of colors.

Abstract

The Minimum Consistent Subset (MCS) problem arises naturally in the context of supervised clustering and instance selection. In supervised clustering, one aims to infer a meaningful partitioning of data using a small labeled subset. However, the sheer volume of training data in modern applications poses a significant computational challenge. The MCS problem formalizes this goal: given a labeled dataset $\mathcal{X}$ in a metric space, the task is to compute a smallest subset $S \subseteq \mathcal{X}$ such that every point in $\mathcal{X}$ shares its label with at least one of its nearest neighbors in $S$. Recently, the MCS problem has been extended to graph metrics, where distances are defined by shortest paths. Prior work has shown that MCS remains NP-hard even on simple graph classes like trees, though an algorithm with runtime $\mathcal{O}(2^{6c} \cdot n^6)$ is known for trees, where $c$ is the number of colors and $n$ the number of vertices. This raises the challenge of identifying graph classes that admit algorithms efficient in both $n$ and $c$. In this work, we study the Minimum Consistent Subset problem on graphs, focusing on two well-established measures: the vertex cover number ($vc$) and the neighborhood diversity ($nd$). We develop an algorithm with running time $vc^{\mathcal{O}(vc)}\cdot\text{Poly}(n,c)$, and another algorithm with runtime $nd^{\mathcal{O}(nd)}\cdot\text{Poly}(n,c)$. In the language of parameterized complexity, this implies that MCS is fixed-parameter tractable (FPT) parameterized by the vertex cover number and the neighborhood diversity. Notably, our algorithms remain efficient for arbitrarily many colors, as their complexity is polynomially dependent on the number of colors.