Semi-supervised structured output prediction by local linear regression and sub-gradient descent

TL;DR

This paper introduces a semi-supervised structured output prediction method that learns local predictors for neighborhoods of data points using local linear regression and sub-gradient descent, improving prediction accuracy.

Contribution

It presents a novel approach that jointly learns missing structured outputs and local predictors, addressing limitations of global models in semi-supervised structured prediction.

Findings

Outperforms existing methods on benchmark datasets.

Effectively captures local data distribution differences.

Demonstrates the advantages of local predictors over global ones.

Abstract

We propose a novel semi-supervised structured output prediction method based on local linear regression in this paper. The existing semi-supervise structured output prediction methods learn a global predictor for all the data points in a data set, which ignores the differences of local distributions of the data set, and the effects to the structured output prediction. To solve this problem, we propose to learn the missing structured outputs and local predictors for neighborhoods of different data points jointly. Using the local linear regression strategy, in the neighborhood of each data point, we propose to learn a local linear predictor by minimizing both the complexity of the predictor and the upper bound of the structured prediction loss. The minimization problem is solved by sub-gradient descent algorithms. We conduct experiments over two benchmark data sets, and the results show the advantages of the proposed method.