Latent label distribution grid representation for modeling uncertainty

TL;DR

This paper introduces a Latent Label Distribution Grid (LLDG) model that captures uncertainty in label spaces for improved classification, using Gaussian distributions and low-rank Tucker reconstruction to reduce noise.

Contribution

The paper proposes a novel LLDG framework that models label uncertainty with Gaussian distributions and employs Tucker-based low-rank schemes for noise reduction, enhancing LDL performance.

Findings

Competitive results on multiple benchmarks.

Effective modeling of label uncertainty.

Improved classification accuracy.

Abstract

Although \textbf{L}abel \textbf{D}istribution \textbf{L}earning (LDL) has promising representation capabilities for characterizing the polysemy of an instance, the complexity and high cost of the label distribution annotation lead to inexact in the construction of the label space. The existence of a large number of inexact labels generates a label space with uncertainty, which misleads the LDL algorithm to yield incorrect decisions. To alleviate this problem, we model the uncertainty of label distributions by constructing a \textbf{L}atent \textbf{L}abel \textbf{D}istribution \textbf{G}rid (LLDG) to form a low-noise representation space. Specifically, we first construct a label correlation matrix based on the differences between labels, and then expand each value of the matrix into a vector that obeys a Gaussian distribution, thus building a LLDG to model the uncertainty of the label space. Finally, the LLDG is reconstructed by the LLDG-Mixer to generate an accurate label distribution. Note that we enforce a customized low-rank scheme on this grid, which assumes that the label relations may be noisy and it needs to perform noise-reduction with the help of a Tucker reconstruction technique. Furthermore, we attempt to evaluate the effectiveness of the LLDG by considering its generation as an upstream task to achieve the classification of the objects. Extensive experimental results show that our approach performs competitively on several benchmarks.