Label-Aware Hyperbolic Embeddings for Fine-grained Emotion Classification

TL;DR

This paper introduces HypEmo, a hyperbolic embedding framework for fine-grained emotion classification that captures hierarchical label structures, leading to improved accuracy and efficiency over existing models.

Contribution

The paper presents a novel hyperbolic embedding approach for FEC, effectively modeling label hierarchies and enhancing classification performance and efficiency.

Findings

Achieved 4.8% relative improvement over state-of-the-art

Reduced training time by 76.9%

Lowered parameter count by 43.2%

Abstract

Fine-grained emotion classification (FEC) is a challenging task. Specifically, FEC needs to handle subtle nuance between labels, which can be complex and confusing. Most existing models only address text classification problem in the euclidean space, which we believe may not be the optimal solution as labels of close semantic (e.g., afraid and terrified) may not be differentiated in such space, which harms the performance. In this paper, we propose HypEmo, a novel framework that can integrate hyperbolic embeddings to improve the FEC task. First, we learn label embeddings in the hyperbolic space to better capture their hierarchical structure, and then our model projects contextualized representations to the hyperbolic space to compute the distance between samples and labels. Experimental results show that incorporating such distance to weight cross entropy loss substantially improves the performance with significantly higher efficiency. We evaluate our proposed model on two benchmark datasets and found 4.8% relative improvement compared to the previous state of the art with 43.2% fewer parameters and 76.9% less training time. Code is available at https: //github.com/dinobby/HypEmo.