Efficient Topic Extraction via Graph-Based Labeling: A Lightweight Alternative to Deep Models

TL;DR

This paper introduces a lightweight, graph-based method for topic labeling that enhances interpretability and efficiency compared to traditional and deep learning models, demonstrated through comparative experiments.

Contribution

The authors propose a novel graph-based approach for topic labeling that is computationally efficient and improves interpretability over existing statistical and deep models.

Findings

Outperforms traditional benchmarks in BERTScore and cosine similarity

Achieves results comparable to ChatGPT-3.5

Remains computationally efficient

Abstract

Extracting topics from text has become an essential task, especially with the rapid growth of unstructured textual data. Most existing works rely on highly computational methods to address this challenge. In this paper, we argue that probabilistic and statistical approaches, such as topic modeling (TM), can offer effective alternatives that require fewer computational resources. TM is a statistical method that automatically discovers topics in large collections of unlabeled text; however, it produces topics as distributions of representative words, which often lack clear interpretability. Our objective is to perform topic labeling by assigning meaningful labels to these sets of words. To achieve this without relying on computationally expensive models, we propose a graph-based approach that not only enriches topic words with semantically related terms but also explores the relationships among them. By analyzing these connections within the graph, we derive suitable labels that accurately capture each topic's meaning. We present a comparative study between our proposed method and several benchmarks, including ChatGPT-3.5, across two different datasets. Our method achieved consistently better results than traditional benchmarks in terms of BERTScore and cosine similarity and produced results comparable to ChatGPT-3.5, while remaining computationally efficient. Finally, we discuss future directions for topic labeling and highlight potential research avenues for enhancing interpretability and automation.