A Framework for Authorial Clustering of Shorter Texts in Latent Semantic Spaces

TL;DR

This paper introduces a framework for authorial clustering of short texts using a latent semantic space derived from non-parametric topic modeling, achieving significant dimensionality reduction and improved clustering performance.

Contribution

The authors propose a novel high-level framework utilizing a compact latent feature space for authorial clustering of short texts, incorporating both unsupervised and semi-supervised scenarios with constraint-based information.

Findings

Latent feature space reduces dimensionality by a factor of 1500.

Semi-supervised constraints improve clustering performance.

The framework performs well across multiple languages and genres.

Abstract

Authorial clustering involves the grouping of documents written by the same author or team of authors without any prior positive examples of an author's writing style or thematic preferences. For authorial clustering on shorter texts (paragraph-length texts that are typically shorter than conventional documents), the document representation is particularly important: very high-dimensional feature spaces lead to data sparsity and suffer from serious consequences like the curse of dimensionality, while feature selection may lead to information loss. We propose a high-level framework which utilizes a compact data representation in a latent feature space derived with non-parametric topic modeling. Authorial clusters are identified thereafter in two scenarios: (a) fully unsupervised and (b) semi-supervised where a small number of shorter texts are known to belong to the same author (must-link constraints) or not (cannot-link constraints). We report on experiments with 120 collections in three languages and two genres and show that the topic-based latent feature space provides a promising level of performance while reducing the dimensionality by a factor of 1500 compared to state-of-the-arts. We also demonstrate that, while prior knowledge on the precise number of authors (i.e. authorial clusters) does not contribute much to additional quality, little knowledge on constraints in authorial clusters memberships leads to clear performance improvements in front of this difficult task. Thorough experimentation with standard metrics indicates that there still remains an ample room for improvement for authorial clustering, especially with shorter texts