Textual Aesthetics in Large Language Models

TL;DR

This paper introduces a new approach for improving textual aesthetics in large language models through a dedicated dataset, a fine-tuning method called TAPO, and evaluation techniques, leading to better aesthetic and overall performance.

Contribution

It presents a novel pipeline, TexAes dataset, and TAPO fine-tuning method to enhance textual aesthetics in LLMs without sacrificing content correctness.

Findings

Textual aesthetics can be quantitatively improved in LLMs.

TAPO fine-tuning enhances aesthetic scores and general performance.

Evaluation methods effectively measure textual aesthetics.

Abstract

Image aesthetics is a crucial metric in the field of image generation. However, textual aesthetics has not been sufficiently explored. With the widespread application of large language models (LLMs), previous work has primarily focused on the correctness of content and the helpfulness of responses. Nonetheless, providing responses with textual aesthetics is also an important factor for LLMs, which can offer a cleaner layout and ensure greater consistency and coherence in content. In this work, we introduce a pipeline for aesthetics polishing and help construct a textual aesthetics dataset named TexAes. We propose a textual aesthetics-powered fine-tuning method based on direct preference optimization, termed TAPO, which leverages textual aesthetics without compromising content correctness. Additionally, we develop two evaluation methods for textual aesthetics based on text and image analysis, respectively. Our experiments demonstrate that using textual aesthetics data and employing the TAPO fine-tuning method not only improves aesthetic scores but also enhances performance on general evaluation datasets such as AlpacalEval and Anera-hard.