C$^3$TG: Conflict-aware, Composite, and Collaborative Controlled Text Generation

TL;DR

C$^3$TG introduces a two-phase, conflict-aware framework for precise multi-attribute text generation, effectively balancing attribute control, fluency, and safety without modifying the underlying language model.

Contribution

It presents a novel two-phase approach combining classifier-guided token adjustment and iterative optimization to manage conflicting attributes in text generation.

Findings

Outperforms baselines in attribute accuracy and fluency.

Reduces toxicity in generated text.

Enables multi-dimensional control without model fine-tuning.

Abstract

Recent advancements in large language models (LLMs) have demonstrated remarkable text generation capabilities. However, controlling specific attributes of generated text remains challenging without architectural modifications or extensive fine-tuning. Current methods typically toggle a single, basic attribute but struggle with precise multi-attribute control. In scenarios where attribute requirements conflict, existing methods lack coordination mechanisms, causing interference between desired attributes. Furthermore, these methods fail to incorporate iterative optimization processes in the controlled generation pipeline. To address these limitations, we propose Conflict-aware, Composite, and Collaborative Controlled Text Generation (C$^3$TG), a two-phase framework for fine-grained, multi-dimensional text attribute control. During generation, C$^3$TG selectively pairs the LLM with the required attribute classifiers from the 17 available dimensions and employs weighted KL-divergence to adjust token probabilities. The optimization phase then leverages an energy function combining classifier scores and penalty terms to resolve attribute conflicts through iterative feedback, enabling precise control over multiple dimensions simultaneously while preserving natural text flow. Experiments show that C$^3$TG significantly outperforms baselines across multiple metrics including attribute accuracy, linguistic fluency, and output diversity, while simultaneously reducing toxicity. These results establish C$^3$TG as an effective and flexible solution for multi-dimensional text attribute control that requires no costly model modifications.