Attribute First, then Generate: Locally-attributable Grounded Text Generation
Aviv Slobodkin, Eran Hirsch, Arie Cattan, Tal Schuster, Ido Dagan

TL;DR
This paper proposes a three-step method for grounded text generation that improves attribution precision, reduces verification effort, and maintains or enhances quality in multi-document summarization and long-form QA tasks.
Contribution
It introduces a locally-attributable generation approach that emphasizes concise, fine-grained source attributions by separating content selection, sentence planning, and generation.
Findings
More concise citations than baselines
Maintains or improves generation quality
Reduces human fact verification time
Abstract
Recent efforts to address hallucinations in Large Language Models (LLMs) have focused on attributed text generation, which supplements generated texts with citations of supporting sources for post-generation fact-checking and corrections. Yet, these citations often point to entire documents or paragraphs, burdening users with extensive verification work. In this paper, we introduce a locally-attributable text generation approach, prioritizing concise attributions. Our method, named "Attribute First, then Generate", breaks down the conventional end-to-end generation process into three intuitive steps: content selection, sentence planning, and sequential sentence generation. By initially identifying relevant source segments ("select first") and then conditioning the generation process on them ("then generate"), we ensure these segments also act as the output's fine-grained attributions…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsTopic Modeling
