Prompted Aspect Key Point Analysis for Quantitative Review Summarization

TL;DR

This paper introduces PAKPA, a novel method using large language models and aspect sentiment analysis for accurate, data-efficient review summarization by extracting and quantifying key points grounded in specific aspects.

Contribution

The paper presents PAKPA, a new approach that leverages LLMs and aspect analysis to improve the faithfulness and quantification of review summaries without extensive annotated data.

Findings

Achieves state-of-the-art performance on Yelp and SPACE datasets.

Produces more faithful and accurately quantified key points.

Reduces reliance on large annotated datasets.

Abstract

Key Point Analysis (KPA) aims for quantitative summarization that provides key points (KPs) as succinct textual summaries and quantities measuring their prevalence. KPA studies for arguments and reviews have been reported in the literature. A majority of KPA studies for reviews adopt supervised learning to extract short sentences as KPs before matching KPs to review comments for quantification of KP prevalence. Recent abstractive approaches still generate KPs based on sentences, often leading to KPs with overlapping and hallucinated opinions, and inaccurate quantification. In this paper, we propose Prompted Aspect Key Point Analysis (PAKPA) for quantitative review summarization. PAKPA employs aspect sentiment analysis and prompted in-context learning with Large Language Models (LLMs) to generate and quantify KPs grounded in aspects for business entities, which achieves faithful KPs with accurate quantification, and removes the need for large amounts of annotated data for supervised training. Experiments on the popular review dataset Yelp and the aspect-oriented review summarization dataset SPACE show that our framework achieves state-of-the-art performance. Source code and data are available at: https://github.com/antangrocket1312/PAKPA