WikiAsp: A Dataset for Multi-domain Aspect-based Summarization

TL;DR

WikiAsp is a large-scale, multi-domain dataset for aspect-based summarization using Wikipedia articles, aiming to advance open-domain summarization research and address challenges like pronoun handling and temporal consistency.

Contribution

The paper introduces WikiAsp, a novel dataset spanning 20 domains for multi-domain aspect-based summarization, and evaluates baseline models to identify key challenges.

Findings

Existing models struggle with pronoun resolution in quotations.

Temporal consistency remains a significant challenge.

Baseline models reveal the complexity of multi-domain summarization.

Abstract

Aspect-based summarization is the task of generating focused summaries based on specific points of interest. Such summaries aid efficient analysis of text, such as quickly understanding reviews or opinions from different angles. However, due to large differences in the type of aspects for different domains (e.g., sentiment, product features), the development of previous models has tended to be domain-specific. In this paper, we propose WikiAsp, a large-scale dataset for multi-domain aspect-based summarization that attempts to spur research in the direction of open-domain aspect-based summarization. Specifically, we build the dataset using Wikipedia articles from 20 different domains, using the section titles and boundaries of each article as a proxy for aspect annotation. We propose several straightforward baseline models for this task and conduct experiments on the dataset. Results highlight key challenges that existing summarization models face in this setting, such as proper pronoun handling of quoted sources and consistent explanation of time-sensitive events.