Change My Frame: Reframing in the Wild in r/ChangeMyView

TL;DR

This paper introduces a new dataset and approach for reframing in natural language processing, based on the r/ChangeMyView subreddit, enabling more diverse perspective shifts beyond neutral or positive rephrases.

Contribution

It generalizes reframing by leveraging community interactions from r/ChangeMyView, creating a dataset that captures diverse perspective changes and fine-tuning models for this task.

Findings

Successfully built a dataset from r/ChangeMyView interactions

Fine-tuned transformer models for perspective reframing

Identified challenges in dataset creation and evaluation

Abstract

Recent work in reframing, within the scope of text style transfer, has so far made use of out-of-context, task-prompted utterances in order to produce neutralizing or optimistic reframes. Our work aims to generalize reframing based on the subreddit r/ChangeMyView (CMV). We build a dataset that leverages CMV's community's interactions and conventions to identify high-value, community-recognized utterances that produce changes of perspective. With this data, we widen the scope of the direction of reframing since the changes in perspective do not only occur in neutral or positive directions. We fine tune transformer-based models, make use of a modern LLM to refine our dataset, and explore challenges in the dataset creation and evaluation around this type of reframing.