ReflectSumm: A Benchmark for Course Reflection Summarization

TL;DR

ReflectSumm is a new dataset for summarizing students' reflective writing, aiming to advance summarization techniques in educational contexts with limited training data.

Contribution

The paper introduces ReflectSumm, a specialized dataset for course reflection summarization, and provides benchmark evaluations to support future research.

Findings

Benchmark results with state-of-the-art models

Dataset covers diverse summarization tasks

Supports research in low-resource educational summarization

Abstract

This paper introduces ReflectSumm, a novel summarization dataset specifically designed for summarizing students' reflective writing. The goal of ReflectSumm is to facilitate developing and evaluating novel summarization techniques tailored to real-world scenarios with little training data, %practical tasks with potential implications in the opinion summarization domain in general and the educational domain in particular. The dataset encompasses a diverse range of summarization tasks and includes comprehensive metadata, enabling the exploration of various research questions and supporting different applications. To showcase its utility, we conducted extensive evaluations using multiple state-of-the-art baselines. The results provide benchmarks for facilitating further research in this area.