ReviseMate: Exploring Contextual Support for Digesting STEM Paper Reviews

TL;DR

ReviseMate is an interactive system designed to improve researchers' ability to understand and incorporate reviewer feedback on STEM papers, addressing challenges like time consumption and reading fatigue.

Contribution

This work introduces ReviseMate, a novel interactive tool supported by user studies, to enhance review comprehension and feedback integration in academic writing.

Findings

ReviseMate outperforms baseline methods in user studies.

Participants reported improved review understanding with ReviseMate.

Field deployment confirmed real-world effectiveness.

Abstract

Effectively assimilating and integrating reviewer feedback is crucial for researchers seeking to refine their papers and handle potential rebuttal phases in academic venues. However, traditional review digestion processes present challenges such as time consumption, reading fatigue, and the requisite for comprehensive analytical skills. Prior research on review analysis often provides theoretical guidance with limited targeted support. Additionally, general text comprehension tools overlook the intricate nature of comprehensively understanding reviews and lack contextual assistance. To bridge this gap, we formulated research questions to explore the authors' concerns and methods for enhancing comprehension during the review digestion phase. Through interviews and the creation of storyboards, we developed ReviseMate, an interactive system designed to address the identified challenges. A controlled user study (N=31) demonstrated the superiority of ReviseMate over baseline methods, with positive feedback regarding user interaction. Subsequent field deployment (N=6) further validated the effectiveness of ReviseMate in real-world review digestion scenarios. These findings underscore the potential of interactive tools to significantly enhance the assimilation and integration of reviewer feedback during the manuscript review process.