CoachGPT: A Scaffolding-based Academic Writing Assistant

TL;DR

CoachGPT is an AI-powered web application that uses large language models to provide personalized, real-time feedback and guidance for academic writing, especially benefiting students with limited resources or self-paced learners.

Contribution

This paper introduces CoachGPT, a novel scaffolding-based system leveraging LLMs to enhance academic writing instruction and feedback.

Findings

User studies confirm CoachGPT's usefulness.

CoachGPT offers personalized, real-time feedback.

The system effectively assists learners with limited resources.

Abstract

Academic writing skills are crucial for students' success, but can feel overwhelming without proper guidance and practice, particularly when writing in a second language. Traditionally, students ask instructors or search dictionaries, which are not universally accessible. Early writing assistants emerged as rule-based systems that focused on detecting misspellings, subject-verb disagreements, and basic punctuation errors; however, they are inaccurate and lack contextual understanding. Machine learning-based assistants demonstrate a strong ability for language understanding but are expensive to train. Large language models (LLMs) have shown remarkable capabilities in generating responses in natural languages based on given prompts. Still, they have a fundamental limitation in education: they generate essays without teaching, which can have detrimental effects on learning when misused. To address this limitation, we develop CoachGPT, which leverages large language models (LLMs) to assist individuals with limited educational resources and those who prefer self-paced learning in academic writing. CoachGPT is an AI agent-based web application that (1) takes instructions from experienced educators, (2) converts instructions into sub-tasks, and (3) provides real-time feedback and suggestions using large language models. This unique scaffolding structure makes CoachGPT unique among existing writing assistants. Compared to existing writing assistants, CoachGPT provides a more immersive writing experience with personalized feedback and guidance. Our user studies prove the usefulness of CoachGPT and the potential of large language models for academic writing.