A Novel Approach to Scalable and Automatic Topic-Controlled Question Generation in Education

TL;DR

This paper presents a scalable, topic-controlled question generation method for education that improves relevance and reduces teacher workload by fine-tuning a small pre-trained model with novel evaluation techniques.

Contribution

It introduces a novel topic-controlled question generation approach using fine-tuned T5-small models, addressing semantic alignment and topic specificity in educational contexts.

Findings

Generated questions are highly relevant and topic-focused.

Model achieves high quality in offline and human evaluations.

Proposed method reduces infrastructure costs and enhances scalability.

Abstract

The development of Automatic Question Generation (QG) models has the potential to significantly improve educational practices by reducing the teacher workload associated with creating educational content. This paper introduces a novel approach to educational question generation that controls the topical focus of questions. The proposed Topic-Controlled Question Generation (T-CQG) method enhances the relevance and effectiveness of the generated content for educational purposes. Our approach uses fine-tuning on a pre-trained T5-small model, employing specially created datasets tailored to educational needs. The research further explores the impacts of pre-training strategies, quantisation, and data augmentation on the model's performance. We specifically address the challenge of generating semantically aligned questions with paragraph-level contexts, thereby improving the topic specificity of the generated questions. In addition, we introduce and explore novel evaluation methods to assess the topical relatedness of the generated questions. Our results, validated through rigorous offline and human-backed evaluations, demonstrate that the proposed models effectively generate high-quality, topic-focused questions. These models have the potential to reduce teacher workload and support personalised tutoring systems by serving as bespoke question generators. With its relatively small number of parameters, the proposals not only advance the capabilities of question generation models for handling specific educational topics but also offer a scalable solution that reduces infrastructure costs. This scalability makes them feasible for widespread use in education without reliance on proprietary large language models like ChatGPT.