"I understand why I got this grade": Automatic Short Answer Grading with Feedback
Dishank Aggarwal, Pritam Sil, Bhaskaran Raman, Pushpak Bhattacharyya

TL;DR
This paper introduces EngSAF, a large dataset for automatic short-answer grading with feedback, leveraging LLMs to generate meaningful feedback and demonstrating its effectiveness in real educational settings.
Contribution
The paper presents EngSAF, a new dataset for automatic short-answer grading with feedback, and proposes a feedback generation strategy using state-of-the-art LLMs.
Findings
Mistral-7B achieves 75.4% accuracy on unseen answers.
The dataset covers diverse subjects and answer patterns.
The system is effective in real-world educational deployment.
Abstract
In recent years, there has been a growing interest in using Artificial Intelligence (AI) to automate student assessment in education. Among different types of assessments, summative assessments play a crucial role in evaluating a student's understanding level of a course. Such examinations often involve short-answer questions. However, grading these responses and providing meaningful feedback manually at scale is both time-consuming and labor-intensive. Feedback is particularly important, as it helps students recognize their strengths and areas for improvement. Despite the importance of this task, there is a significant lack of publicly available datasets that support automatic short-answer grading with feedback generation. To address this gap, we introduce Engineering Short Answer Feedback (EngSAF), a dataset designed for automatic short-answer grading with feedback. The dataset covers…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
- 🤗IsmaelMousa/Qwen2.5-0.5B-Instruct-EngSaf-211Kmodel· 3 dl3 dl
- 🤗IsmaelMousa/Qwen2.5-1.5B-Instruct-EngSaf-211Kmodel· 3 dl3 dl
- 🤗IsmaelMousa/Qwen2.5-3B-Instruct-EngSaf-211Kmodel· 2 dl2 dl
- 🤗IsmaelMousa/Qwen2.5-0.5B-Instruct-EngSaf-417Kmodel· 2 dl2 dl
- 🤗amjad-awad/mistral-7b-instruct-v0.2-bnb-4bit-EngSaf-96Kmodel
- 🤗IsmaelMousa/Qwen2.5-1.5B-Instruct-EngSaf-417Kmodel· 3 dl3 dl
- 🤗IsmaelMousa/Qwen2.5-3B-Instruct-EngSaf-417Kmodel· 1 dl1 dl
- 🤗IsmaelMousa/Qwen2.5-0.5B-Instruct-EngSaf-628Kmodel· 8 dl8 dl
- 🤗IsmaelMousa/Qwen2.5-1.5B-Instruct-EngSaf-628Kmodel· 2 dl2 dl
- 🤗IsmaelMousa/Qwen2.5-3B-Instruct-EngSaf-628Kmodel· 5 dl5 dl
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsIntelligent Tutoring Systems and Adaptive Learning
