Gradeer: An Open-Source Modular Hybrid Grader

TL;DR

Gradeer is a modular hybrid grading tool that combines automated and manual assessment methods, enhancing flexibility and efficiency in grading programming assignments.

Contribution

It introduces a modular, open-source platform that supports hybrid grading, enabling seamless integration of automated and manual evaluation techniques.

Findings

Hybrid grading improves assessment efficiency.

Gradeer facilitates easier manual grading process.

The tool is effective in real course settings.

Abstract

Automated assessment has been shown to greatly simplify the process of assessing students' programs. However, manual assessment still offers benefits to both students and tutors. We introduce Gradeer, a hybrid assessment tool, which allows tutors to leverage the advantages of both automated and manual assessment. The tool features a modular design, allowing new grading functionality to be added. Gradeer directly assists manual grading, by automatically loading code inspectors, running students' programs, and allowing grading to be stopped and resumed in place at a later time. We used Gradeer to assess an end of year assignment for an introductory Java programming course, and found that its hybrid approach offers several benefits.