Crafting Tomorrow's Evaluations: Assessment Design Strategies in the Era of Generative AI

TL;DR

This paper discusses the challenges and opportunities of integrating Generative AI into educational assessment design, emphasizing policy, integrity, and skill development to adapt evaluation methodologies.

Contribution

It offers a framework for assessment categorization based on GenAI use and highlights strategies for maintaining academic integrity in the AI era.

Findings

Assessment categories based on GenAI usage

Need for clear policies on GenAI in assessments

Skills development for effective GenAI utilization

Abstract

GenAI has gained the attention of a myriad of users in almost every profession. Its advancement has had an intense impact on education, significantly disrupting the assessment design and evaluation methodologies. Despite the potential benefits and possibilities of GenAI in the education sector, there are several concerns primarily centred around academic integrity, authenticity, equity of access, assessment evaluation methodology, and feedback. Consequently, academia is encountering challenges in assessment design that are essential to retaining academic integrity in the age of GenAI. In this article, we discuss the challenges, and opportunities that need to be addressed for the assessment design and evaluation. The article also highlights the importance of clear policy about the usage of GenAI in completing assessment tasks, and also in design approaches to ensure academic integrity and subject learning. Additionally, this article also provides assessment categorisation based on the use of GenAI to cultivate knowledge among students and academic professionals. It also provides information on the skills necessary to formulate and articulate problems and evaluate the task, enabling students and academics to effectively utilise GenAI tools.