chatGPT for generating questions and assessments based on accreditations

TL;DR

This paper explores using generative AI to create and validate student assessment questions aligned with academic accreditation standards, demonstrating high faculty acceptance for AI-generated and edited questions.

Contribution

Introduces a novel method for mapping question verbs and applying generative AI to produce and validate accreditation-compliant exam questions.

Findings

85% approval for AI-generated complete exam questions

98% approval for editing existing questions

High faculty acceptance of AI-assisted assessment creation

Abstract

This research aims to take advantage of artificial intelligence techniques in producing students assessment that is compatible with the different academic accreditations of the same program. The possibility of using generative artificial intelligence technology was studied to produce an academic accreditation compliant test the National Center for Academic Accreditation of Kingdom of Saudi Arabia and Accreditation Board for Engineering and Technology. A novel method was introduced to map the verbs used to create the questions introduced in the tests. The method allows a possibility of using the generative artificial intelligence technology to produce and check the validity of questions that measure educational outcomes. A questionnaire was distributed to ensure that the use of generative artificial intelligence to create exam questions is acceptable by the faculty members, as well as to ask about the acceptance of assistance in validating questions submitted by faculty members and amending them in accordance with academic accreditations. The questionnaire was distributed to faculty members of different majors in the Kingdom of Saudi Arabias universities. one hundred twenty responses obtained with eight five percentile approval percentage for generate complete exam questions by generative artificial intelligence . Whereas ninety eight percentage was the approval percentage for editing and improving already existed questions.