Explainability and Certification of AI-Generated Educational Assessments

TL;DR

This paper presents a comprehensive framework for making AI-generated educational assessments transparent, explainable, and certifiable, enhancing trustworthiness and compliance with governance standards.

Contribution

It introduces a novel framework combining self-rationalization, attribution analysis, and certification metadata for AI assessment items, with a proof-of-concept study.

Findings

Improved transparency and interpretability of AI-generated questions

Reduced instructor workload through automated certification processes

Enhanced auditability and compliance with governance standards

Abstract

The rapid adoption of generative artificial intelligence (AI) in educational assessment has created new opportunities for scalable item creation, personalized feedback, and efficient formative evaluation. However, despite advances in taxonomy alignment and automated question generation, the absence of transparent, explainable, and certifiable mechanisms limits institutional and accreditation-level acceptance. This chapter proposes a comprehensive framework for explainability and certification of AI-generated assessment items, combining self-rationalization, attribution-based analysis, and post-hoc verification to produce interpretable cognitive-alignment evidence grounded in Bloom's and SOLO taxonomies. A structured certification metadata schema is introduced to capture provenance, alignment predictions, reviewer actions, and ethical indicators, enabling audit-ready documentation consistent with emerging governance requirements. A traffic-light certification workflow operationalizes these signals by distinguishing auto-certifiable items from those requiring human review or rejection. A proof-of-concept study on 500 AI-generated computer science questions demonstrates the framework's feasibility, showing improved transparency, reduced instructor workload, and enhanced auditability. The chapter concludes by outlining ethical implications, policy considerations, and directions for future research, positioning explainability and certification as essential components of trustworthy, accreditation-ready AI assessment systems.