Design of a Quality Management System based on the EU Artificial Intelligence Act

TL;DR

This paper presents a practical, prototype-based quality management system for high-risk AI, aligned with the EU AI Act, enabling verification, documentation, and orchestration of AI system requirements.

Contribution

It introduces a novel microservice SaaS architecture for a QMS that connects directly to AI systems for compliance and documentation, bridging the gap between theory and practical implementation.

Findings

Prototype successfully connects to an LLM for verification and documentation.

Qualitative assessment confirms requirement implementation.

Performance analysis shows acceptable GPU memory usage.

Abstract

The EU AI Act mandates that providers and deployers of high-risk AI systems establish a quality management system (QMS). Among other criteria, a QMS shall help verify and document the AI system design and quality and monitor the proper implementation of all high-risk AI system requirements. Current research rarely explores practical solutions for implementing the EU AI Act. Instead, it tends to focus on theoretical concepts. As a result, more attention must be paid to tools that help humans actively check and document AI systems and orchestrate the implementation of all high-risk AI system requirements. Therefore, this paper introduces a new design concept and prototype for a QMS as a microservice Software as a Service web application. It connects directly to the AI system for verification and documentation and enables the orchestration and integration of various sub-services, which can be individually designed, each tailored to specific high-risk AI system requirements. The first version of the prototype connects to the Phi-3-mini-128k-instruct LLM as an example of an AI system and integrates a risk management system and a data management system. The prototype is evaluated through a qualitative assessment of the implemented requirements, a GPU memory and performance analysis, and an evaluation with IT, AI, and legal experts.