Criminal Liability of Generative Artificial Intelligence Providers for User-Generated Child Sexual Abuse Material

TL;DR

This paper examines the complex legal issues surrounding the criminal liability of GenAI providers and users involved in generating child sexual abuse material, highlighting legal, technical, and contextual factors.

Contribution

It offers a multidisciplinary legal analysis of liability for GenAI creators and users in the context of CSAM, considering German law and technical scenarios.

Findings

Liability extends to users and responsible model developers.

Legal consequences depend on content type and moderation policies.

Contextual and technical factors influence criminal liability assessment.

Abstract

The development of more powerful Generative Artificial Intelligence (GenAI) has expanded its capabilities and the variety of outputs. This has introduced significant legal challenges, including gray areas in various legal systems, such as the assessment of criminal liability for those responsible for these models. Therefore, we conducted a multidisciplinary study utilizing the statutory interpretation of relevant German laws, which, in conjunction with scenarios, provides a perspective on the different properties of GenAI in the context of Child Sexual Abuse Material (CSAM) generation. We found that generating CSAM with GenAI may have criminal and legal consequences not only for the user committing the primary offense but also for individuals responsible for the models, such as independent software developers, researchers, and company representatives. Additionally, the assessment of criminal liability may be affected by contextual and technical factors, including the type of generated image, content moderation policies, and the model's intended purpose. Based on our findings, we discussed the implications for different roles, as well as the requirements when developing such systems.