Measuring Human Contribution in AI-Assisted Content Generation

TL;DR

This paper proposes an information-theoretic framework to quantify human contribution in AI-assisted content creation, addressing challenges in measuring originality and varying human involvement.

Contribution

It introduces a novel mutual information-based measure to quantify human input in AI-assisted content, validated across multiple creative domains.

Findings

Effective discrimination of human contribution levels

Framework applicable across diverse creative domains

Provides a foundation for future measurement of human-AI collaboration

Abstract

With the growing prevalence of generative artificial intelligence (AI), an increasing amount of content is no longer exclusively generated by humans but by generative AI models with human guidance. This shift presents notable challenges for the delineation of originality due to the varying degrees of human contribution in AI-assisted works. This study raises the research question of measuring human contribution in AI-assisted content generation and introduces a framework to address this question that is grounded in information theory. By calculating mutual information between human input and AI-assisted output relative to self-information of AI-assisted output, we quantify the proportional information contribution of humans in content generation. Our experimental results demonstrate that the proposed measure effectively discriminates between varying degrees of human contribution across multiple creative domains. We hope that this work lays a foundation for measuring human contributions in AI-assisted content generation in the era of generative AI.