Policy or Community?: Supporting Individual Model Creators' Open Model Development in Model Marketplaces

TL;DR

This paper investigates how AI model marketplaces can better support responsible individual model creators by understanding their needs, motivations, and community influences through interviews, highlighting the importance of tailored platform governance.

Contribution

It provides empirical insights into creators' regulatory needs and community-driven responsibility, informing platform policies for responsible open model development.

Findings

Creators need to reduce downstream harms and secure model ownership.

Community norms heavily influence creators' sense of responsibility.

Creators use RAI tools mainly for self-protection and visibility.

Abstract

Lightweight fine-tuning techniques and the rise of 'open' AI model marketplaces have enabled individuals to easily build and release generative models. Yet, this accessibility also raises risks, including the production of harmful and infringing content. While platforms offer policies and responsible AI tools, their effectiveness may be limited, as creators engage with partially open models that vary widely in openness and transparency. To understand how platform governance can better support responsible practices, we conducted semi-structured interviews with 19 individual model creators. We identified three regulatory needs shaped by creators' workflows: reducing downstream harms, recognizing creators' contributions and originality, and securing model ownership. Creators also repurpose RAI tools primarily for self-protection and visibility, and their sense of responsibility is deeply shaped by community norms rather than formal policies. We argue that platforms' governance decisions must consider how policy interventions shape the practices and motivations of individual creators.