Strategic Response of News Publishers to Generative AI

TL;DR

This paper analyzes how news publishers strategically respond to Generative AI, revealing tactics like blocking AI bots, shifting to richer content, and increasing new editorial jobs, with measurable impacts on traffic and content quality.

Contribution

It provides empirical evidence on publishers' strategic responses to Generative AI, including blocking AI access, content adaptation, and employment changes, using high-frequency data and difference-in-differences analysis.

Findings

Large publishers blocking AI bots see reduced traffic.

Publishers shift to richer, harder-to-replicate content.

Increase in new editorial and content-production job postings.

Abstract

Generative AI can adversely impact news publishers by lowering consumer demand. It can also reduce demand for newsroom employees, and increase the creation of news "slop." However, it can also form a source of traffic referrals and an information-discovery channel that increases demand. We use high-frequency granular data to analyze the strategic response of news publishers to the introduction of Generative AI. Many publishers strategically blocked LLM access to their websites using the robots.txt file standard. Using a difference-in-differences approach, we find that large publishers who block GenAI bots experience reduced website traffic compared to not blocking. In addition, we find that large publishers shift toward richer content that is harder for LLMs to replicate, without increasing text volume. Finally, we find that the share of new editorial and content-production job postings rises over time. Together, these findings illustrate the levers that publishers choose to use to strategically respond to competitive Generative AI threats, and their consequences.