The Impact of AI Search on the Online Content Ecosystem: Evidence from Google and Reddit

TL;DR

This study examines how generative AI search tools like Google AI Overviews influence user engagement on Reddit, revealing increased activity in safe-for-work communities and the impact of interface design on content types.

Contribution

It provides empirical evidence on the effects of AI search interfaces on online content ecosystems, highlighting the role of design and content type in user engagement.

Findings

AI Overviews increase engagement in SFW Reddit communities by over 12%.

Effects are stronger for experience-based discussions than factual content.

Introduction of Google AI Mode reduces these engagement gains.

Abstract

Search engines traditionally complement online content platforms by directing users seeking information to external websites. The emergence of generative AI search tools that summarize answers directly on the results page may disrupt this relationship by making visits to source platforms optional. We study this question using Google AI Overviews and Reddit, one of the largest online discussion platforms. Our identification exploits Google's content moderation policy: Safe-for-Work (SFW) Reddit communities are indexed by Google organic search and surfaced in Google AI Overviews, while Not-Safe-for-Work (NSFW) communities, though indexed by organic search, are prohibited from being referenced in AI Overview summaries. Using a difference-in-differences design, we find that AI Overviews increase engagement in SFW communities: daily comments rise by 12.0 percent and the number of commenting users by 12.3 percent relative to NSFW communities. The effects are concentrated in experience-based discussions (opinions, advice, and personal experiences) rather than fact-based information. However, the subsequent introduction of Google AI Mode, which allows users to interact conversationally with the AI summary, largely eliminates these gains in experience-based content. These results suggest that the effects of AI search depend critically on interface design and types of content.