Engagement vs. Commitment: The Economic Trade-Offs of Polarizing News Content

TL;DR

This study examines how polarizing news content increases engagement but does not boost subscriptions and can harm reader commitment during high political salience periods.

Contribution

It introduces a novel measurement of article polarization using deep learning and identifies causal effects of polarizing content on engagement and subscription behavior.

Findings

Polarizing content increases engagement but not subscriptions.

During high-salience elections, polarizing content reduces subscriptions and accelerates churn.

Balanced coverage of both sides of an issue increases consumption when supply shifts exogenously.

Abstract

Content that drives engagement need not be the same content that drives willingness to pay. We study how polarizing content affects engagement (time on site) and commitment (subscriptions and retention) on a major news platform. We measure article-level polarization with deep-learning classifiers and large language models tailored to a multiparty system, and identify causal effects with two complementary instrumental variables: a Bartik instrument exploiting supply-side editorial variation, and an election instrument exploiting demand-side political salience. We find that supply-driven increases in polarizing content raise engagement but not subscriptions. During the high-salience election window, the same content reduces subscriptions and accelerates churn, with affective polarization driving the sharpest divergence. On the mechanism, we find evidence inconsistent with confirmation bias: three pre-determined ideology proxies do not moderate the engagement or subscription effects. By contrast, on ideological dimensions where the publisher covers both sides, exogenous shifts in the publisher's supply of content opposite readers' baseline ideology raise their consumption of that content, consistent with balanced consumption. These results document an asymmetric engagement-commitment trade-off for digital publishers: polarizing content reliably captures attention but does not convert to subscriptions, and actively damages commitment when political salience is elevated