Paid Voices vs. Public Feeds: Interpretable Cross-Platform Theme Modeling of Climate Discourse

TL;DR

This paper introduces an interpretable thematic analysis framework for comparing climate discourse across paid ads on Meta and organic posts on Bluesky, revealing platform-driven differences in messaging and response to political events.

Contribution

It presents a novel, interpretable, end-to-end thematic discovery method leveraging large language models, enabling cross-platform comparison of climate communication.

Findings

Paid advertising emphasizes strategic persuasion themes.

Public discourse shows more organic, diverse themes.

Themes shift around major political events.

Abstract

Climate discourse online plays a crucial role in shaping public understanding of climate change and influencing political and policy outcomes. However, climate communication unfolds across structurally distinct platforms with fundamentally different incentive structures: paid advertising ecosystems incentivize targeted, strategic persuasion, while public social media platforms host largely organic, user-driven discourse. Existing computational studies typically analyze these environments in isolation, limiting our ability to distinguish institutional messaging from public expression. In this work, we present a comparative analysis of climate discourse across paid advertisements on Meta (previously known as Facebook) and public posts on Bluesky from July 2024 to September 2025. We introduce an interpretable, end-to-end thematic discovery and assignment framework that clusters texts by semantic similarity and leverages large language models (LLMs) to generate concise, human-interpretable theme labels. We evaluate the quality of the induced themes against traditional topic modeling baselines using both human judgments and an LLM-based evaluator, and further validate their semantic coherence through downstream stance prediction and theme-guided retrieval tasks. Applying the resulting themes, we characterize systematic differences between paid climate messaging and public climate discourse and examine how thematic prevalence shifts around major political events. Our findings show that platform-level incentives are reflected in the thematic structure, stance alignment, and temporal responsiveness of climate narratives. While our empirical analysis focuses on climate communication, the proposed framework is designed to support comparative narrative analysis across heterogeneous communication environments.