An Audit of Misinformation Filter Bubbles on YouTube: Bubble Bursting and Recent Behavior Changes

TL;DR

This study investigates how misinformation filter bubbles on YouTube can be burst by watching debunking content, revealing that bubble bursting is possible but varies by topic and that bubbles are not always present, with limited recent improvements.

Contribution

It is the first to analyze the process of bursting misinformation filter bubbles on YouTube through simulated user behavior and compare it with previous findings.

Findings

Bursting bubbles varies by topic.

Filter bubbles are not always present.

Limited recent improvements in misinformation prevalence.

Abstract

The negative effects of misinformation filter bubbles in adaptive systems have been known to researchers for some time. Several studies investigated, most prominently on YouTube, how fast a user can get into a misinformation filter bubble simply by selecting wrong choices from the items offered. Yet, no studies so far have investigated what it takes to burst the bubble, i.e., revert the bubble enclosure. We present a study in which pre-programmed agents (acting as YouTube users) delve into misinformation filter bubbles by watching misinformation promoting content (for various topics). Then, by watching misinformation debunking content, the agents try to burst the bubbles and reach more balanced recommendation mixes. We recorded the search results and recommendations, which the agents encountered, and analyzed them for the presence of misinformation. Our key finding is that bursting of a filter bubble is possible, albeit it manifests differently from topic to topic. Moreover, we observe that filter bubbles do not truly appear in some situations. We also draw a direct comparison with a previous study. Sadly, we did not find much improvements in misinformation occurrences, despite recent pledges by YouTube.