Reliability Estimation of News Media Sources: Birds of a Feather Flock Together
Sergio Burdisso, Dairazalia S\'anchez-Cort\'es, Esa\'u Villatoro-Tello, and Petr Motlicek

TL;DR
This paper introduces a reinforcement learning-based method for estimating news media sources' reliability degrees, which correlates well with journalist scores and improves reliability prediction accuracy.
Contribution
It presents a novel approach modeling source reliability as a degree influenced by interactions among sources, validated on a large dataset, advancing beyond previous label-based methods.
Findings
Reliability degrees strongly correlate with journalist scores (Spearman=0.80)
Achieves an 81.05% macro F1 score in predicting reliability labels
Validated on a dataset an order of magnitude larger than existing ones
Abstract
Evaluating the reliability of news sources is a routine task for journalists and organizations committed to acquiring and disseminating accurate information. Recent research has shown that predicting sources' reliability represents an important first-prior step in addressing additional challenges such as fake news detection and fact-checking. In this paper, we introduce a novel approach for source reliability estimation that leverages reinforcement learning strategies for estimating the reliability degree of news sources. Contrary to previous research, our proposed approach models the problem as the estimation of a reliability degree, and not a reliability label, based on how all the news media sources interact with each other on the Web. We validated the effectiveness of our method on a news media reliability dataset that is an order of magnitude larger than comparable existing…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
Taxonomy
TopicsModel Reduction and Neural Networks · Nuclear Engineering Thermal-Hydraulics · Anomaly Detection Techniques and Applications
