MegaWika 2: A More Comprehensive Multilingual Collection of Articles and their Sources

TL;DR

MegaWika 2 is an extensive multilingual dataset of Wikipedia articles with detailed citation and source information, designed to facilitate fact-checking and cross-lingual analysis.

Contribution

It significantly expands the original MegaWika dataset by increasing article count and citation coverage, supporting advanced fact-checking and temporal analysis tasks.

Findings

Six times more articles than MegaWika

Twice as many fully scraped citations

Supports fact checking and cross-language analysis

Abstract

We introduce MegaWika 2, a large, multilingual dataset of Wikipedia articles with their citations and scraped web sources; articles are represented in a rich data structure, and scraped source texts are stored inline with precise character offsets of their citations in the article text. MegaWika 2 is a major upgrade from the original MegaWika, spanning six times as many articles and twice as many fully scraped citations. Both MegaWika and MegaWika 2 support report generation research ; whereas MegaWika also focused on supporting question answering and retrieval applications, MegaWika 2 is designed to support fact checking and analyses across time and language.