How Similar Are Grokipedia and Wikipedia? A Multi-Dimensional Textual and Structural Comparison

TL;DR

This study compares Grokipedia, an AI-generated encyclopedia, with Wikipedia across multiple textual and structural dimensions, revealing significant differences in length, references, and political bias, and highlighting challenges in AI-driven knowledge curation.

Contribution

It provides a large-scale, multi-metric analysis of AI-generated versus human-edited encyclopedia articles, uncovering systematic biases and content divergence.

Findings

Grokipedia articles are longer and have fewer references per word.

Content divides into semantically aligned and divergent groups.

Divergent articles show a rightward political bias in cited sources.

Abstract

The launch of Grokipedia, an AI-generated encyclopedia developed by Elon Musk's xAI, was presented as a response to perceived ideological and structural biases in Wikipedia, aiming to produce "truthful" entries using the Grok large language model. Yet whether an AI-driven alternative can escape the biases and limitations of human-edited platforms remains unclear. This study conducts a large-scale computational comparison of 17,790 matched article pairs from the 20,000 most-edited English Wikipedia pages. Using metrics spanning lexical richness, readability, reference density, structural features, and semantic similarity, we assess how closely the two platforms align in form and substance. We find that Grokipedia articles are substantially longer and contain significantly fewer references per word. Moreover, Grokipedia's content divides into two distinct groups: one that remains semantically and stylistically aligned with Wikipedia, and another that diverges sharply. Among the dissimilar articles, we observe a systematic rightward shift in the political bias of frequently cited news media sources, concentrated primarily in entries related to history and religion, and literature and art. More broadly, the findings indicate that AI-generated encyclopedic content departs from established editorial norms, favoring narrative expansion over citation-based verification, raising questions about transparency, provenance, and the governance of knowledge in automated information systems.