Plato's Cave: A Human-Centered Research Verification System

TL;DR

Plato's Cave is an open-source system that uses a DAG and web agents to verify research claims, assess writing quality, and identify unverifiable statements in scientific papers.

Contribution

It introduces a novel human-centered verification system that combines graph analysis and web-based credibility scoring for research papers.

Findings

System implemented and tested on 104 papers

Effective in assessing credibility and argumentative structure

Provides a transparent, automated verification process

Abstract

The growing publication rate of research papers has created an urgent need for better ways to fact-check information, assess writing quality, and identify unverifiable claims. We present Plato's Cave as an open-source, human-centered research verification system that (i) creates a directed acyclic graph (DAG) from a document, (ii) leverages web agents to assign credibility scores to nodes and edges from the DAG, and (iii) gives a final score by interpreting and evaluating the paper's argumentative structure. We report the system implementation and results on a collected dataset of 104 research papers.