IntelliProof: An Argumentation Network-based Conversational Helper for Organized Reflection

TL;DR

IntelliProof is an interactive system that analyzes argumentative essays by constructing argumentation graphs, classifying relations with LLMs, and providing visualizations and justifications to enhance user understanding and assessment of essay coherence.

Contribution

It introduces a novel interactive system that structures essays as argumentation graphs with LLM-based classification and visualization, improving user engagement and understanding.

Findings

Effective visualization of argumentation graphs.

Quantitative measures of essay coherence.

Enhanced user understanding of argumentative structure.

Abstract

We present IntelliProof, an interactive system for analyzing argumentative essays through LLMs. IntelliProof structures an essay as an argumentation graph, where claims are represented as nodes, supporting evidence is attached as node properties, and edges encode supporting or attacking relations. Unlike existing automated essay scoring systems, IntelliProof emphasizes the user experience: each relation is initially classified and scored by an LLM, then visualized for enhanced understanding. The system provides justifications for classifications and produces quantitative measures for essay coherence. It enables rapid exploration of argumentative quality while retaining human oversight. In addition, IntelliProof provides a set of tools for a better understanding of an argumentative essay and its corresponding graph in natural language, bridging the gap between the structural semantics of argumentative essays and the user's understanding of a given text.