Towards grounded autonomous research: an end-to-end LLM mini research loop on published computational physics

TL;DR

This paper demonstrates an autonomous research loop using large language models that can read, reproduce, critique, and extend computational physics papers, achieving significant insights and even producing a publishable comment.

Contribution

It introduces an end-to-end autonomous research framework applied to computational physics, capable of critical analysis and generating new scientific content without supervision.

Findings

The agent raised substantive concerns on 42% of 111 papers.

In-depth case study produced a publishable comment revising the original paper's conclusion.

The system autonomously generated a complete, typeset, and PDF-iterated comment.

Abstract

Recent autonomous LLM agents have demonstrated end-to-end automation of machine-learning research. Real-world physical science is intrinsically harder, requiring deep reasoning bounded by physical truth and, because real systems are too complex to study in isolation, almost always built on existing literature. We focus on the smallest meaningful unit of such research, a mini research loop in which an agent reads a paper, reproduces it, critiques it, and extends it. We test this loop in two complementary regimes: scale and depth. At scale, across 111 open-access computational physics papers, an agent autonomously runs the read-plan-compute-compare loop and, without being asked to critique, raises substantive concerns on ~42% of papers - 97.7% of which require execution to surface. In depth, for one Nature Communications paper on multiscale simulation of a 2D-material MOSFET, the agent runs new calculations missing from the original and produces, unsupervised, a publishable Comment -- composed, figured, typeset, and PDF-iterated -- that revises the paper's headline conclusion.