Setting SAIL: Leveraging Scientist-AI-Loops for Rigorous Visualization Tools

TL;DR

The paper introduces the Scientist-AI-Loop (SAIL), a framework that enables scientists to rapidly develop scientifically rigorous visualization tools by combining AI code generation with strict oversight of scientific accuracy.

Contribution

SAIL separates domain logic from code syntax, allowing researchers to maintain scientific rigor while leveraging AI for faster tool development.

Findings

Development of two astrophysics visualization tools in days

SAIL maintains scientific validity in AI-generated code

Framework supports outreach, teaching, and early research prototyping

Abstract

Scientists across all disciplines share a common challenge: the divide between their theoretical knowledge and the specialized skills and time needed to build interactive tools to communicate this expertise. While large language models (LLMs) offer unparalleled acceleration in code generation, they frequently prioritize functional syntax over scientific accuracy, risking visually convincing but scientifically invalid results. This work advocates the Scientist-AI-Loop (SAIL), a framework designed to harness this speed without compromising rigor. By separating domain logic from code syntax, SAIL enables researchers to maintain strict oversight of scientific concepts and constraints while delegating code implementation to AI. We illustrate this approach through two open-source, browser-based astrophysics tools: an interactive gravitational lensing visualization and a large-scale structure formation sandbox, both publicly available. Our methodology condensed development to mere days while maintaining scientific integrity. We specifically address failure modes where AI-generated code neglects phenomenological boundaries or scientific validity. While cautioning that research-grade code requires stringent protocols, we demonstrate through two examples that SAIL provides an effective code generation workflow for outreach, teaching, professional presentations, and early-stage research prototyping. This framework contributes to a foundation for the further development of AI-assisted scientific software.