Operating advanced scientific instruments with AI agents that learn on the job

TL;DR

This paper investigates integrating Large Language Model-powered AI agents into advanced scientific facilities to improve automation, usability, and adaptability in complex experimental workflows through human-in-the-loop learning.

Contribution

It introduces a novel human-in-the-loop pipeline utilizing LLMs as trainable scientific assistants for operating complex scientific instruments.

Findings

AI agents can effectively manage multi-task scientific workflows

LLMs enhance human-in-the-loop operation and iterative learning

Demonstrated application on X-ray beamline and robotic material characterization

Abstract

Advanced scientific user facilities, such as next generation X-ray light sources and self-driving laboratories, are revolutionizing scientific discovery by automating routine tasks and enabling rapid experimentation and characterizations. However, these facilities must continuously evolve to support new experimental workflows, adapt to diverse user projects, and meet growing demands for more intricate instruments and experiments. This continuous development introduces significant operational complexity, necessitating a focus on usability, reproducibility, and intuitive human-instrument interaction. In this work, we explore the integration of agentic AI, powered by Large Language Models (LLMs), as a transformative tool to achieve this goal. We present our approach to developing a human-in-the-loop pipeline for operating advanced instruments including an X-ray nanoprobe beamline and an autonomous robotic station dedicated to the design and characterization of materials. Specifically, we evaluate the potential of various LLMs as trainable scientific assistants for orchestrating complex, multi-task workflows, which also include multimodal data, optimizing their performance through optional human input and iterative learning. We demonstrate the ability of AI agents to bridge the gap between advanced automation and user-friendly operation, paving the way for more adaptable and intelligent scientific facilities.