Exploring the use of AI authors and reviewers at Agents4Science

TL;DR

This paper discusses the first conference where AI agents acted as both authors and reviewers alongside humans, exploring their capabilities and implications for future scientific collaboration.

Contribution

It introduces Agents4Science, a novel conference format where AI agents serve as primary authors and reviewers, highlighting insights into human-AI scientific collaboration.

Findings

AI agents can effectively serve as scientific authors and reviewers

Human-AI collaboration in science shows promising potential

Key challenges and opportunities for AI in scientific peer review

Abstract

There is growing interest in using AI agents for scientific research, yet fundamental questions remain about their capabilities as scientists and reviewers. To explore these questions, we organized Agents4Science, the first conference in which AI agents serve as both primary authors and reviewers, with humans as co-authors and co-reviewers. Here, we discuss the key learnings from the conference and their implications for human-AI collaboration in science.