Dynamic Knowledge Exchange and Dual-diversity Review: Concisely Unleashing the Potential of a Multi-Agent Research Team

TL;DR

This paper introduces IDVSCI, a multi-agent LLM framework with dynamic knowledge exchange and dual-diversity review, enhancing autonomous scientific discovery through interactive reasoning and heterogeneous evaluation, outperforming existing systems.

Contribution

The paper presents a novel multi-agent framework with dynamic knowledge exchange and dual-diversity review, improving reasoning and evaluation in LLM-based scientific research.

Findings

IDVSCI outperforms existing systems like AI Scientist and VIRSCI.

The approach improves reasoning depth and idea creativity.

Effective across computer science and health sciences datasets.

Abstract

Scientific progress increasingly relies on effective collaboration among researchers, a dynamic that large language models (LLMs) have only begun to emulate. While recent LLM-based scientist agents show promise in autonomous scientific discovery, they often lack the interactive reasoning and evaluation mechanisms essential to real-world research. We propose IDVSCI (Internal Discussion and Vote SCIentists), a multi-agent framework built on LLMs that incorporates two key innovations: a Dynamic Knowledge Exchange mechanism enabling iterative feedback among agents, and a Dual-Diversity Review paradigm that simulates heterogeneous expert evaluation. These components jointly promote deeper reasoning and the generation of more creative and impactful scientific ideas. To evaluate the effectiveness and generalizability of our approach, we conduct experiments on two datasets: a widely used benchmark in computer science and a new dataset we introduce in the health sciences domain. Results show that IDVSCI consistently achieves the best performance across both datasets, outperforming existing systems such as AI Scientist and VIRSCI. These findings highlight the value of modeling interaction and peer review dynamics in LLM-based autonomous research.