ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoning

TL;DR

ML-Master is an innovative AI-for-AI agent that effectively combines exploration and reasoning using a memory mechanism, leading to significant performance improvements in automated AI system development within strict time limits.

Contribution

The paper introduces ML-Master, a novel AI4AI agent that integrates exploration and reasoning through a memory mechanism, enhancing efficiency and performance in AI system design.

Findings

Achieves a 29.3% average medal rate on MLE-Bench.

Outperforms existing methods, especially in medium-complexity tasks.

Completes tasks within 12 hours, half the time of previous baselines.

Abstract

As AI capabilities advance toward and potentially beyond human-level performance, a natural transition emerges where AI-driven development becomes more efficient than human-centric approaches. A promising pathway toward this transition lies in AI-for-AI (AI4AI), which leverages AI techniques to automate and optimize the design, training, and deployment of AI systems themselves. While LLM-based agents have shown the potential to realize AI4AI, they are often unable to fully leverage the experience accumulated by agents during the exploration of solutions in the reasoning process, leading to inefficiencies and suboptimal performance. To address this limitation, we propose ML-Master, a novel AI4AI agent that seamlessly integrates exploration and reasoning by employing a selectively scoped memory mechanism. This approach allows ML-Master to efficiently combine diverse insights from parallel solution trajectories with analytical reasoning, guiding further exploration without overwhelming the agent with excessive context. We evaluate ML-Master on the MLE-Bench, where it achieves a 29.3% average medal rate, significantly surpassing existing methods, particularly in medium-complexity tasks, while accomplishing this superior performance within a strict 12-hour time constraint-half the 24-hour limit used by previous baselines. These results demonstrate ML-Master's potential as a powerful tool for advancing AI4AI.