FinDeepForecast: A Live Multi-Agent System for Benchmarking Deep Research Agents in Financial Forecasting

TL;DR

FinDeepForecast is a live multi-agent system that continuously evaluates deep research agents' financial forecasting abilities across global markets, highlighting their strengths and limitations in real-world research tasks.

Contribution

This paper introduces FinDeepForecast, the first live, end-to-end system for benchmarking deep research agents in financial forecasting with a dynamic, research-oriented evaluation framework.

Findings

DR agents outperform baselines but lack genuine forward-looking reasoning

The system generates diverse, research-oriented financial forecasting tasks

A comprehensive weekly benchmark over multiple economies and companies

Abstract

Deep Research (DR) Agents powered by advanced Large Language Models (LLMs) have fundamentally shifted the paradigm for completing complex research tasks. Yet, a comprehensive and live evaluation of their forecasting performance on real-world, research-oriented tasks in high-stakes domains (e.g., finance) remains underexplored. We introduce FinDeepForecast, the first live, end-to-end multi-agent system for automatically evaluating DR agents by continuously generating research-oriented financial forecasting tasks. This system is equipped with a dual-track taxonomy, enabling the dynamic generation of recurrent and non-recurrent forecasting tasks at both corporate and macro levels. With this system, we generate FinDeepForecastBench, a weekly evaluation benchmark over a ten-week horizon, encompassing 8 global economies and 1,314 listed companies, and evaluate 13 representative methods. Extensive experiments show that, while DR agents consistently outperform strong baselines, their performance still falls short of genuine forward-looking financial reasoning. We expect the proposed FinDeepForecast system to consistently facilitate future advancements of DR agents in research-oriented financial forecasting tasks. The benchmark and leaderboard are publicly available on the OpenFinArena Platform.