FinSphere, a Real-Time Stock Analysis Agent Powered by Instruction-Tuned LLMs and Domain Tools

TL;DR

FinSphere is a novel AI stock analysis agent that combines real-time data, domain tools, and instruction-tuned LLMs to generate professional-grade insights, supported by a new evaluation framework and expert-curated dataset.

Contribution

The paper introduces FinSphere, a comprehensive system with a new evaluation metric and dataset, significantly improving stock analysis quality of LLM-based agents.

Findings

FinSphere outperforms existing models and systems in stock analysis tasks.

The Asseyscore framework effectively evaluates analysis quality.

The Stocksis dataset enhances LLMs' analytical capabilities.

Abstract

Current financial large language models (FinLLMs) struggle with two critical limitations: the absence of objective evaluation metrics to assess the quality of stock analysis reports and a lack of depth in stock analysis, which impedes their ability to generate professional-grade insights. To address these challenges, this paper introduces FinSphere, a stock analysis agent, along with three major contributions: (1) AnalyScore, a systematic evaluation framework for assessing stock analysis quality, (2) Stocksis, a dataset curated by industry experts to enhance LLMs' stock analysis capabilities, and (3) FinSphere, an AI agent that can generate high-quality stock analysis reports in response to user queries. Experiments demonstrate that FinSphere achieves superior performance compared to both general and domain-specific LLMs, as well as existing agent-based systems, even when they are enhanced with real-time data access and few-shot guidance. The integrated framework, which combines real-time data feeds, quantitative tools, and an instruction-tuned LLM, yields substantial improvements in both analytical quality and practical applicability for real-world stock analysis.