MaRGen: Multi-Agent LLM Approach for Self-Directed Market Research and Analysis

TL;DR

MaRGen is an autonomous multi-agent system leveraging LLMs to automate comprehensive market research, report generation, and iterative quality improvement, significantly reducing time and cost while maintaining high report quality.

Contribution

This work introduces a multi-agent LLM framework with a novel evaluation and iterative improvement system for automated market report generation.

Findings

Generates detailed reports in 7 minutes at about $1 cost

Achieves high report quality aligned with human expert evaluations

Improves report quality through automated review cycles

Abstract

We present an autonomous framework that leverages Large Language Models (LLMs) to automate end-to-end business analysis and market report generation. At its core, the system employs specialized agents - Researcher, Reviewer, Writer, and Retriever - that collaborate to analyze data and produce comprehensive reports. These agents learn from real professional consultants' presentation materials at Amazon through in-context learning to replicate professional analytical methodologies. The framework executes a multi-step process: querying databases, analyzing data, generating insights, creating visualizations, and composing market reports. We also introduce a novel LLM-based evaluation system for assessing report quality, which shows alignment with expert human evaluations. Building on these evaluations, we implement an iterative improvement mechanism that optimizes report quality through automated review cycles. Experimental results show that report quality can be improved by both automated review cycles and consultants' unstructured knowledge. In experimental validation, our framework generates detailed 6-page reports in 7 minutes at a cost of approximately \$1. Our work could be an important step to automatically create affordable market insights.