SiriusBI: A Comprehensive LLM-Powered Solution for Data Analytics in Business Intelligence

TL;DR

SiriusBI is an innovative LLM-powered business intelligence system that enhances functionality, interaction, and cross-domain adaptability, significantly improving SQL accuracy and reducing query time in real-world enterprise settings.

Contribution

The paper introduces SiriusBI, a comprehensive BI system with multi-module architecture, multi-round dialogue, and data-conditioned SQL generation, addressing key industrial deployment challenges of LLM-based BI solutions.

Findings

Achieves over 93% SQL generation accuracy.

Reduces data analysts' query time from minutes to seconds.

Demonstrates effectiveness on real-world datasets and benchmarks.

Abstract

With the proliferation of Large Language Models (LLMs) in Business Intelligence (BI), existing solutions face critical challenges in industrial deployments: functionality deficiencies from legacy systems failing to meet evolving LLM-era user demands, interaction limitations from single-round SQL generation paradigms inadequate for multi-round clarification, and cost for domain adaptation arising from cross-domain methods migration. We present SiriusBI, a practical LLM-powered BI system addressing the challenges of industrial deployments through three key innovations: (a) An end-to-end architecture integrating multi-module coordination to overcome functionality gaps in legacy systems; (b) A multi-round dialogue with querying mechanism, consisting of semantic completion, knowledge-guided clarification, and proactive querying processes, to resolve interaction constraints in SQL generation; (c) A data-conditioned SQL generation method selection strategy that supports both an efficient one-step Fine-Tuning approach and a two-step method leveraging Semantic Intermediate Representation for low-cost cross-domain applications. Experiments on both real-world datasets and public benchmarks demonstrate the effectiveness of SiriusBI. User studies further confirm that SiriusBI enhances both productivity and user experience. As an independent service on Tencent's data platform, SiriusBI is deployed across finance, advertising, and cloud sectors, serving dozens of enterprise clients. It achieves over 93% accuracy in SQL generation and reduces data analysts' query time from minutes to seconds in real-world applications.