Text2Insight: Transform natural language text into insights seamlessly using multi-model architecture

TL;DR

Text2Insight is a multi-model architecture system that converts natural language queries into customized data insights and visualizations, integrating SQL generation, visualization prediction, and predictive analytics for user-centric data analysis.

Contribution

It introduces a novel multi-model framework that seamlessly transforms natural language into tailored data insights and visualizations, combining SQL conversion, visualization prediction, and predictive analytics.

Findings

Achieves 99% accuracy in transforming natural language to insights

High precision and recall in data analysis tasks

Effective integration of multiple models for dynamic visualization

Abstract

The growing demand for dynamic, user-centric data analysis and visualization is evident across domains like healthcare, finance, and research. Traditional visualization tools often fail to meet individual user needs due to their static and predefined nature. To address this gap, Text2Insight is introduced as an innovative solution that delivers customized data analysis and visualizations based on user-defined natural language requirements. Leveraging a multi-model architecture, Text2Insight transforms user inputs into actionable insights and dynamic visualizations. The methodology begins with analyzing the input dataset to extract structural details such as columns and values. A pre-trained Llama3 model converts the user's natural language query into an SQL query, which is further refined using a Named Entity Recognition (NER) model for accuracy. A chart predictor determines the most suitable visualization type, while the Llama3 model generates insights based on the SQL query's results. The output is a user-friendly and visually informative chart. To enhance analysis capabilities, the system integrates a question-answering model and a predictive model using the BERT framework. These models provide insights into historical data and predict future trends. Performance evaluation of Text2Insight demonstrates its effectiveness, achieving high accuracy (99%), precision (100%), recall (99%), and F1-score (99%), with a BLEU score of 0.5. The question-answering model attained an accuracy of 89% and the predictive model achieved 70% accuracy. These results validate Text2Insight as a robust and viable solution for transforming natural language text into dynamic, user-specific data analysis and visualizations.