An advanced AI driven database system

TL;DR

This paper introduces an AI-driven database system that leverages natural language processing and machine learning to simplify data management, automate schema creation, and improve usability for non-expert users.

Contribution

It presents a novel AI-supported database system integrating LLMs and advanced algorithms for automated schema inference, query generation, and performance optimization.

Findings

Automates schema inference and query generation.

Reduces need for technical database skills.

Enhances usability with NLP-based interfaces.

Abstract

Contemporary database systems, while effective, suffer severe issues related to complexity and usability, especially among individuals who lack technical expertise but are unfamiliar with query languages like Structured Query Language (SQL). This paper presents a new database system supported by Artificial Intelligence (AI), which is intended to improve the management of data using natural language processing (NLP) - based intuitive interfaces, and automatic creation of structured queries and semi-structured data formats like yet another markup language (YAML), java script object notation (JSON), and application program interface (API) documentation. The system is intended to strengthen the potential of databases through the integration of Large Language Models (LLMs) and advanced machine learning algorithms. The integration is purposed to allow the automation of fundamental tasks such as data modeling, schema creation, query comprehension, and performance optimization. We present in this paper a system that aims to alleviate the main problems with current database technologies. It is meant to reduce the need for technical skills, manual tuning for better performance, and the potential for human error. The AI database employs generative schema inference and format selection to build its schema models and execution formats.