TQL: Towards Type-Driven Data Discovery

TL;DR

TQL is a new query language that uses a type-like system to improve data discovery by making it more flexible and user-centric, leveraging programming language research insights.

Contribution

The paper introduces TQL, a type-driven query language that enhances data discovery capabilities with formal syntax, semantics, and implementation insights.

Findings

TQL offers greater expressive power than existing languages.

TQL's formal semantics enable reliable and flexible data queries.

Comparative analysis shows TQL's advantages in real-world scenarios.

Abstract

Existing query languages for data discovery exhibit system-driven designs that emphasize database features and functionality over user needs. We propose a re-prioritization of the client through an introduction of a language-driven approach to data discovery systems that can leverage powerful results from programming languages research. In this paper, we describe TQL, a flexible and practical query language which incorporates a type-like system to encompass downstream transformation-context in its discovery queries. The syntax and semantics of TQL (including the underlying evaluation model), are formally defined, and a sketch of its implementation is also provided. Additionally, we provide comparisons to existing languages for data retrieval and data discovery to examine the advantages of TQL's expanded expressive power in real-life settings.