The SQL++ Query Language: Configurable, Unifying and Semi-structured

TL;DR

SQL++ is a formal, configurable query language that unifies and extends existing semi-structured data query languages, supporting JSON and SQL databases with formal semantics and practical validation.

Contribution

It introduces SQL++, a unifying, semi-structured query language with formal semantics, configurable options, and demonstrated applicability to multiple NoSQL and SQL databases.

Findings

SQL++ can describe MongoDB, Cassandra CQL, Couchbase N1QL, and AsterixDB AQL.

Version 4 of Couchbase N1QL is syntactic sugar over SQL++.

AsterixDB will support full SQL++ and Apache Drill aligns with it.

Abstract

NoSQL databases support semi-structured data, typically modeled as JSON. They also provide limited (but expanding) query languages. Their idiomatic, non-SQL language constructs, the many variations, and the lack of formal semantics inhibit deep understanding of the query languages, and also impede progress towards clean, powerful, declarative query languages. This paper specifies the syntax and semantics of SQL++, which is applicable to both JSON native stores and SQL databases. The SQL++ semi-structured data model is a superset of both JSON and the SQL data model. SQL++ offers powerful computational capabilities for processing semi-structured data akin to prior non-relational query languages, notably OQL and XQuery. Yet, SQL++ is SQL backwards compatible and is generalized towards JSON by introducing only a small number of query language extensions to SQL. Recognizing that a query language standard is probably premature for the fast evolving area of NoSQL databases, SQL++ includes configuration options that formally itemize the semantics variations that language designers may choose from. The options often pertain to the treatment of semi-structuredness (missing attributes, heterogeneous types, etc), where more than one sensible approaches are possible. SQL++ is unifying: By appropriate choices of configuration options, the SQL++ semantics can morph into the semantics of existing semi-structured database query languages. The extensive experimental validation shows how SQL and four semi-structured database query languages (MongoDB, Cassandra CQL, Couchbase N1QL and AsterixDB AQL) are formally described by appropriate settings of the configuration options. Early adoption signs of SQL++ are positive: Version 4 of Couchbase's N1QL is explained as syntactic sugar over SQL++. AsterixDB will soon support the full SQL++ and Apache Drill is in the process of aligning with SQL++.