Data Migration using Datalog Program Synthesis

TL;DR

This paper introduces Dynamite, a tool that automatically synthesizes Datalog programs from examples to facilitate data migration across diverse schema types, demonstrating efficiency and versatility.

Contribution

It presents a novel method for schema mapping using Datalog program synthesis from examples, enabling flexible and efficient data migration.

Findings

Successfully applied to 28 real-world scenarios

Handles diverse schema transformations like relational to graph

Efficient synthesis leveraging Datalog semantics

Abstract

This paper presents a new technique for migrating data between different schemas. Our method expresses the schema mapping as a Datalog program and automatically synthesizes a Datalog program from simple input-output examples to perform data migration. This approach can transform data between different types of schemas (e.g., relational-to-graph, document-to-relational) and performs synthesis efficiently by leveraging the semantics of Datalog. We implement the proposed technique as a tool called Dynamite and show its effectiveness by evaluating Dynamite on 28 realistic data migration scenarios.