Pipeline-Centric Provenance Model

TL;DR

This paper introduces a pipeline-centric provenance model tailored for workflow-based applications, demonstrating its benefits in reducing storage needs, with a focus on astronomy use cases and general applicability.

Contribution

The paper presents a novel provenance model specifically designed for pipeline workflows, expanding its relevance beyond astronomy and evaluating storage efficiency.

Findings

Reduced storage requirements for provenance data

Effective for astronomy workflow applications

Applicable to a broader class of workflow-based systems

Abstract

In this paper we propose a new provenance model which is tailored to a class of workflow-based applications. We motivate the approach with use cases from the astronomy community. We generalize the class of applications the approach is relevant to and propose a pipeline-centric provenance model. Finally, we evaluate the benefits in terms of storage needed by the approach when applied to an astronomy application.