A Proposed End-To-End Principle for Data Commons

TL;DR

This paper proposes the narrow middle architecture as a design principle for data commons, emphasizing interoperability and core services based on the end-to-end argument in systems design.

Contribution

It introduces the end-to-end inspired narrow middle architecture as a new design principle for data commons and discusses essential core services and standards.

Findings

The proposed architecture enhances interoperability in data commons.

Core services are crucial for effective data sharing and analysis.

Standards play a key role in implementing the architecture.

Abstract

A data commons brings together (or co-locates) data with cloud computing infrastructure and commonly used software services, tools and applications for managing, analyzing and sharing data to create an interoperable resource for a research community. We introduce an architectural design principle for data commons called the narrow middle architecture that is broadly based upon the end-to-end argument in systems design. We also discuss important core services for data commons and the role of standards.