Viash: from scripts to pipelines

TL;DR

Viash is a tool that enhances bioinformatics pipeline development by enabling modular, reusable components through code generation and separation of concerns, facilitating collaboration and reducing maintenance overhead.

Contribution

Introduces Viash, a novel tool for creating pipeline components that are decoupled from pipeline logic, improving reusability and collaboration in bioinformatics workflows.

Findings

Applied in diverse projects, including international data science competitions

Enabled rapid development of robust, modular pipelines

Improved component reusability and collaboration

Abstract

Most bioinformatics pipelines consist of software components that are tightly coupled to the logic of the pipeline itself. This limits reusability of the individual components in the pipeline or introduces maintenance overhead when they need to be reimplemented in multiple pipelines. We introduce Viash, a tool for speeding up development of robust pipelines through "code-first" prototyping, separation of concerns and code generation of modular pipeline components. By decoupling the component functionality from the pipeline logic, component functionality becomes fully pipeline-agnostic, and conversely the resulting pipelines are agnostic towards specific component requirements. This separation of concerns improves reusability of components and facilitates multidisciplinar and pan-organisational collaborations. It has been applied in a variety of projects, from proof-of-concept pipelines to supporting an international data science competition. Viash is available as an open-source project at https://github.com/viash-io/viash and documentation is available at https://viash.io.