Preprint Review Version 1 Preserved in Portico This version is not peer-reviewed

Approaches for Containerized Scientific Workflows in Cloud Environments with Applications in Life Science

Version 1 : Received: 30 January 2020 / Approved: 31 January 2020 / Online: 31 January 2020 (05:15:01 CET)

How to cite: Spjuth, O.; Capuccini, M.; Carone, M.; Larsson, A.; Schaal, W.; Novella, J.A.; Stein, O.; Ekmefjord, M.; Di Tommaso, P.; Floden, E.; Notredame, C.; Moreno, P.; Emami Khoonsari, P.; Herman, S.; Kultima, K.; Lampa, S. Approaches for Containerized Scientific Workflows in Cloud Environments with Applications in Life Science. Preprints 2020, 2020010378. https://doi.org/10.20944/preprints202001.0378.v1 Spjuth, O.; Capuccini, M.; Carone, M.; Larsson, A.; Schaal, W.; Novella, J.A.; Stein, O.; Ekmefjord, M.; Di Tommaso, P.; Floden, E.; Notredame, C.; Moreno, P.; Emami Khoonsari, P.; Herman, S.; Kultima, K.; Lampa, S. Approaches for Containerized Scientific Workflows in Cloud Environments with Applications in Life Science. Preprints 2020, 2020010378. https://doi.org/10.20944/preprints202001.0378.v1

Abstract

Containers are gaining popularity in life science research as they provide a solution for encompassing dependencies of provisioned tools, simplify software installations for end users and offer a form of isolation between processes. Scientific workflows are ideal for chaining containers into data analysis pipelines to aid in creating reproducible analyses. In this manuscript we review a number of approaches to using containers as implemented in the workflow tools Nextflow, Galaxy, Pachyderm, Argo, Kubeflow, Luigi and SciPipe, when deployed in cloud environments. A particular focus is placed on the workflow tool’s interaction with the Kubernetes container orchestration framework.

Supplementary and Associated Material

https://doi.org/10.7287/peerj.preprints.27141v1: Previous version of this preprint

Keywords

workflows; containers; cloud computing; Kubernetes; big data; reproducibility

Subject

Computer Science and Mathematics, Mathematical and Computational Biology

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.