crew.aws.batch

CRANcrew.aws.batchMaRDI QIDQ5976117FDOQ5976117

A Crew Launcher Plugin for AWS Batch

William Michael Landau

Last update: 8 February 2024

Copyright license: MIT license, File License

Software version identifier: 0.0.1, 0.0.4, 0.0.5

Description

In computationally demanding analysis projects, statisticians and data scientists asynchronously deploy long-running tasks to distributed systems, ranging from traditional clusters to cloud services. The 'crew.aws.batch' package extends the 'mirai'-powered 'crew' package with a worker launcher plugin for AWS Batch. Inspiration also comes from packages 'mirai' by Gao (2023) <https://github.com/shikokuchuo/mirai>, 'future' by Bengtsson (2021) <doi:10.32614/RJ-2021-048>, 'rrq' by FitzJohn and Ashton (2023) <https://github.com/mrc-ide/rrq>, 'clustermq' by Schubert (2019) <doi:10.1093/bioinformatics/btz284>), and 'batchtools' by Lang, Bischl, and Surmann (2017). <doi:10.21105/joss.00135>.

Cites work

• A Unifying Framework for Parallel and Distributed Processing in R using Futures
• clustermq enables efficient parallelization of genomic analyses
• batchtools: Tools for R to work on batch systems

This page was built for software: crew.aws.batch