ASCL.net

Astrophysics Source Code Library

Making codes discoverable since 1999

ASCL Code Record

[ascl:2412.002] Stimela2: Workflow management framework for data reduction workflows

Stimela2 develops data reduction workflows and is a significant update of Stimela (ascl:2305.007). Though designed for radio astronomy data, it can be adapted for other data processing applications. Stimela2 represents workflows by linear, concise and intuitive YAML-format "recipes". Atomic data reduction tasks (binary executables, Python functions and code, and CASA tasks) are described by YAML-format "cab definitions" detailing each task's "schema" (inputs and outputs). Stimela2 provides a rich syntax for chaining tasks together, and encourages a high degree of modularity: recipes may be nested into other recipes, and configuration is cleanly separated from recipe logic. Tasks can be executed natively or in isolated environments using containerization technologies such as Apptainer. Stimela2 facilitates the deployment of scalable, distributed workflows by interfacing with the Slurm scheduler and the Kubernetes API, the latter allowing workflows to be readily deployed in the cloud.

Code site:
https://github.com/caracal-pipeline/stimela https://stimela.readthedocs.io
Used in:
https://ui.adsabs.harvard.edu/abs/2024MNRAS.528.6517S
Described in:
https://ui.adsabs.harvard.edu/abs/2024arXiv241210080S
Bibcode:
2024ascl.soft12002S

Views: 163

ascl:2412.002
Add this shield to your page
Copy the above HTML to add this shield to your code's website.