Tempest Workflows

Job Arrays

Job arrays can be used to launch multiple jobs at the same time. This can be useful for processing multiple datasets or doing parameter sweeps on complex jobs.

• Slurm Job Array Example

Dependency Jobs

Dependency jobs can be used to launch jobs after the completion of another job. This can be applied to workflows that require multiple different jobs with different resource amounts where order of operation is imperative.

• Slurm Dependency Jobs Example

Data Transfers

Data transfers onto Tempest can be done with the web file interface or SCP, but for larger data we recommend using Globus. Globus is a software that can be used as a web interface or in code that can be used in Tempest jobs.

• Globus Web Interface Documentation
• Globus Command Line Interface (CLI)
• Globus Python SDK

Domain-Specific Workflows

• CryoEM