Webinar 2022 More Options for Solving Jobs with Many Tasks

From SHARCNETHelp
Jump to navigationJump to search

This webinar will provide a high level comparison of the available tools on Compute Canada systems for submitting jobs that consist of many tasks including: Job Arrays, GNU Parallel, GLOST and META. In particular it will highlight the many benefits of using the META approach. The type of jobs suitable for each of tool will be explained. In addition their ability to conduct parameter sweeps over one or more variables of an equation or design space will be considered. Finally examples of how to bundle tasks into a single job for submission to the SLURM scheduler will be demonstrated.