Videos

James Corbett - Flux: a next generation resource manager for HPC and beyond - IPAM at UCLA

Presenter
May 5, 2023
Abstract
Recorded 05 May 2023. James Corbett of Lawrence Livermore National Laboratory presents "Flux: a next generation resource manager for HPC and beyond" at IPAM's workshop for Complex Scientific Workflows at Extreme Computational Scales. Abstract: Flux is a next-generation resource manager that has been in development at LLNL for a decade. It is currently deployed on a handful of small clusters at LLNL, and is the planned resource manager for the El Capitan supercomputer. Flux offers numerous advantages over older resource managers like Slurm, LSF, and PBSPro. Among other things, Flux offers fully-featured scheduling; a standardized interface; feature-rich Python, Lua, and C libraries for submitting and monitoring jobs; and the ability to launch Flux within the resource allocations of other resource managers, or of Flux itself. The advantages of Flux and the ease with which it can be built and started have led many user-led successes at LLNL and other sites. Learn more online at: hhttp://www.ipam.ucla.edu/programs/workshops/workshop-iii-complex-scientific-workflows-at-extreme-computational-scales/