Skip to content

A Python 3 library for automatically running experiments using a Slurm cluster

License

Notifications You must be signed in to change notification settings

Kasekopf/SlurmQueen

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

87 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SlurmQueen

A Python 3 library for automatically running experiments on a black-box tool using a Slurm cluster. In particular, this harness allows you to:

  1. Define an experiment by declaring a list of tasks to run on a tool.
  2. Generate bash scripts that run each task.
  3. Run those bash scripts on a Slurm cluster and download the results.
  4. Analyze the results through an SQL interface.

See this jupyter notebook for detailed usage.

Installation

For most users, the recommended method to install is via pip:

pip install slurmqueen

Dependencies:

  • paramiko
  • pandas
  • pathlib (included in Python 3.4 or higher)
  • ipywidgets (optional)
  • notebook (required to run the example notebook)

See requirements.txt for detailed version information, if needed.

About

A Python 3 library for automatically running experiments using a Slurm cluster

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published