Skip to content

STNS01 19 Release BEEWorkflowManager and client

Jump to bottom
Tim Randles edited this page Mar 5, 2020 · 1 revision

Activity Description

Develop BEEWorkflowManager and client software.

The BEEWorkflowManager daemon runs on the HPC cluster login node. It accepts workflows submitted by the BEE client. These workflows are specified using the Common Workflow Language (CWL) standard. The BEEWorkflowManager loads workflows into the Neo4j graph database to create the workflow directed acyclic graph (DAG), and submits the workflow tasks to the BEETaskManager for execution. The BEEWorkflowManager records the state of the workflow and its tasks, and communicates this state to the BEE client. The BEEWorkflowManager will start, pause, and cancel a running workflow and its tasks at the command of the BEE client.

Activity Completion Criteria

This activity will be complete when the BEEWorkflowManager can successfully perform the following functionality on a production Slurm HPC Cluster at LANL.

  1. Accept a CWL workflow from the BEE client
  2. Load the CWL workflow into a Neo4j graph database
  3. Start/pause/cancel an active workflow
  4. Submit ready tasks to the BEETaskManager
  5. Report back to the BEE client the status of the submitted workflow and its tasks

Activity Due Date

March 31, 2020

Clone this wiki locally