From 8d48221129fc00e68b06d956c088be2a1afc88c2 Mon Sep 17 00:00:00 2001 From: Setepenre Date: Thu, 1 Aug 2024 09:40:52 -0400 Subject: [PATCH] Create execution_modes.rst --- docs/execution_modes.rst | 38 ++++++++++++++++++++++++++++++++++++++ 1 file changed, 38 insertions(+) create mode 100644 docs/execution_modes.rst diff --git a/docs/execution_modes.rst b/docs/execution_modes.rst new file mode 100644 index 000000000..4318130d6 --- /dev/null +++ b/docs/execution_modes.rst @@ -0,0 +1,38 @@ +Plan +==== + +* ``per_gpu``: used for mono gpu benchmarks, spawn one process per gpu and run the same benchmark + +.. code-block:: yaml + + _torchvision: + inherits: _defaults + definition: ../benchmarks/torchvision + group: torchvision + install_group: torch + plan: + method: per_gpu + +* ``njobs``: used to launch a single jobs that can see all the gpus. + +.. code-block:: yaml + + _torchvision_ddp: + inherits: _defaults + definition: ../benchmarks/torchvision_ddp + group: torchvision + install_group: torch + plan: + method: njobs + n: 1 + + +Milabench processes overview +---------------------------- + +* milabench main process + * gather metrics + +* milabench launches a new benchmark process + * milabench launch monitoring processes + * torchrun will launch one process per GPU