Skip to content

Commit

Permalink
Create execution_modes.rst
Browse files Browse the repository at this point in the history
  • Loading branch information
Delaunay authored Aug 1, 2024
1 parent 2586e65 commit 8d48221
Showing 1 changed file with 38 additions and 0 deletions.
38 changes: 38 additions & 0 deletions docs/execution_modes.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
Plan
====

* ``per_gpu``: used for mono gpu benchmarks, spawn one process per gpu and run the same benchmark

.. code-block:: yaml
_torchvision:
inherits: _defaults
definition: ../benchmarks/torchvision
group: torchvision
install_group: torch
plan:
method: per_gpu
* ``njobs``: used to launch a single jobs that can see all the gpus.

.. code-block:: yaml
_torchvision_ddp:
inherits: _defaults
definition: ../benchmarks/torchvision_ddp
group: torchvision
install_group: torch
plan:
method: njobs
n: 1
Milabench processes overview
----------------------------

* milabench main process
* gather metrics

* milabench launches a new benchmark process
* milabench launch monitoring processes
* torchrun will launch one process per GPU

0 comments on commit 8d48221

Please sign in to comment.