Skip to content

Commit

Permalink
dyad: changes cpu-affinity for DLIO
Browse files Browse the repository at this point in the history
This commit changes cpu-affinity to off when running DLIO for
training for consistency
  • Loading branch information
ilumsden committed Aug 21, 2024
1 parent e777fd2 commit 075be85
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -378,7 +378,7 @@
"metadata": {},
"outputs": [],
"source": [
"!flux run -N {num_nodes} -o cpu-affinity=on --tasks-per-node={workers_per_node} --env-file=dlio_env.txt \\\n",
"!flux run -N {num_nodes} -o cpu-affinity=off --tasks-per-node={workers_per_node} --env-file=dlio_env.txt \\\n",
" dlio_benchmark --config-dir={dlio_extensions_dir}/configs workload={workload} \\\n",
" ++workload.dataset.data_folder={initial_data_directory} ++workload.workflow.generate_data=False \\\n",
" ++workload.workflow.train=True\n",
Expand Down Expand Up @@ -490,7 +490,7 @@
"3. Deep Learning I/O (DLIO) benchmark\n",
"4. Accelerating distributed DL training\n",
"\n",
"To continue with the tutorial, open [Module 4](./04_flux_tutorial_conclusions.ipynb)"
"<!--To continue with the tutorial, open [Module 4](./04_flux_tutorial_conclusions.ipynb)-->"
]
},
{
Expand Down

0 comments on commit 075be85

Please sign in to comment.