Skip to content

Commit

Permalink
Changes cpu-affinity to off when running DLIO for training for consis…
Browse files Browse the repository at this point in the history
…tency
  • Loading branch information
ilumsden committed Aug 20, 2024
1 parent dd80d1d commit 70943ff
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -378,7 +378,7 @@
"metadata": {},
"outputs": [],
"source": [
"!flux run -N {num_nodes} -o cpu-affinity=on --tasks-per-node={workers_per_node} --env-file=dlio_env.txt \\\n",
"!flux run -N {num_nodes} -o cpu-affinity=off --tasks-per-node={workers_per_node} --env-file=dlio_env.txt \\\n",
" dlio_benchmark --config-dir={dlio_extensions_dir}/configs workload={workload} \\\n",
" ++workload.dataset.data_folder={initial_data_directory} ++workload.workflow.generate_data=False \\\n",
" ++workload.workflow.train=True\n",
Expand Down

0 comments on commit 70943ff

Please sign in to comment.