Skip to content

Commit

Permalink
rm custom moe tune file. Add bash script for tuning reference (#305)
Browse files Browse the repository at this point in the history 
Since, rocm support has been added to the upstream tuning script, this PR removes the old custom tuning script "benchmark_mixtral_moe_rocm.py".
A bash script (moe_tune_script.sh) is also pushed as a reference on how to use the new tuning script for fp8 and fp16
  • Loading branch information
@divakar-amd
divakar-amd authored Dec 4, 2024
1 parent 1a17f0f commit 68fdfc2
Show file tree
Hide file tree
Showing 2 changed files with 33 additions and 454 deletions.
Loading

0 comments on commit 68fdfc2

Please sign in to comment.