Skip to content

Commit

Permalink
Updated docs
Browse files Browse the repository at this point in the history
  • Loading branch information
ctuning-admin committed Apr 10, 2024
1 parent 7c918fc commit 29cdfd1
Show file tree
Hide file tree
Showing 2 changed files with 34 additions and 2 deletions.
29 changes: 28 additions & 1 deletion cm-mlops/script/app-loadgen-generic-python/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,10 @@ Developers: [Gaz Iqbal](https://www.linkedin.com/in/gaziqbal), [Arjun Suresh](ht

#### Input Flags

* --**modelpath**=Full path to a model
* --**modelpath**=Full path to file with model weights
* --**modelcodepath**=(for PyTorch models) Full path to file with model code and cmc.py
* --**modelcfgpath**=(for PyTorch models) Full path to JSON file with model cfg
* --**modelsamplepath**=(for PyTorch models) Full path to file with model sample in pickle format
* --**ep**=ONNX Execution provider
* --**scenario**=MLPerf LoadGen scenario
* --**samples**=Number of samples (*2*)
Expand Down Expand Up @@ -201,7 +204,13 @@ ___
* `--execmode=value` → `CM_MLPERF_EXEC_MODE=value`
* `--interop=value` → `CM_MLPERF_INTEROP=value`
* `--intraop=value` → `CM_MLPERF_INTRAOP=value`
* `--loadgen_duration_sec=value` → `CM_MLPERF_LOADGEN_DURATION_SEC=value`
* `--loadgen_expected_qps=value` → `CM_MLPERF_LOADGEN_EXPECTED_QPS=value`
* `--modelcfg=value` → `CM_ML_MODEL_CFG=value`
* `--modelcfgpath=value` → `CM_ML_MODEL_CFG_WITH_PATH=value`
* `--modelcodepath=value` → `CM_ML_MODEL_CODE_WITH_PATH=value`
* `--modelpath=value` → `CM_ML_MODEL_FILE_WITH_PATH=value`
* `--modelsamplepath=value` → `CM_ML_MODEL_SAMPLE_WITH_PATH=value`
* `--output_dir=value` → `CM_MLPERF_OUTPUT_DIR=value`
* `--runner=value` → `CM_MLPERF_RUNNER=value`
* `--samples=value` → `CM_MLPERF_LOADGEN_SAMPLES=value`
Expand Down Expand Up @@ -241,6 +250,8 @@ ___
- CM script: [get-python3](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-python3)
* get,generic-python-lib,_psutil
- CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
* get,generic-python-lib,_package.numpy
- CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
* get,cuda
* `if (CM_MLPERF_DEVICE == gpu)`
- CM script: [get-cuda](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-cuda)
Expand All @@ -259,6 +270,22 @@ ___
* `if (CM_MLPERF_BACKEND == onnxruntime)`
* CM names: `--adr.['onnx']...`
- CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
* get,generic-python-lib,_torch
* `if (CM_MLPERF_BACKEND == pytorch AND CM_MLPERF_DEVICE == cpu)`
* CM names: `--adr.['torch']...`
- CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
* get,generic-python-lib,_torchvision
* `if (CM_MLPERF_BACKEND == pytorch AND CM_MLPERF_DEVICE == cpu)`
* CM names: `--adr.['torchvision']...`
- CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
* get,generic-python-lib,_torch_cuda
* `if (CM_MLPERF_BACKEND == pytorch AND CM_MLPERF_DEVICE == gpu)`
* CM names: `--adr.['torch']...`
- CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
* get,generic-python-lib,_torchvision_cuda
* `if (CM_MLPERF_BACKEND == pytorch AND CM_MLPERF_DEVICE == gpu)`
* CM names: `--adr.['torchvision']...`
- CM script: [get-generic-python-lib](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-generic-python-lib)
* get,ml-model,resnet50,_onnx
* `if (CM_MODEL == resnet50)`
- CM script: [get-ml-model-resnet50](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-resnet50)
Expand Down
7 changes: 6 additions & 1 deletion cm-mlops/script/get-mlperf-inference-loadgen/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -213,5 +213,10 @@ ___
* `+DYLD_FALLBACK_LIBRARY_PATH`
* `+LD_LIBRARY_PATH`
* `+PYTHONPATH`
* `CM_MLPERF_INFERENCE_LOADGEN_VERSION`
* `CM_MLPERF_INFERENCE_LOADGEN_*`
#### New environment keys auto-detected from customize

* `CM_MLPERF_INFERENCE_LOADGEN_INCLUDE_PATH`
* `CM_MLPERF_INFERENCE_LOADGEN_INSTALL_PATH`
* `CM_MLPERF_INFERENCE_LOADGEN_LIBRARY_PATH`
* `CM_MLPERF_INFERENCE_LOADGEN_PYTHON_PATH`

0 comments on commit 29cdfd1

Please sign in to comment.