Skip to content

Commit

Permalink
Update amd-installation.md
Browse files Browse the repository at this point in the history
  • Loading branch information
johnnynunez authored Dec 24, 2024
1 parent 9e42b53 commit f853174
Showing 1 changed file with 4 additions and 5 deletions.
9 changes: 4 additions & 5 deletions docs/source/getting_started/amd-installation.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ vLLM supports AMD GPUs with ROCm 6.3.

- OS: Linux
- Python: 3.9 -- 3.12
- GPU: MI200s (gfx90a), MI300 (gfx942), Radeon RX 7900 series (gfx1100)
- GPU: MI200s (gfx90a), MI300 (gfx942), Radeon Pro, Radeon RX 7900 series (gfx1100)
- ROCm 6.3

Installation options:
Expand Down Expand Up @@ -83,7 +83,7 @@ Where the `<path/to/model>` is the location where the model is stored, for examp
- [ROCm](https://rocm.docs.amd.com/en/latest/deploy/linux/index.html)
- [PyTorch](https://pytorch.org/)

For installing PyTorch, you can start from a fresh docker image, e.g, `rocm/pytorch:rocm6.3_ubuntu20.04_py3.9_pytorch_release_2.4.0`, `rocm/pytorch-nightly`.
For installing PyTorch, you can start from a fresh docker image, e.g, `rocm/pytorch:rocm6.3_ubuntu24.04_py3.12_pytorch_release_2.4.0`, `rocm/pytorch-nightly`.

Alternatively, you can install PyTorch using PyTorch wheels. You can check PyTorch installation guide in PyTorch [Getting Started](https://pytorch.org/get-started/locally/)

Expand All @@ -94,9 +94,9 @@ Install ROCm's Triton flash attention (the default triton-mlir branch) following
```console
$ python3 -m pip install ninja cmake wheel pybind11
$ pip uninstall -y triton
$ git clone https://github.com/OpenAI/triton.git
$ git clone https://github.com/triton-lang/triton
$ cd triton
$ git checkout e192dba
$ git checkout release/3.2.x
$ cd python
$ pip3 install .
$ cd ../..
Expand All @@ -116,7 +116,6 @@ For example, for ROCm 6.3, suppose your gfx arch is `gfx90a`. To get your gfx ar
```console
$ git clone https://github.com/ROCm/flash-attention.git
$ cd flash-attention
$ git checkout 3cea2fb
$ git submodule update --init
$ GPU_ARCHS="gfx90a" python3 setup.py install
$ cd ..
Expand Down

0 comments on commit f853174

Please sign in to comment.