Skip to content

Commit

Permalink
Documentation changes
Browse files Browse the repository at this point in the history
  • Loading branch information
vgf89 committed Mar 26, 2024
1 parent a7525e2 commit fc0dac9
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 1 deletion.
6 changes: 6 additions & 0 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,12 @@ To run Tabby locally with ROCm (AMD):
cargo run --features rocm serve --model TabbyML/StarCoder-1B --device rocm
```

To run Tabby locally with Vulkan:

```
cargo run --features vulkan serve --model TabbyML/StarCoder-1B --device vulkan
```

To run Tabby locally with Metal (Apple M1/M2):

```
Expand Down
7 changes: 6 additions & 1 deletion website/docs/installation/windows/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,8 @@ Running Tabby on Windows using Tabby's exe distribution.

## 2. Download the release
* If you are using a CPU-only system, download the **tabby_x86_64-windows-msvc.exe file**.
* If you are using a GPU-enabled system, download the **tabby_x86_64-windows-msvc-cuda117.exe** file, In this example, we assume you are using CUDA 11.7.
* If you are using an Nvidia GPU, download the **tabby_x86_64-windows-msvc-cuda117.exe** file, In this example, we assume you are using CUDA 11.7.
* If you are using a different GPU with Vulkan support, download the **tabby_x86_64-windows-msvc-vulkan.exe** file.

**Tips:**
* Download the CUDA Toolkit from Nvidia: https://developer.nvidia.com/cuda-toolkit
Expand All @@ -27,6 +28,10 @@ Open a command prompt or PowerShell window in the directory where you downloaded
```
.\tabby_x86_64-windows-msvc-cuda117.exe serve --model StarCoder-1B --device cuda
```
or
```
.\tabby_x86_64-windows-msvc-vulkan.exe serve --model StarCoder-1B --device vulkan
```
You should see the following output if the command runs successfully:
![Windows running output](./status.png)

Expand Down

0 comments on commit fc0dac9

Please sign in to comment.