Skip to content

Commit

Permalink
Remove suggested model list from UI blurb
Browse files Browse the repository at this point in the history
  • Loading branch information
sd109 committed Jan 23, 2024
1 parent 9078b71 commit a9aff5d
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions chart/templates/NOTES.txt
Original file line number Diff line number Diff line change
Expand Up @@ -7,5 +7,4 @@ On deployment of a new model, the app must first download the model's weights fr
This can take a significant amount of time depending on model choice and network speeds.
Download progress can be monitored by inspecting the logs for the LLM API pod(s) via the Kubernetes Dashboard for the target cluster.

The app use [vLLM](https://docs.vllm.ai/en/latest/) as a model serving backend and [gradio](https://github.com/gradio-app/gradio) as a web interface. The official list of Huggingface models supported by vLLM can be found [here](https://docs.vllm.ai/en/latest/models/supported_models.html). Some suggested models to try include:
- ise-uiuc/Magicoder-S-DS-6.7B
The app use [vLLM](https://docs.vllm.ai/en/latest/) as a model serving backend and [gradio](https://github.com/gradio-app/gradio) as a web interface. The official list of Huggingface models supported by vLLM can be found [here](https://docs.vllm.ai/en/latest/models/supported_models.html).

0 comments on commit a9aff5d

Please sign in to comment.