Skip to content

Commit

Permalink
[Bugfix][Doc] Fix Doc Formatting (vllm-project#6048)
Browse files Browse the repository at this point in the history
  • Loading branch information
ywang96 authored Jul 1, 2024
1 parent 83bdcb6 commit 8e0817c
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/source/serving/faq.rst
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
Frequently Asked Questions
========================
===========================

Q: How can I serve multiple models on a single port using the OpenAI API?

Expand All @@ -9,4 +9,4 @@ A: Assuming that you're referring to using OpenAI compatible server to serve mul

Q: Which model to use for offline inference embedding?

A: If you want to use an embedding model, try: https://huggingface.co/intfloat/e5-mistral-7b-instruct. Instead models, such as Llama-3-8b, Mistral-7B-Instruct-v0.3, are generation models rather than an embedding model
A: If you want to use an embedding model, try: https://huggingface.co/intfloat/e5-mistral-7b-instruct. Instead models, such as Llama-3-8b, Mistral-7B-Instruct-v0.3, are generation models rather than an embedding model

0 comments on commit 8e0817c

Please sign in to comment.