Skip to content

Commit

Permalink
ci(test_api_server): update port
Browse files Browse the repository at this point in the history
Signed-off-by: Xin Liu <[email protected]>
  • Loading branch information
apepkuss committed Nov 4, 2024
1 parent 47a710c commit 48d6e48
Show file tree
Hide file tree
Showing 4 changed files with 7 additions and 7 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/test_api_server.yml
Original file line number Diff line number Diff line change
Expand Up @@ -90,7 +90,7 @@ jobs:
- name: Start rag-api-server for testing chat completions
run: |
nohup $HOME/.wasmedge/bin/wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2-1.5B-Instruct-Q3_K_M.gguf --nn-preload embedding:GGML:AUTO:nomic-embed-text-v1.5-f16.gguf rag-api-server.wasm --model-name Qwen2-1.5B-Instruct,nomic-embed-text-v1.5 --ctx-size 4096,512 --batch-size 16,512 --prompt-template chatml,embedding --rag-policy last-user-message --socket-addr 0.0.0.0:8080 > ./start-llamaedge.log 2>&1 &
nohup $HOME/.wasmedge/bin/wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2-1.5B-Instruct-Q3_K_M.gguf --nn-preload embedding:GGML:AUTO:nomic-embed-text-v1.5-f16.gguf rag-api-server.wasm --model-name Qwen2-1.5B-Instruct,nomic-embed-text-v1.5 --ctx-size 4096,512 --batch-size 16,512 --prompt-template chatml,embedding --rag-policy last-user-message --socket-addr 0.0.0.0:9069 > ./start-llamaedge.log 2>&1 &
sleep 10
cat start-llamaedge.log
Expand Down
6 changes: 3 additions & 3 deletions tests/test_chat.hurl
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# test /v1/models endpoint
GET http://localhost:8080/v1/models
GET http://localhost:9069/v1/models
screencapability: low
HTTP 200
[Asserts]
jsonpath "$.data[0].id" == "Qwen2-1.5B-Instruct"

# test /v1/chat/completions endpoint
POST http://localhost:8080/v1/chat/completions
POST http://localhost:9069/v1/chat/completions

Check failure on line 9 in tests/test_chat.hurl

View workflow job for this annotation

GitHub Actions / test-api-server (0.14.1)

HTTP connection
Accept: application/json
Content-Type: application/json
```json
Expand All @@ -29,7 +29,7 @@ jsonpath "$.choices[0].message.content" contains "Paris"

# test /v1/chat/completions endpoint
# Test purpose: The model name is incorrect
POST http://localhost:8080/v1/chat/completions
POST http://localhost:9069/v1/chat/completions
Accept: application/json
Content-Type: application/json
```json
Expand Down
4 changes: 2 additions & 2 deletions tests/test_embeddings.hurl
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@

# test /v1/embeddings endpoint
POST http://localhost:8080/v1/embeddings
POST http://localhost:9069/v1/embeddings
Accept: application/json
Content-Type: application/json
```json
Expand All @@ -27,7 +27,7 @@ jsonpath "$.data" count > 0

# test /v1/embeddings endpoint
# Test purpose: The model name is incorrect
POST http://localhost:8080/v1/embeddings
POST http://localhost:9069/v1/embeddings
Accept: application/json
Content-Type: application/json
```json
Expand Down
2 changes: 1 addition & 1 deletion tests/test_rag.hurl
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@

# test /v1/chat/completions endpoint
POST http://localhost:8080/v1/chat/completions
POST http://localhost:9069/v1/chat/completions
Accept: application/json
Content-Type: application/json
```json
Expand Down

0 comments on commit 48d6e48

Please sign in to comment.