Skip to content

Commit

Permalink
ci(test_api_server): update workflow
Browse files Browse the repository at this point in the history
Signed-off-by: Xin Liu <[email protected]>
  • Loading branch information
apepkuss committed Sep 16, 2024
1 parent 84862c7 commit b0e2316
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions .github/workflows/test_api_server.yml
Original file line number Diff line number Diff line change
Expand Up @@ -73,18 +73,20 @@ jobs:
curl -LO https://huggingface.co/second-state/Qwen2-1.5B-Instruct-GGUF/resolve/main/Qwen2-1.5B-Instruct-Q3_K_M.gguf
curl -LO https://huggingface.co/second-state/Nomic-embed-text-v1.5-Embedding-GGUF/resolve/main/nomic-embed-text-v1.5-f16.gguf
- name: Start rag-api-server for testing chat completions
- name: Start rag-api-server
run: |
nohup $HOME/.wasmedge/bin/wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2-1.5B-Instruct-Q3_K_M.gguf --nn-preload embedding:GGML:AUTO:nomic-embed-text-v1.5-f16.gguf rag-api-server.wasm --model-name Qwen2-1.5B-Instruct,nomic-embed-text-v1.5 --ctx-size 4096,512 --batch-size 16,512 --prompt-template chatml,embedding --socket-addr 0.0.0.0:8080 > ./start-llamaedge.log 2>&1 &
sleep 10
sleep 5
cat start-llamaedge.log
- name: Run test_chat.hurl
run: |
sleep 5
hurl --test --jobs 1 ./tests/test_chat.hurl
- name: Run test_embeddings.hurl
run: |
sleep 5
hurl --test --jobs 1 ./tests/test_embeddings.hurl
- name: Stop rag-api-server for testing chat completions
Expand Down

0 comments on commit b0e2316

Please sign in to comment.