vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server: tests: use ngxson llama_xs_q4.bin

Browse source
This commit is contained in:
Pierrick HYMBERT 2024-02-19 23:05:06 +01:00
parent 30aa323fb9
commit fe9866a52d
2 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

4
.github/workflows/server-test.yml vendored
View file

@ -40,12 +40,12 @@ jobs:
- name: Download test model - name: Download test model
id: download_model id: download_model
run: | run: |
./scripts/hf.sh --repo TheBloke/Tinyllama-2-1b-miniguanaco-GGUF --file tinyllama-2-1b-miniguanaco.Q2_K.gguf ./scripts/hf.sh --repo ngxson/dummy-llama --file llama_xs_q4.bin
- name: Server Integration Tests - name: Server Integration Tests
id: server_integration_test id: server_integration_test
run: | run: |
cd examples/server/tests cd examples/server/tests
./tests.sh ../../../tinyllama-2-1b-miniguanaco.Q2_K.gguf ./tests.sh ../../../llama_xs_q4.bin

2
examples/server/tests/README.md
View file

@ -7,5 +7,5 @@ Functional server tests suite.
### Run tests ### Run tests
1. Build the server 1. Build the server
2. download a GGUF model: `../../../scripts/hf.sh --repo TheBloke/Tinyllama-2-1b-miniguanaco-GGUF --file tinyllama-2-1b-miniguanaco.Q2_K.gguf` 2. download a GGUF model: `../../../scripts/hf.sh --repo ngxson/dummy-llama --file llama_xs_q4.bin`
3. Start the test: `./tests.sh tinyllama-2-1b-miniguanaco.Q2_K.gguf -ngl 23 --log-disable` 3. Start the test: `./tests.sh tinyllama-2-1b-miniguanaco.Q2_K.gguf -ngl 23 --log-disable`