vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server: bench: doc add an option to debug http request

Browse source
This commit is contained in:
Pierrick HYMBERT 2024-03-09 09:55:11 +01:00
parent 572758a665
commit 06e225f843
1 changed files with 2 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/server/bench/README.md
View file

@ -62,6 +62,8 @@ Or with [k6 options](https://k6.io/docs/using-k6/k6-options/reference/):
SERVER_BENCH_N_PROMPTS=500 k6 run script.js --duration 10m --iterations 500 --vus 8
```
To [debug http request](https://k6.io/docs/using-k6/http-debugging/) use `--http-debug="full"`
#### Metrics
Following metrics are available computed from the OAI chat completions response `usage`: