vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
llama.cpp/.github/workflows
History
Pierrick Hymbert 75cd4c7729
ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response (#6495) 
* ci: bench: support sse and fix prompt processing time
server: add tokens usage in stream mode

* ci: bench: README.md EOL

* ci: bench: remove total pp and tg as it is not accurate

* ci: bench: fix case when there is no token generated

* ci: bench: change to the 95 percentile for pp and tg as it is closer to what the server exports in metrics

* ci: bench: fix finish reason rate
2024-04-06 05:40:47 +02:00
..
bench.yml ci: bench: support sse and fix prompt processing time / server: add tokens usage in stream OAI response (#6495) 2024-04-06 05:40:47 +02:00
build.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
close-issue.yml ci : close inactive issue, increase operations per run (#6270) 2024-03-24 10:57:06 +02:00
code-coverage.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
docker.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
editorconfig.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
gguf-publish.yml ci : update checkout, setup-python and upload-artifact to latest (#6456) 2024-04-03 21:01:13 +03:00
nix-ci-aarch64.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
nix-ci.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
nix-flake-update.yml ci: nix-flake-update: new token with pr permissions (#4879) 2024-01-11 17:22:34 +00:00
nix-publish-flake.yml workflows: nix-flakestry: drop tag filters 2023-12-31 13:14:58 -08:00
python-check-requirements.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
python-lint.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
server.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00
zig-build.yml ci: exempt master branch workflows from getting cancelled (#6486) 2024-04-04 18:30:53 +02:00