vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server : test script : add timeout for all requests (#9282)

Browse source
This commit is contained in:
Xuan Son Nguyen 2024-09-02 22:08:38 +02:00 • committed by GitHub
parent f1485161e5
commit 48baa61ecc
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 20 additions and 20 deletions
Download patch file Download diff file Expand all files Collapse all files

4
examples/server/tests/features/parallel.feature
View file

@ -52,8 +52,8 @@ Feature: Parallel
Then all prompts are predicted with <n_predict> tokens
Examples:
| streaming | n_predict |
| disabled | 200 |
| enabled | 200 |
| disabled | 128 |
| enabled | 64 |
Scenario Outline: Multi users OAI completions compatibility no v1
Given a system prompt You are a writer.