vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server: tests: fix the multi users infinite loop test

Browse source
This commit is contained in:
Pierrick HYMBERT 2024-02-21 02:29:50 +01:00
parent 469af4b4ec
commit 2a37bd6b86
1 changed files with 6 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

7
examples/server/tests/features/server.feature
View file

@ -98,7 +98,12 @@ Feature: llama.cpp server
"""
Write a very long poem.
"""
And 1024 max tokens to predict
And a prompt:
"""
Write a very long joke.
"""
And 512 max tokens to predict
And a user api key llama.cpp
Given concurrent completion requests
Then the server is busy
And all slots are busy