server: tests: fix the multi users infinite loop test
This commit is contained in:
parent
469af4b4ec
commit
2a37bd6b86
1 changed files with 6 additions and 1 deletions
|
@ -98,7 +98,12 @@ Feature: llama.cpp server
|
||||||
"""
|
"""
|
||||||
Write a very long poem.
|
Write a very long poem.
|
||||||
"""
|
"""
|
||||||
And 1024 max tokens to predict
|
And a prompt:
|
||||||
|
"""
|
||||||
|
Write a very long joke.
|
||||||
|
"""
|
||||||
|
And 512 max tokens to predict
|
||||||
|
And a user api key llama.cpp
|
||||||
Given concurrent completion requests
|
Given concurrent completion requests
|
||||||
Then the server is busy
|
Then the server is busy
|
||||||
And all slots are busy
|
And all slots are busy
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue