vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server: tests: check for infinite loops

Browse source
This commit is contained in:
Pierrick HYMBERT 2024-02-20 22:49:36 +01:00
parent 367b59a15c
commit b9f8390d28
1 changed files with 1 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

10
examples/server/tests/features/server.feature
View file

@ -54,10 +54,6 @@ Feature: llama.cpp server
It was her greeting to Prince Vassily, a man high in rank
and office, who was the first to arrive at her soirée.
"""
And a prompt:
"""
Write another very long music lyrics.
"""
Given concurrent completion requests
Then the server is busy
And all slots are busy
@ -69,7 +65,7 @@ Feature: llama.cpp server
Scenario: Multi users OAI Compatibility
Given a system prompt "You are an AI assistant."
And a model tinyllama-2
And 512 max tokens to predict
And 1024 max tokens to predict
And streaming is enabled
Given a prompt:
"""
@ -79,10 +75,6 @@ Feature: llama.cpp server
"""
Write another very long music lyrics.
"""
And a prompt:
"""
I believe the meaning of life is
"""
Given concurrent OAI completions requests
Then the server is busy
And all slots are busy