vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server: tests: check for infinite loops

Browse source
This commit is contained in:
Pierrick HYMBERT 2024-02-20 22:49:36 +01:00
parent 367b59a15c
commit b9f8390d28
1 changed files with 1 additions and 9 deletions
Download patch file Download diff file Expand all files Collapse all files

10
examples/server/tests/features/server.feature
View file

@ -54,10 +54,6 @@ Feature: llama.cpp server
It was her greeting to Prince Vassily, a man high in rank It was her greeting to Prince Vassily, a man high in rank
and office, who was the first to arrive at her soirée. and office, who was the first to arrive at her soirée.
""" """
And a prompt:
"""
Write another very long music lyrics.
"""
Given concurrent completion requests Given concurrent completion requests
Then the server is busy Then the server is busy
And all slots are busy And all slots are busy
@ -69,7 +65,7 @@ Feature: llama.cpp server
Scenario: Multi users OAI Compatibility Scenario: Multi users OAI Compatibility
Given a system prompt "You are an AI assistant." Given a system prompt "You are an AI assistant."
And a model tinyllama-2 And a model tinyllama-2
And 512 max tokens to predict And 1024 max tokens to predict
And streaming is enabled And streaming is enabled
Given a prompt: Given a prompt:
""" """
@ -79,10 +75,6 @@ Feature: llama.cpp server
""" """
Write another very long music lyrics. Write another very long music lyrics.
""" """
And a prompt:
"""
I believe the meaning of life is
"""
Given concurrent OAI completions requests Given concurrent OAI completions requests
Then the server is busy Then the server is busy
And all slots are busy And all slots are busy