vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

(try) fix test

Browse source
This commit is contained in:
Xuan Son Nguyen 2024-09-02 13:36:18 +02:00
parent 24329aac1e
commit 31a2d4a4a8
2 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

4
examples/server/tests/features/parallel.feature
View file

@ -52,8 +52,8 @@ Feature: Parallel
Then all prompts are predicted with <n_predict> tokens Then all prompts are predicted with <n_predict> tokens
Examples: Examples:
| streaming | n_predict | | streaming | n_predict |
| disabled | 128 | | disabled | 200 |
| enabled | 64 | | enabled | 200 |
Scenario Outline: Multi users OAI completions compatibility no v1 Scenario Outline: Multi users OAI completions compatibility no v1
Given a system prompt You are a writer. Given a system prompt You are a writer.

2
examples/server/tests/features/steps/steps.py
View file

@ -818,7 +818,7 @@ async def concurrent_requests(context, f_completion, *args, **kwargs):
for prompt_no in range(context.n_prompts): for prompt_no in range(context.n_prompts):
shifted_args = [context.prompts.pop(), seeds[prompt_no], *args] shifted_args = [context.prompts.pop(), seeds[prompt_no], *args]
context.concurrent_tasks.append(asyncio.create_task(f_completion(*shifted_args, **kwargs))) context.concurrent_tasks.append(asyncio.create_task(f_completion(*shifted_args, **kwargs)))
await asyncio.sleep(0.1) await asyncio.sleep(0.01)
@step('the slot {slot_id:d} is saved with filename "{filename}"') @step('the slot {slot_id:d} is saved with filename "{filename}"')