From 2a37bd6b860013902825b40ffcf9321d3a874d93 Mon Sep 17 00:00:00 2001 From: Pierrick HYMBERT Date: Wed, 21 Feb 2024 02:29:50 +0100 Subject: [PATCH] server: tests: fix the multi users infinite loop test --- examples/server/tests/features/server.feature | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/examples/server/tests/features/server.feature b/examples/server/tests/features/server.feature index 44c676303..8bafbc39b 100644 --- a/examples/server/tests/features/server.feature +++ b/examples/server/tests/features/server.feature @@ -98,7 +98,12 @@ Feature: llama.cpp server """ Write a very long poem. """ - And 1024 max tokens to predict + And a prompt: + """ + Write a very long joke. + """ + And 512 max tokens to predict + And a user api key llama.cpp Given concurrent completion requests Then the server is busy And all slots are busy