From b0b6d83c76856bb04a9a0e5260bd4c004b4919b1 Mon Sep 17 00:00:00 2001 From: Pierrick HYMBERT Date: Tue, 20 Feb 2024 23:17:00 +0100 Subject: [PATCH] server: tests: add infinite loop scenario --- examples/server/tests/features/server.feature | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/examples/server/tests/features/server.feature b/examples/server/tests/features/server.feature index 681025cf5..77e8b9088 100644 --- a/examples/server/tests/features/server.feature +++ b/examples/server/tests/features/server.feature @@ -42,7 +42,7 @@ Feature: llama.cpp server """ Write another very long music lyrics. """ - And 256 max tokens to predict + And 32 max tokens to predict Given concurrent completion requests Then the server is busy And all slots are busy @@ -62,7 +62,7 @@ Feature: llama.cpp server """ Write another very long music lyrics. """ - And 256 max tokens to predict + And 32 max tokens to predict And streaming is enabled Given concurrent OAI completions requests Then the server is busy