From 36e12f8fd35a9eaa0c12ee7d5a3105e396d8cd44 Mon Sep 17 00:00:00 2001 From: Georgi Gerganov Date: Wed, 6 Mar 2024 21:28:10 +0200 Subject: [PATCH] server, tests : bump batch to fit 1 embedding prompt --- examples/server/tests/features/embeddings.feature | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/examples/server/tests/features/embeddings.feature b/examples/server/tests/features/embeddings.feature index 50aaf0f9d..d02d3ace6 100644 --- a/examples/server/tests/features/embeddings.feature +++ b/examples/server/tests/features/embeddings.feature @@ -8,7 +8,7 @@ Feature: llama.cpp server And a model alias bert-bge-small And 42 as server seed And 2 slots - And 512 as batch size + And 1024 as batch size And 1024 KV cache size And embeddings extraction Then the server is starting