server, tests : bump batch to fit 1 embedding prompt

2024-03-06 21:28:10 +02:00 · 2024-03-06 21:28:10 +02:00 · 36e12f8fd3
commit 36e12f8fd3
parent 79ef3c0585
1 changed files with 1 additions and 1 deletions
--- a/examples/server/tests/features/embeddings.feature
+++ b/examples/server/tests/features/embeddings.feature
@ -8,7 +8,7 @@ Feature: llama.cpp server
    And   a model alias bert-bge-small
    And   42 as server seed
    And   2 slots
-    And   512 as batch size
+    And   1024 as batch size
    And   1024 KV cache size
    And   embeddings extraction
    Then  the server is starting