vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server: tests: embeddings, use different KV Cache size

Browse source
This commit is contained in:
Pierrick HYMBERT 2024-03-06 21:03:26 +01:00
parent 36e12f8fd3
commit ec6ba3bff1
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/server/tests/features/embeddings.feature
View file

@ -9,7 +9,7 @@ Feature: llama.cpp server
And 42 as server seed And 42 as server seed
And 2 slots And 2 slots
And 1024 as batch size And 1024 as batch size
And 1024 KV cache size And 4096 KV cache size
And embeddings extraction And embeddings extraction
Then the server is starting Then the server is starting
Then the server is healthy Then the server is healthy