vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server : fix extra BOS in infill endpoint (#11106)

Browse source 
* server : fix extra BOS in infill endpoing

ggml-ci

* server : update infill tests
This commit is contained in:
Georgi Gerganov 2025-01-06 15:36:08 +02:00 • committed by GitHub
parent 09186fabbe
commit e6e7c75d94
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/server/tests/unit/test_infill.py
View file

@ -18,7 +18,7 @@ def test_infill_without_input_extra():
"input_suffix": "}\n",
})
assert res.status_code == 200
assert match_regex("(Ann|small|shiny)+", res.body["content"])
assert match_regex("(Ann|small|shiny|Daddy)+", res.body["content"])
def test_infill_with_input_extra():