vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Allow passing grammar to completion endpoint (#2532)

Browse source 
* Allow passing grammar to completion endpoint
This commit is contained in:
Martin Krasser 2023-08-08 15:29:19 +02:00 • committed by GitHub
parent acfc5478ff
commit f5bfea0580
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 61 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/server/README.md
View file

@ -151,6 +151,8 @@ node .
`mirostat_eta`: Set the Mirostat learning rate, parameter eta (default: 0.1).
`grammar`: Set grammar for grammar-based sampling (default: no grammar)
`seed`: Set the random number generator (RNG) seed (default: -1, -1 = random seed).
`ignore_eos`: Ignore end of stream token and continue generating (default: false).