vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

infill : add new example + extend server API (#3296)

Browse source 
* vvhg-code-infill (#1)

* infill in separate example (#2)

* reverted changes to main and added infill example

* cleanup

* naming improvement

* make : add missing blank line

* fix missing semicolon

* brought infill up to current main code

* cleanup

---------

Co-authored-by: Cebtenzzre <cebtenzzre@gmail.com>
This commit is contained in:
vvhg1 2023-10-02 09:42:02 +02:00 • committed by GitHub
parent f5ef5cfb18
commit c97f01c362
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
11 changed files with 1067 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

10
examples/server/README.md
View file

@ -176,6 +176,16 @@ node index.js
`content`: Set the text to process.
**POST** `/infill`: For code infilling. Takes a prefix and a suffix and returns the predicted completion as stream.
*Options:*
`input_prefix`: Set the prefix of the code to infill.
`input_suffix`: Set the suffix of the code to infill.
It also accepts all the options of `/completion` except `stream` and `prompt`.
## More examples
### Interactive mode