vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Apply suggestions from code review

Browse source 
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
This commit is contained in:
Henri Vasserman 2023-06-08 22:17:46 +03:00 • committed by GitHub
parent 61befcba7b
commit ccd85e0a6b
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/server/README.md
View file

@ -37,7 +37,7 @@ To get started right away, run the following command, making sure to use the cor
server.exe -m models\7B\ggml-model.bin -c 2048 server.exe -m models\7B\ggml-model.bin -c 2048
``` ```
That will start a server that by default listens on `127.0.0.1:8080`. The above command will start a server that by default listens on `127.0.0.1:8080`.
You can consume the endpoints with Postman or NodeJS with axios library. You can consume the endpoints with Postman or NodeJS with axios library.
## Testing with CURL ## Testing with CURL

2
examples/server/chat.mjs
View file

@ -25,7 +25,7 @@ async function ChatCompletion(question) {
top_p: 0.9, top_p: 0.9,
n_keep: 29, n_keep: 29,
n_predict: 256, n_predict: 256,
stop: ["\n### Human:"], // when detect this, stop completion stop: ["\n### Human:"], // stop completion after generating this
stream: true, stream: true,
}) })
}) })