vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

server : add_special option for tokenize endpoint (#7059)

Browse source
This commit is contained in:
Johan 2024-05-08 14:27:58 +02:00 • committed by GitHub
parent ad211edef5
commit 911b3900dd
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 48 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/server/README.md
View file

@ -331,7 +331,7 @@ Notice that each `probs` is an array of length `n_probs`.
`content`: Set the text to tokenize.
Note that a special `BOS` token is never inserted.
`add_special`: Boolean indicating if special tokens, i.e. `BOS`, should be inserted. Default: `false`
- **POST** `/detokenize`: Convert tokens to text.