vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Merge branch 'ggerganov-gg/tokenizer-cleanup' into refactor-tokenizer

Browse source
This commit is contained in:
zhenweijin 2024-09-20 18:48:58 +08:00
commit 8be5d11c0d
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/llama-vocab.h
View file

@ -139,4 +139,4 @@ int32_t llama_detokenize_impl(
char * text, char * text,
int32_t text_len_max, int32_t text_len_max,
bool remove_special, bool remove_special,
bool unparse_special); bool unparse_special);