vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

fixed a bug with token timings, updated lite

Browse source
This commit is contained in:
Concedo 2023-06-20 20:41:42 +08:00
parent c5ae3f50a7
commit 537ff22ec9
2 changed files with 4 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

1
gpttype_adapter.cpp
View file

@ -1265,6 +1265,7 @@ generation_outputs gpttype_generate(const generation_inputs inputs, generation_o
if(unbanTokens && id==eosID) if(unbanTokens && id==eosID)
{ {
stopper_unused_tokens = remaining_tokens;
printf("\n(EOS token triggered!)"); printf("\n(EOS token triggered!)");
remaining_tokens = 0; remaining_tokens = 0;
} }

6
klite.embd
View file

File diff suppressed because one or more lines are too long