vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

examples : utilize new llama_get_logits_ith()

Browse source
This commit is contained in:
Georgi Gerganov 2023-09-28 16:05:37 +03:00
parent 4c72ab13b2
commit d008733e6b
No known key found for this signature in database
GPG key ID: 449E073F9DC10735
3 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/common.cpp
View file

@ -905,7 +905,7 @@ llama_token llama_sample_token(
llama_token id = 0;
float * logits = llama_get_logits(ctx) + idx * n_vocab;
float * logits = llama_get_logits_ith(ctx, idx);
// Apply params.logit_bias map
for (auto it = params.logit_bias.begin(); it != params.logit_bias.end(); it++) {