vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

fixed bug where kv_self.size is being set wrongly to the buffer size instead of the context size

Browse source
This commit is contained in:
l3utterfly 2023-10-03 03:23:42 +08:00
parent 9476b01226
commit 7d14b33981
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
llama.cpp
View file

@ -7276,7 +7276,7 @@ size_t llama_set_state_data(struct llama_context * ctx, uint8_t * src) {
}
ctx->kv_self.head = kv_ntok;
ctx->kv_self.size = kv_size;
ctx->kv_self.size = n_ctx;
}
const size_t nread = inp - src;