llama.cpp

History

Christian Fillion 7ee953a64a llama : add llama_sampler_init for safe usage of llama_sampler_free (#11727 ) The C API in llama.h claims users can implement `llama_sampler_i` to create custom `llama_sampler`. The sampler chain takes ownership and calls `llama_sampler_free` on them. However, `llama_sampler_free` is hard-coded to use `delete`. This is undefined behavior if the object wasn't also allocated via `new` from libllama's C++ runtime. Callers in C and C-compatible languages do not use C++'s `new` operator. C++ callers may not be sharing the same heap as libllama.	2025-02-07 11:33:27 +02:00
..
llama-cpp.h	llama : add `llama_vocab`, functions -> methods, naming (#11110 )	2025-01-12 11:32:42 +02:00
llama.h	llama : add llama_sampler_init for safe usage of llama_sampler_free (#11727 )	2025-02-07 11:33:27 +02:00

Christian Fillion 7ee953a64a

llama : add llama_sampler_init for safe usage of llama_sampler_free (#11727 )

The C API in llama.h claims users can implement `llama_sampler_i` to
create custom `llama_sampler`. The sampler chain takes ownership and
calls `llama_sampler_free` on them. However, `llama_sampler_free` is
hard-coded to use `delete`. This is undefined behavior if the object
wasn't also allocated via `new` from libllama's C++ runtime. Callers
in C and C-compatible languages do not use C++'s `new` operator. C++
callers may not be sharing the same heap as libllama.

2025-02-07 11:33:27 +02:00

llama-cpp.h llama : add llama_vocab, functions -> methods, naming (#11110 ) 2025-01-12 11:32:42 +02:00

llama.h llama : add llama_sampler_init for safe usage of llama_sampler_free (#11727 ) 2025-02-07 11:33:27 +02:00