llama : refactor sampling v2 (#9294)

Browse source

- Add `struct llama_sampler` and `struct llama_sampler_i`
- Add `llama_sampler_` API
- Add `llama_sampler_chain_` API for chaining multiple samplers
- Remove `LLAMA_API_INTERNAL`
- Add `llama_perf_` API and remove old `llama_print_timings` and `llama_reset_timings`

...

This commit is contained in:

Georgi Gerganov 2024-09-07 15:16:19 +03:00 • committed by GitHub

parent 947538acb8

commit df270ef745

No known key found for this signature in database

GPG key ID: B5690EEEBB952194

48 changed files with 3497 additions and 2914 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

1400

src/llama-sampling.cpp

View file

File diff suppressed because it is too large Load diff