vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

examples : add readme files

Browse source
This commit is contained in:
Georgi Gerganov 2023-11-29 11:00:17 +02:00
parent 4fea3420ee
commit 1f5cd83275
No known key found for this signature in database
GPG key ID: 449E073F9DC10735
2 changed files with 15 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
examples/speculative/README.md Normal file
View file

@ -0,0 +1,8 @@
# llama.cpp/examples/speculative
Demonstartion of speculative decoding and tree-based speculative decoding techniques
More info:
- https://github.com/ggerganov/llama.cpp/pull/2926
- https://github.com/ggerganov/llama.cpp/pull/3624