vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Introduce llama-run (#10291)

Browse source 
It's like simple-chat but it uses smart pointers to avoid manual
memory cleanups. Less memory leaks in the code now. Avoid printing
multiple dots. Split code into smaller functions. Uses no exception
handling.

Signed-off-by: Eric Curtin <ecurtin@redhat.com>
This commit is contained in:
Eric Curtin 2024-11-25 16:56:24 -05:00 • committed by GitHub
parent 50d5cecbda
commit 0cc63754b8
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
7 changed files with 458 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

7
examples/run/README.md Normal file
View file

@ -0,0 +1,7 @@
# llama.cpp/example/run
The purpose of this example is to demonstrate a minimal usage of llama.cpp for running models.
```bash
./llama-run Meta-Llama-3.1-8B-Instruct.gguf
...