vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

llama : add simple-chat example (#10124)

Browse source 
* llama : add simple-chat example

---------

Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com>
This commit is contained in:
Diego Devesa 2024-11-01 23:50:59 +01:00 • committed by GitHub
parent e991e3127f
commit a6744e43e8
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
6 changed files with 220 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

7
examples/simple-chat/README.md Normal file
View file

@ -0,0 +1,7 @@
# llama.cpp/example/simple-chat
The purpose of this example is to demonstrate a minimal usage of llama.cpp to create a simple chat program using the chat template from the GGUF file.
```bash
./llama-simple-chat -m Meta-Llama-3.1-8B-Instruct.gguf -c 2048
...