vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update README.md

Browse source
This commit is contained in:
ochafik 2024-09-27 07:15:25 +01:00
parent e62b5de3cf
commit 86e4f99092
1 changed files with 11 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

12
examples/agent/README.md
View file

@ -12,7 +12,17 @@
``` ```
<details> <details>
<summary>Instructions for meekai/functionary-small-v3.2 (experimental)</summary> <summary>Instructions for NousResearch/Hermes-2-Pro-Llama-3-8B (needs template override)</summary>
```bash
./llama-server \
--jinja -fa \
-mu https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-8B-Q8_0.gguf \
--chat-template-file tests/chat/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja
```
<details>
<summary>Instructions for meekai/functionary-small-v3.2 (needs template override)</summary>
The template in the GGUF doesn't seem to support tool calls, but its bigger brother's template can be used: The template in the GGUF doesn't seem to support tool calls, but its bigger brother's template can be used: