diff --git a/examples/agent/README.md b/examples/agent/README.md index e09541649..631ab140e 100644 --- a/examples/agent/README.md +++ b/examples/agent/README.md @@ -12,7 +12,17 @@ ```
- Instructions for meekai/functionary-small-v3.2 (experimental) + Instructions for NousResearch/Hermes-2-Pro-Llama-3-8B (needs template override) + + ```bash + ./llama-server \ + --jinja -fa \ + -mu https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-8B-Q8_0.gguf \ + --chat-template-file tests/chat/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja + ``` + +
+ Instructions for meekai/functionary-small-v3.2 (needs template override) The template in the GGUF doesn't seem to support tool calls, but its bigger brother's template can be used: