From 2f25ee30ef3087b1e7ae1917b7542ff3ed4311b2 Mon Sep 17 00:00:00 2001 From: ochafik Date: Fri, 27 Sep 2024 07:18:07 +0100 Subject: [PATCH] Update README.md --- examples/agent/README.md | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/examples/agent/README.md b/examples/agent/README.md index 631ab140e..1b8a318ea 100644 --- a/examples/agent/README.md +++ b/examples/agent/README.md @@ -14,17 +14,21 @@
Instructions for NousResearch/Hermes-2-Pro-Llama-3-8B (needs template override) + The HF model had two variants for its chat template (`default` and `tool_use`), but the GGUF only retained the `default` one. + ```bash ./llama-server \ --jinja -fa \ -mu https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-8B-Q8_0.gguf \ --chat-template-file tests/chat/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja ``` +` +
Instructions for meekai/functionary-small-v3.2 (needs template override) - The template in the GGUF doesn't seem to support tool calls, but its bigger brother's template can be used: + The template in the GGUF doesn't support tool calls, but its bigger brother's template can be used: ```bash ./llama-server \