From 0ac1dd8df79deab50f38641953c6ff735d3d9c69 Mon Sep 17 00:00:00 2001 From: Yuval Peled Date: Fri, 2 Jun 2023 15:33:41 +0300 Subject: [PATCH] add benchmarks --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 149aa3e24..4aa830aed 100644 --- a/README.md +++ b/README.md @@ -657,3 +657,4 @@ docker run -v /path/to/models:/models ghcr.io/ggerganov/llama.cpp:light -m /mode ### Docs - [GGML tips & tricks](https://github.com/ggerganov/llama.cpp/wiki/GGML-Tips-&-Tricks) +- [Performance troubleshooting](./docs/token_generation_performance_tips.md)