From b58b1f4bf6d5f7a4086d39fe269fbc06857cbf4f Mon Sep 17 00:00:00 2001 From: Georgi Gerganov Date: Fri, 12 May 2023 00:00:40 +0300 Subject: [PATCH] readme : add note that Q4 and Q5 have been changed --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 396e3be65..8bc051c6b 100644 --- a/README.md +++ b/README.md @@ -9,8 +9,8 @@ Inference of [LLaMA](https://arxiv.org/abs/2302.13971) model in pure C/C++ **Hot topics:** +- Qauntization formats `Q4` and `Q5` have changed - requantize any old models [(info)](https://github.com/ggerganov/llama.cpp/pull/1405) - [Roadmap May 2023](https://github.com/ggerganov/llama.cpp/discussions/1220) -- [New quantization methods](https://github.com/ggerganov/llama.cpp#quantization)
Table of Contents