vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

fix: readme

Browse source
This commit is contained in:
Trần Đức Nam 2023-12-22 15:10:37 +07:00
parent 48cd819e64
commit 6fcdb07773
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
awqpy/README.md
View file

@ -48,7 +48,7 @@ python convert-hf-to-gguf.py models/llama-7b/ --awq-path awq_cache/llama-7b-w4-g
## Quantize ## Quantize
```bash ```bash
# For now I only benchmark and confirm the results on q4_0, q4_1 and q2_k types. # We only benchmark and confirm the results on q4_0, q4_1, and q2_k types.
./quantize models/llama_7b_fp16.gguf models/llama_7b_q4_0.gguf q4_0 ./quantize models/llama_7b_fp16.gguf models/llama_7b_q4_0.gguf q4_0
``` ```