vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

update readme

Browse source
This commit is contained in:
caitianchi 2025-01-16 14:16:38 +08:00
parent 52c6abe0df
commit c69f9baf2b
1 changed files with 4 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

7
examples/llava/README-minicpmo2.6.md
View file

@ -25,11 +25,12 @@ python ./convert_hf_to_gguf.py ../MiniCPM-o-2_6/model
./llama-quantize ../MiniCPM-o-2_6/model/ggml-model-f16.gguf ../MiniCPM-o-2_6/model/ggml-model-Q4_K_M.gguf Q4_K_M ./llama-quantize ../MiniCPM-o-2_6/model/ggml-model-f16.gguf ../MiniCPM-o-2_6/model/ggml-model-Q4_K_M.gguf Q4_K_M
``` ```
Build for Linux or Mac Build llama.cpp using `CMake`:
https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md
```bash ```bash
make cmake -B build
make llama-minicpmv-cli cmake --build build --config Release
``` ```
Inference on Linux or Mac Inference on Linux or Mac