vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

updating readme for instructions for compilation and use

Browse source
This commit is contained in:
Aniket 2023-08-08 13:52:20 -04:00
parent ff9fae57d1
commit 2a0138e5ea
1 changed files with 13 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

13
examples/convert-llama2c-to-ggml/README.md Normal file
View file

@ -0,0 +1,13 @@
## Convert llama2.c model to ggml
This example reads weights from project [llama2.c](https://github.com/karpathy/llama2.c) and saves them in ggml compatible format.
To convert the model first download the models from the [llma2.c](https://github.com/karpathy/llama2.c) repository:
`$ make -j`
`$ ./convert-llama2c-to-ggml --vocab-model <ggml-vocab.bin> --llama2c-model <llama2.c model path> --llama2c-output-model <ggml output model path>`
Now you can use the model with command:
`$ ./main -m <ggml output model path> -p "One day, Lily met a Shoggoth" -n 500 -c 256 -eps 1e-5`