vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Added support for 30B weight. (#108)

Browse source
This commit is contained in:
Trevor White 2023-03-21 18:34:01 -04:00 • committed by GitHub
parent 81bd894c51
commit c5ae5d08a5
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 14 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

14
README.md
View file

@ -45,6 +45,20 @@ Once you've downloaded the weights, you can run the following command to enter c
./chat -m ggml-alpaca-13b-q4.bin
```
## Getting Started (30B)
If you have more than 32GB of RAM (and a beefy CPU), you can use the higher quality 30B `alpaca-30B-ggml.bin` model. To download the weights, you can use
```
git clone https://huggingface.co/Pi3141/alpaca-30B-ggml
```
Once you've downloaded the weights, you can run the following command to enter chat
```
./chat -m ggml-model-q4_0.bin
```
## Building from Source (MacOS/Linux)