vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

chore: resolve comments

Browse source
This commit is contained in:
vodkaslime 2023-11-20 00:40:45 +08:00
parent 34a9ef6c6c
commit 5d21a82786
No known key found for this signature in database
GPG key ID: 62BE927A8F526C6F
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
README.md
View file

@ -214,7 +214,7 @@ cd llama.cpp
### Build ### Build
In order to build llama.cpp you have different options. In order to build llama.cpp you have three different options.
- Using `make`: - Using `make`:
- On Linux or MacOS: - On Linux or MacOS:
@ -320,7 +320,7 @@ mpirun -hostfile hostfile -n 3 ./main -m ./models/7B/ggml-model-q4_0.gguf -n 128
### BLAS Build ### BLAS Build
Building the program with BLAS support may lead to some performance improvements in prompt processing using batch sizes higher than 32 (the default is 512). BLAS doesn't affect the normal generation performance. There are currently various different implementations of it: Building the program with BLAS support may lead to some performance improvements in prompt processing using batch sizes higher than 32 (the default is 512). BLAS doesn't affect the normal generation performance. There are currently several different implementations of it:
- #### Accelerate Framework: - #### Accelerate Framework: