vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

BLAS for Mac

Browse source 
Specifying that BLAS is already supported on Macs using the Accelerate Framework.
This commit is contained in:
DaniAndTheWeb 2023-04-26 01:33:25 +02:00 • committed by GitHub
parent 2ff156d463
commit b6904cc79f
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 5 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

6
README.md
View file

@ -194,7 +194,11 @@ Note: For Windows, CMake or Zig can be used.
#### BLAS Build
Building the program with BLAS support may lead to some performance improvements in prompt processing using batch sizes higher than 32 (the default is 512). BLAS doesn't affect the prompt generation. There are currently two different implementations of it:
Building the program with BLAS support may lead to some performance improvements in prompt processing using batch sizes higher than 32 (the default is 512). BLAS doesn't affect the prompt generation. There are currently three different implementations of it:
- Accelerate Framework
This is only available on Mac PCs and it's enabled by default. You can just build using the normal instructions.
- OpenBLAS