Updated build information
First update to the build instructions to include BLAS.
This commit is contained in:
parent
54bb60e268
commit
e2bb127fd8
1 changed files with 42 additions and 3 deletions
45
README.md
45
README.md
|
@ -167,15 +167,17 @@ cd llama.cpp
|
||||||
|
|
||||||
### Build
|
### Build
|
||||||
|
|
||||||
|
In order to build llama.cpp you have three different options.
|
||||||
|
|
||||||
Note: For Windows, CMake or Zig can be used.
|
Note: For Windows, CMake or Zig can be used.
|
||||||
|
|
||||||
1. Use `make`
|
- Using `make`
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
make
|
make
|
||||||
```
|
```
|
||||||
|
|
||||||
1. Use CMake
|
- Using CMake
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
mkdir build
|
mkdir build
|
||||||
|
@ -184,12 +186,49 @@ Note: For Windows, CMake or Zig can be used.
|
||||||
cmake --build . --config Release
|
cmake --build . --config Release
|
||||||
```
|
```
|
||||||
|
|
||||||
1. Use Zig
|
- Using Zig
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
zig build -Drelease-fast
|
zig build -Drelease-fast
|
||||||
```
|
```
|
||||||
|
|
||||||
|
BLAS acceleration is not enabled by default, in order to use it you have different options:
|
||||||
|
|
||||||
|
- OpenBLAS
|
||||||
|
|
||||||
|
This provides a faster evaluation time using only the CPU. Make sure to have OpenBLAS installed on your machine.
|
||||||
|
|
||||||
|
- Using `make`
|
||||||
|
```bash
|
||||||
|
make LLAMA_OPENBLAS=1
|
||||||
|
```
|
||||||
|
Note: in order to build with OpenBLAS enabled on Arch Linux you must edit the Makefile adding at the end of the line 105: `-lcblas`
|
||||||
|
|
||||||
|
|
||||||
|
- Using CMake
|
||||||
|
|
||||||
|
```bash
|
||||||
|
mkdir build
|
||||||
|
cd build
|
||||||
|
cmake .. -DLLAMA_OPENBLAS=ON
|
||||||
|
cmake --build . --config Release
|
||||||
|
```
|
||||||
|
- cuBLAS
|
||||||
|
|
||||||
|
This provides a faster evaluation time using the CUDA cores of your Nvidia GPU. Make sure to have the CUDA toolkit installed.
|
||||||
|
- Using `make`
|
||||||
|
```bash
|
||||||
|
make LLAMA_CUBLAS=1
|
||||||
|
```
|
||||||
|
- Using CMake
|
||||||
|
|
||||||
|
```bash
|
||||||
|
mkdir build
|
||||||
|
cd build
|
||||||
|
cmake .. -DLLAMA_CUBLAS=ON
|
||||||
|
cmake --build . --config Release
|
||||||
|
```
|
||||||
|
|
||||||
### Prepare Data & Run
|
### Prepare Data & Run
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue