vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

doc - Better explanation of how to build the libraries at Windows. (#107)

Browse source
This commit is contained in:
Gustavo Rocha Dias 2023-04-23 02:40:09 -03:00 • committed by GitHub
parent d41490c27b
commit 3f21bd81f3
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 6 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

11
README.md
View file

@ -27,11 +27,12 @@ What does it mean? You get llama.cpp with a fancy UI, persistent stories, editin
- If you want to generate the .exe file, make sure you have the python module PyInstaller installed with pip ('pip install PyInstaller').
- Run the script make_pyinstaller.bat at a regular terminal (or Windows Explorer).
- The koboldcpp.exe file will be at your dist folder.
- If you wish to use your own version of the additional Windows libraries (clblast, libopenblas or OpenCL), you can:
- Compile then, or download the lastest release from the respective GitHub repository.
- Replace the existing versions of the .dll file located in the project directory root.
- Move any import .lib file to the /lib folder of your project, overwriting the older file.
- Make the project using the instructions.
- If you wish to use your own version of the additional Windows libraries (OpenCL, CLBlast and OpenBLAS), you can do it with:
- OpenCL - tested with https://github.com/KhronosGroup/OpenCL-SDK . If you wish to compile it, follow the repository instructions. You will need vcpkg.
- CLBlast - tested with https://github.com/CNugteren/CLBlast . If you wish to compile it you will need to reference the OpenCL files. It will only generate the ".lib" file if you compile using MSVC.
- OpenBLAS - tested with https://github.com/xianyi/OpenBLAS .
- Move the respectives .lib files to the /lib folder of your project, overwriting the older files.
- Make the KoboldCPP project using the instructions above.
## OSX and Linux
- You will have to compile your binaries from source. A makefile is provided, simply run `make`