vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

doc - explanation of how to use a custom version of the windows libraries at the lib folder. (#92)

Browse source 
the dynamic libraries also need to be updated if you replace the import libraries
This commit is contained in:
Gustavo Rocha Dias 2023-04-20 01:20:11 -03:00 • committed by GitHub
parent be1222c36e
commit 5ca2d774cc
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 5 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

5
README.md
View file

@ -26,6 +26,11 @@ What does it mean? You get llama.cpp with a fancy UI, persistent stories, editin
- If you want to generate the .exe file, make sure you have the python module PyInstaller installed with pip ('pip install PyInstaller'). - If you want to generate the .exe file, make sure you have the python module PyInstaller installed with pip ('pip install PyInstaller').
- Run the script make_pyinstaller.bat at a regular terminal (or Windows Explorer). - Run the script make_pyinstaller.bat at a regular terminal (or Windows Explorer).
- The koboldcpp.exe file will be at your dist folder. - The koboldcpp.exe file will be at your dist folder.
- If you wish to use your own version of the additional Windows libraries (clblast.lib, libopenblas.lib or OpenCL.lib), you can:
- Compile then, or download the lastest release from the respective GitHub repository.
- Change the extension of the .dll file to .lib.
- Move the new .lib file to the /lib folder of your project, overwriting the older file.
- Make the project using the instructions.
## OSX and Linux ## OSX and Linux
- You will have to compile your binaries from source. A makefile is provided, simply run `make` - You will have to compile your binaries from source. A makefile is provided, simply run `make`