From a9253cdfba0fad11337712e2bddb3d1cab859eaa Mon Sep 17 00:00:00 2001 From: Gustavo Rocha Dias <91472747+gustrd@users.noreply.github.com> Date: Tue, 18 Apr 2023 06:39:06 -0300 Subject: [PATCH 1/2] fix - at some OSs the PyInstaller command is case sensitive, at lowercase it doen't work. (#81) --- make_pyinstaller.bat | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/make_pyinstaller.bat b/make_pyinstaller.bat index 6b8267fbe..a197c0a03 100644 --- a/make_pyinstaller.bat +++ b/make_pyinstaller.bat @@ -1 +1 @@ -pyinstaller --noconfirm --onefile --clean --console --icon "./niko.ico" --add-data "./klite.embd;." --add-data "./koboldcpp.dll;." --add-data "./koboldcpp_openblas.dll;." --add-data "./koboldcpp_noavx2.dll;." --add-data "./koboldcpp_openblas_noavx2.dll;." --add-data "./libopenblas.dll;." --add-data "./koboldcpp_clblast.dll;." --add-data "./clblast.dll;." "./koboldcpp.py" -n "koboldcpp.exe" \ No newline at end of file +PyInstaller --noconfirm --onefile --clean --console --icon "./niko.ico" --add-data "./klite.embd;." --add-data "./koboldcpp.dll;." --add-data "./koboldcpp_openblas.dll;." --add-data "./koboldcpp_noavx2.dll;." --add-data "./koboldcpp_openblas_noavx2.dll;." --add-data "./libopenblas.dll;." --add-data "./koboldcpp_clblast.dll;." --add-data "./clblast.dll;." "./koboldcpp.py" -n "koboldcpp.exe" \ No newline at end of file From ed5b5c45a99c26d70aaaf630863c9a020de568e6 Mon Sep 17 00:00:00 2001 From: Gustavo Rocha Dias <91472747+gustrd@users.noreply.github.com> Date: Tue, 18 Apr 2023 06:40:04 -0300 Subject: [PATCH 2/2] doc - enhanced readme explaing how to compile at Windows. (#80) --- README.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/README.md b/README.md index 3af669fd9..00aa7b355 100644 --- a/README.md +++ b/README.md @@ -18,6 +18,14 @@ What does it mean? You get llama.cpp with a fancy UI, persistent stories, editin - You can also run it using the command line `koboldcpp.exe [ggml_model.bin] [port]`. For info, please check `koboldcpp.exe --help` - If you are having crashes or issues with OpenBLAS, please try the `--noblas` flag. +## Compiling at Windows +- If you want to compile your binaries from source at Windows, the easiest way is: + - Use the latest release of w64devkit (https://github.com/skeeto/w64devkit). Be sure to use the "vanilla one", not i686 or other different stuff. If you try they will conflit with the precompiled libs! + - Make sure you are using the w64devkit integrated terminal, then run 'make' at the KoboldCpp source folder. This will create the .dll files. + - If you want to generate the .exe file, make sure you have the python module PyInstaller installed with pip ('pip install PyInstaller'). + - Run the script make_pyinstaller.bat at a regular terminal (or Windows Explorer). + - The koboldcpp.exe file will be at your dist folder. + ## OSX and Linux - You will have to compile your binaries from source. A makefile is provided, simply run `make` - If you want you can also link your own install of OpenBLAS manually with `make LLAMA_OPENBLAS=1`