From b48255db19f89b7df1032f61fddeee83ec108e90 Mon Sep 17 00:00:00 2001 From: ariez-xyz <41232910+ariez-xyz@users.noreply.github.com> Date: Sat, 8 Apr 2023 10:41:57 +0200 Subject: [PATCH] add more precise instructions for arch --- README.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index ed4e48f6a..fba411d59 100644 --- a/README.md +++ b/README.md @@ -22,6 +22,7 @@ What does it mean? You get llama.cpp with a fancy UI, persistent stories, editin ## OSX and Linux - You will have to compile your binaries from source. A makefile is provided, simply run `make` - If you want you can also link your own install of OpenBLAS manually with `make LLAMA_OPENBLAS=1` + - For Arch Linux: Install `cblas` and `openblas`. In the makefile, find the `ifdef LLAMA_OPENBLAS` conditional and add `-lcblas` to `LDFLAGS`. - After all binaries are built, you can run the python script with the command `koboldcpp.py [ggml_model.bin] [port]` ## Considerations @@ -39,4 +40,4 @@ What does it mean? You get llama.cpp with a fancy UI, persistent stories, editin ## Notes - Generation delay scales linearly with original prompt length. See [this discussion](https://github.com/ggerganov/llama.cpp/discussions/229). If OpenBLAS is enabled then prompt ingestion becomes about 2-3x faster. This is automatic on windows, but will require linking on OSX and Linux. -- I have heard of someone claiming a false AV positive report. The exe is a simple pyinstaller bundle that includes the necessary python scripts and dlls to run. If this still concerns you, you might wish to rebuild everything from source code using the makefile, and you can rebuild the exe yourself with pyinstaller by using `make_pyinstaller.bat` \ No newline at end of file +- I have heard of someone claiming a false AV positive report. The exe is a simple pyinstaller bundle that includes the necessary python scripts and dlls to run. If this still concerns you, you might wish to rebuild everything from source code using the makefile, and you can rebuild the exe yourself with pyinstaller by using `make_pyinstaller.bat`