From 64e2bc9184e5443e18e0084041ee387ca739920b Mon Sep 17 00:00:00 2001 From: calvinweb <38599774+calvinweb@users.noreply.github.com> Date: Sat, 3 Feb 2024 17:06:40 +0800 Subject: [PATCH] Update README.md --- README.md | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 145d8fd68..302f8d5f0 100644 --- a/README.md +++ b/README.md @@ -346,11 +346,15 @@ mpirun -hostfile hostfile -n 3 ./main -m ./models/7B/ggml-model-q4_0.gguf -n 128 ``` ### Vulkan Build -**Vulkan** is a new library aimed at replacing **OpenGL**. Starting from version `b1996`, `llama.cpp` now supports **Vulkan** as a backend. It can be faster (almost 2x on NVIDIA GeForce RTX™ 3060 Laptop GPU) than **CUDA** on a consumer-grade NVIDIA graphics card. - +**Vulkan** is a new library aimed at replacing **OpenGL**. Starting from version `b1996`, `llama.cpp` now supports **Vulkan** as a backend. To build with **Vulkan**: - Ensure that your operating system and graphics card support **Vulkan**. +- Install Vulkan realted dependents: + - On Debian based distros: + ``` + apt install libvulkan-dev + ``` - Build `llama.cpp` with the following arguments: `LLAMA_VULKAN=1`. ### BLAS Build