vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Refactor Vulkan backend to allow multiple contexts (#7961)

Browse source 
* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
This commit is contained in:
0cc4m 2024-06-23 10:21:25 +02:00 • committed by GitHub
parent b5a5f34efa
commit 45c0e2e4c1
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
8 changed files with 21021 additions and 20675 deletions
Download patch file Download diff file Expand all files Collapse all files

2
vulkan-shaders/mul_mat_vec.comp
View file

@ -13,7 +13,7 @@ layout (constant_id = 0) const uint BLOCK_SIZE = 32;
shared FLOAT_TYPE tmp[BLOCK_SIZE];
void main() {
const uint row = gl_WorkGroupID.x;
const uint row = gl_WorkGroupID.x + gl_NumWorkGroups.x * gl_WorkGroupID.z;
const uint tid = gl_LocalInvocationID.x;
uint a_offset, b_offset, d_offset;