vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Vulkan Phi Fix for AMD Proprietary Drivers (#5260)

Browse source 
* Replace tanh to avoid NaN in gelu shader on AMD proprietary driver

* Fix another Vulkan CPY buffer size bug
This commit is contained in:
0cc4m 2024-02-01 19:25:24 +01:00 • committed by GitHub
parent 8ca511cade
commit 4d0924a890
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
3 changed files with 83 additions and 69 deletions
Download patch file Download diff file Expand all files Collapse all files

3
ggml_vk_generate_shaders.py
View file

@ -1689,7 +1689,8 @@ void main() {
}
const float xi = float(data_a[i]);
data_d[i] = D_TYPE(0.5f*xi*(1.0f + tanh(SQRT_2_OVER_PI*xi*(1.0f + GELU_COEF_A*xi*xi))));
const float val = SQRT_2_OVER_PI*xi*(1.0f + GELU_COEF_A*xi*xi);
data_d[i] = D_TYPE(0.5f*xi*(2.0f - 2.0f / (exp(2 * val) + 1)));
}
"""