vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

causallm is not working well on clblast, running out of mem wth blas. this helps a bit but doesnt fix the problem.

Browse source
This commit is contained in:
Concedo 2023-10-26 23:36:35 +08:00
parent 0f46534866
commit f344a99425
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
ggml-opencl.cpp
View file

@ -1258,7 +1258,7 @@ static cl_kernel* ggml_get_dequantize_mul_mat_vec_cl(ggml_type type) {
} }
// buffer pool for cl // buffer pool for cl
#define MAX_CL_BUFFERS 256 #define MAX_CL_BUFFERS 400
struct scoped_spin_lock { struct scoped_spin_lock {
std::atomic_flag& lock; std::atomic_flag& lock;