vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Revert "[SYCL] fallback mmvq (#9088)" (#9579)

Browse source 
This reverts commit 50addec9a5.
This commit is contained in:
Akarshan Biswas 2024-09-23 08:58:06 +05:30 • committed by GitHub
parent c35e586ea5
commit e62e9789cd
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 1 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

1
ggml/src/ggml-sycl/common.hpp
View file

@ -134,7 +134,6 @@ typedef sycl::float2 dfloat2;
#endif // GGML_SYCL_F16
#define MMVQ_MAX_BATCH_SIZE 8
#define MMVQ_MIN_BATCH_SIZE 4
static const int8_t kvalues_iq4nl[16]={-127, -104, -83, -65, -49, -35, -22, -10, 1, 13, 25, 38, 53, 69, 89, 113};