vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

SYCL : SOFTMAX F16 mask support and other fixes (#11261)

Browse source 
Implemented ggml_sycl_op_soft_max() F16 src1(mask) support for which a pragma deprecation warning was added during #5021.
To do this, had to decouple it from ggml_sycl_op_flatten which always considered src1 to be of fp32 type(many OP functions are dependent on it).

* SYCL: SOFTMAX F16 mask support and other fixes

* test-backend-ops: Add F16 mask test cases
This commit is contained in:
Akarshan Biswas 2025-01-28 15:26:58 +05:30 • committed by GitHub
parent 2b8525d5c8
commit 6e84b0ab8e
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 64 additions and 49 deletions
Download patch file Download diff file Expand all files Collapse all files

6
ggml/src/ggml-sycl/softmax.hpp
View file

@ -15,10 +15,6 @@
#include "common.hpp"
void ggml_sycl_op_soft_max(ggml_backend_sycl_context &ctx, const ggml_tensor *src0,
const ggml_tensor *src1, ggml_tensor *dst,
const float *src0_dd, const float *src1_dd,
float *dst_dd,
const queue_ptr &main_stream);
void ggml_sycl_op_soft_max(ggml_backend_sycl_context &ctx, ggml_tensor *dst);
#endif // GGML_SYCL_SOFTMAX_HPP