vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

[SYCL] Update SYCL-Rope op and Refactor (#8157)

Browse source 
* align with rope.cu and move sycl-op to a single file
This commit is contained in:
zhentaoyu 2024-07-01 19:39:06 +08:00 • committed by GitHub
parent d0a7145ba9
commit 197fe6c1d7
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 300 additions and 303 deletions
Download patch file Download diff file Expand all files Collapse all files

22
ggml/src/ggml-sycl/rope.hpp Normal file
View file

@ -0,0 +1,22 @@
//
// MIT license
// Copyright (C) 2024 Intel Corporation
// SPDX-License-Identifier: MIT
//
//
// Part of the LLVM Project, under the Apache License v2.0 with LLVM Exceptions.
// See https://llvm.org/LICENSE.txt for license information.
// SPDX-License-Identifier: Apache-2.0 WITH LLVM-exception
//
#ifndef GGML_SYCL_ROPE_HPP
#define GGML_SYCL_ROPE_HPP
#include "common.hpp"
void ggml_sycl_op_rope(
ggml_backend_sycl_context & ctx, const ggml_tensor *src0, const ggml_tensor *src1, ggml_tensor *dst,
const float *src0_dd, const float *src1_dd, float *dst_dd, const queue_ptr &main_stream);
#endif // GGML_SYCL_ROPE_HPP