vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Small related update to example/sycl Readme

Browse source
This commit is contained in:
OuadiElfarouki 2024-08-07 06:21:22 +01:00
parent b13ed28fbf
commit 0b83303465
1 changed files with 9 additions and 15 deletions
Download patch file Download diff file Expand all files Collapse all files

24
examples/sycl/README.md
View file

@ -12,9 +12,9 @@ This example program provides the tools for llama.cpp for SYCL on Intel GPU.
List all SYCL devices with ID, compute capability, max work group size, ect. List all SYCL devices with ID, compute capability, max work group size, ect.
1. Build the llama.cpp for SYCL for all targets. 1. Build the llama.cpp for SYCL for the specified target *(using GGML_SYCL_TARGET)*.
2. Enable oneAPI running environment 2. Enable oneAPI running environment *(if GGML_SYCL_TARGET is set to INTEL -default-)*
``` ```
source /opt/intel/oneapi/setvars.sh source /opt/intel/oneapi/setvars.sh
@ -29,19 +29,13 @@ source /opt/intel/oneapi/setvars.sh
Check the ID in startup log, like: Check the ID in startup log, like:
``` ```
found 4 SYCL devices: found 2 SYCL devices:
Device 0: Intel(R) Arc(TM) A770 Graphics, compute capability 1.3, | | | | |Max | |Max |Global | |
max compute_units 512, max work group size 1024, max sub group size 32, global mem size 16225243136 | | | | |compute|Max work|sub |mem | |
Device 1: Intel(R) FPGA Emulation Device, compute capability 1.2, |ID| Device Type| Name|Version|units |group |group|size | Driver version|
max compute_units 24, max work group size 67108864, max sub group size 64, global mem size 67065057280 |--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
Device 2: 13th Gen Intel(R) Core(TM) i7-13700K, compute capability 3.0, | 0| [level_zero:gpu:0]| Intel Arc A770 Graphics| 1.3| 512| 1024| 32| 16225M| 1.3.29138|
max compute_units 24, max work group size 8192, max sub group size 64, global mem size 67065057280 | 1| [level_zero:gpu:1]| Intel UHD Graphics 750| 1.3| 32| 512| 32| 62631M| 1.3.29138|
Device 3: Intel(R) Arc(TM) A770 Graphics, compute capability 3.0,
max compute_units 512, max work group size 1024, max sub group size 32, global mem size 16225243136
``` ```
|Attribute|Note|
|-|-|
|compute capability 1.3|Level-zero running time, recommended |
|compute capability 3.0|OpenCL running time, slower than level-zero in most cases|