vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
llama.cpp/ggml/src/ggml-cuda/template-instances
History
Georgi Gerganov f3f65429c4
llama : reorganize source code + improve CMake (#8006) 
* scripts : update sync [no ci]

* files : relocate [no ci]

* ci : disable kompute build [no ci]

* cmake : fixes [no ci]

* server : fix mingw build

ggml-ci

* cmake : minor [no ci]

* cmake : link math library [no ci]

* cmake : build normal ggml library (not object library) [no ci]

* cmake : fix kompute build

ggml-ci

* make,cmake : fix LLAMA_CUDA + replace GGML_CDEF_PRIVATE

ggml-ci

* move public backend headers to the public include directory (#8122)

* move public backend headers to the public include directory

* nix test

* spm : fix metal header

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* scripts : fix sync paths [no ci]

* scripts : sync ggml-blas.h [no ci]

---------

Co-authored-by: slaren <slarengh@gmail.com>
2024-06-26 18:33:02 +03:00
..
fattn-vec-f16-instance-hs64-f16-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs64-f16-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs64-f16-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs64-f16-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs64-f16-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs64-f16-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-f16-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-f16-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-f16-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-f16-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-f16-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-f16-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_0-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_0-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_0-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_0-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_0-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_0-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_1-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_1-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_1-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_1-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_1-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q4_1-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_0-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_0-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_0-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_0-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_0-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_0-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_1-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_1-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_1-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_1-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_1-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q5_1-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q8_0-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q8_0-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q8_0-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q8_0-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q8_0-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs128-q8_0-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f16-instance-hs256-f16-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs64-f16-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs64-f16-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs64-f16-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs64-f16-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs64-f16-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs64-f16-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-f16-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-f16-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-f16-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-f16-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-f16-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-f16-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_0-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_0-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_0-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_0-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_0-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_0-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_1-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_1-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_1-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_1-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_1-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q4_1-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_0-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_0-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_0-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_0-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_0-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_0-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_1-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_1-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_1-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_1-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_1-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q5_1-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q8_0-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q8_0-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q8_0-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q8_0-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q8_0-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs128-q8_0-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-vec-f32-instance-hs256-f16-f16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-wmma-f16-instance-kqfloat-cpb16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-wmma-f16-instance-kqfloat-cpb32.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-wmma-f16-instance-kqhalf-cpb8.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-wmma-f16-instance-kqhalf-cpb16.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
fattn-wmma-f16-instance-kqhalf-cpb32.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
generate_cu_files.py llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q2_k.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q3_k.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q4_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q4_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q4_k.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q5_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q5_1.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q5_k.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q6_k.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmq-instance-q8_0.cu llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00