Default branch

d7b31a9d84 · sync: minja (a72057e519) (#11774) · Updated 2025-02-10 09:34:09 +00:00

Branches

afb3929279 · Merge branch 'master' into llama-refactor · Updated 2023-10-31 18:35:31 +00:00    vbatts

3234
21

29fe516913 · wip · Updated 2023-10-31 16:36:37 +00:00    vbatts

3235
1

dab42893c9 · scripts : working curl pipe · Updated 2023-10-31 15:03:56 +00:00    vbatts

3235
3

7923b70cb8 · llama : add llm_build_inp_embd helper · Updated 2023-10-31 14:43:08 +00:00    vbatts

3240
37

4b3cb98d46 · ggml-impl : move extern "C" to start of file · Updated 2023-10-30 17:05:58 +00:00    vbatts

3236
7
lto

bc28aaa8c2 · make : use -lfto=auto to avoid warnings and maintain perf · Updated 2023-10-30 14:00:53 +00:00    vbatts

3236
5

15267192c0 · llama : refactor tensor offloading as callback · Updated 2023-10-29 11:04:36 +00:00    vbatts

3240
15

8a86b95e87 · quantize : --pure option for disabling k-quant mixtures · Updated 2023-10-28 20:37:03 +00:00    vbatts

3241
3

de7e0912b6 · convert : ignore tokens if their IDs are within [0, vocab_size) · Updated 2023-10-28 12:01:36 +00:00    vbatts

3244
1

bbfc62ac2f · sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs · Updated 2023-10-28 11:04:57 +00:00    vbatts

3252
3

cd3e20fb50 · cuda : fix multi-gpu with tensor cores · Updated 2023-10-27 20:11:50 +00:00    vbatts

3251
3

49af767fad · build : add compile option to force use of MMQ kernels · Updated 2023-10-27 10:21:04 +00:00    vbatts

3253
7

d798a17c34 · cuda : add TODO for calling cublas from kernel + using mem pool · Updated 2023-10-24 13:33:24 +00:00    vbatts

3267
10

6966474928 · cuda : play with faster Q4_0 dequantization · Updated 2023-10-24 07:29:40 +00:00    vbatts

3267
8

b9bb4cbe86 · Separate bug and enhancement template + no default title · Updated 2023-10-23 15:59:11 +00:00    vbatts

3267
1

c0f4d54870 · server : add comment about changing slot_state to bool · Updated 2023-10-22 19:24:39 +00:00    vbatts

3273
72

cb79f8a2d8 · llama : add SKIP_KQ_KQV option · Updated 2023-10-22 06:58:29 +00:00    vbatts

3273
3

56ba00b923 · sampling : hide prev behind API and apply #3661 · Updated 2023-10-20 15:53:27 +00:00    vbatts

3276
6

ad2727d091 · Merge branch 'master' into speculative-tree · Updated 2023-10-18 07:50:58 +00:00    vbatts

3287
18

932589c0ef · Honor -ngl option for Cuda offloading in llava · Updated 2023-10-14 00:12:10 +00:00    vbatts

3301
1