Georgi Gerganov
ea600071cb
Revert "feature : add blis and other BLAS implementation support ( #1502 )"
...
This reverts commit 07e9ace0f9
2023-05-20 12:03:48 +03:00
Zenix
07e9ace0f9
feature : add blis and other BLAS implementation support ( #1502 )
...
* feature: add blis support
* feature: allow all BLA_VENDOR to be assigned in cmake arguments. align with whisper.cpp pr 927
* fix: version detection for BLA_SIZEOF_INTEGER, recover min version of cmake
* Fix typo in INTEGER
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-05-20 12:02:48 +03:00
Concedo
417302b226
Merge remote-tracking branch 'occam/opencl-dev' into concedo_experimental
...
# Conflicts:
# ggml-opencl.cpp
2023-05-20 16:16:48 +08:00
Concedo
bd1aa7212c
wip2
2023-05-20 16:15:06 +08:00
Concedo
d6f6b71478
wip
2023-05-20 16:08:54 +08:00
Georgi Gerganov
ec2e10c444
llama : add llama_init_backend() API ( close #1527 )
2023-05-20 11:06:37 +03:00
Concedo
a0cfed1e30
still merging in process
2023-05-20 15:58:33 +08:00
DannyDaemonic
d2c59b8ba4
Fix for mingw ( #1462 )
2023-05-20 00:40:02 -07:00
Maxime
503db28849
llama : fix name shadowing and C4146 ( #1526 )
...
* Fix name shadowing and C4146
* Fix if macros not using defined when required
* Update llama-util.h
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* Update llama-util.h
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* Code style
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-05-20 10:22:37 +03:00
Georgi Gerganov
8a203f9fa1
llama : fix compile warnings in llama_set_state_data()
2023-05-20 10:14:43 +03:00
Georgi Gerganov
4fd3e29297
ggml : fix scalar implementation of Q4_1 dot
2023-05-20 10:13:19 +03:00
Concedo
a8958f6b76
merging, do not use
2023-05-20 15:12:31 +08:00
0cc4m
fb638fa817
Merge remote-tracking branch 'origin/master' into opencl-dev
2023-05-20 07:55:02 +02:00
0cc4m
02914698f0
Update Q4_0, Q4_1 and Q8_0 to use half instead of float
2023-05-20 07:45:56 +02:00
0cc4m
285f8f990b
Explicitely set CLBlast GEMM type
2023-05-20 07:26:38 +02:00
Concedo
4e86a07e57
wip cleanup before big merge
2023-05-20 12:48:28 +08:00
Concedo
010b2753d9
Merge commit ' 6986c7835a' into concedo_experimental
...
# Conflicts:
# README.md
2023-05-20 11:30:51 +08:00
Concedo
1225fab2ec
fix f16 format detection in neox
2023-05-20 11:26:50 +08:00
0cc4m
78b1d8351f
Add OpenCL compile options
2023-05-19 21:18:57 +02:00
Georgi Gerganov
2d5db48371
ggml : use F16 instead of F32 in Q4_0, Q4_1, Q8_0 ( #1508 )
...
* ggml : use F16 instead of F32 in Q4_0, Q4_1 and Q8_0
* llama : bump LLAMA_FILE_VERSION to 3
* cuda : update Q4 and Q8 dequantize kernels
* ggml : fix AVX dot products
* readme : update performance table + hot topics
2023-05-19 22:17:18 +03:00
Georgi Gerganov
6986c7835a
tests : add missing header
2023-05-19 21:17:28 +03:00
Evan Jones
943e6081cc
examples : add persistent chat ( #1495 )
...
* examples : add persistent chat
* examples : fix whitespace
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-05-19 20:39:51 +03:00
Jason McCartney
7694b52b9a
main : make reverse prompt option act as a stop token in non-interactive mode ( #1032 )
...
* Make reverse prompt option act as a stop token in non-interactive scenarios
* Making requested review changes
* Update gpt_params_parse and fix a merge error
* Revert "Update gpt_params_parse and fix a merge error"
This reverts commit 2bb2ff1748
2023-05-19 20:24:59 +03:00
David Kennedy
79e3efb0e9
readme : adds WizardLM to the list of supported models ( #1485 )
2023-05-19 20:16:30 +03:00
Georgi Gerganov
4b7e245adf
minor : fix compile warnings
2023-05-19 20:14:51 +03:00
Erik Scholz
5ea4339273
make kv_f16 the default for api users ( #1517 )
2023-05-18 19:31:01 +02:00
DannyDaemonic
ee9654138a
Fixes #1511 lambda issue for w64devkit (mingw) ( #1513 )
...
* Fix for w64devkit and mingw
2023-05-18 19:30:40 +02:00
Concedo
f5e1fe46e1
up ver
2023-05-18 17:15:03 +08:00
Concedo
f65bae760a
Merge remote-tracking branch 'occam/opencl-dev' into concedo_experimental
...
# Conflicts:
# ggml-opencl.cpp
2023-05-18 15:52:35 +08:00
Concedo
dae9a14b50
disable CL f16 for now until it's sorted out
2023-05-18 14:23:56 +08:00
0cc4m
b73c437e83
Fix convert_row_f16 kernel issue
2023-05-18 08:05:19 +02:00
0cc4m
0df55da4ca
Deduplicate dequant kernels
2023-05-18 07:35:40 +02:00
Stephan Walter
dc271c52ed
Remove unused n_parts parameter ( #1509 )
2023-05-17 22:12:01 +00:00
0cc4m
67dbd356b6
Remove redundant constant values
2023-05-17 19:20:46 +02:00
rankaiyx
c238b5873a
benchmark-matmul: Print the average of the test results ( #1490 )
2023-05-17 16:47:58 +02:00
Concedo
b8fe4bd37d
fixed wrong function call
2023-05-17 21:15:01 +08:00
Concedo
3530d4b753
added more debugging
2023-05-17 19:17:09 +08:00
Concedo
411687f300
remove more type decls from cl kernel.
2023-05-17 18:37:39 +08:00
Concedo
32bdc6b603
fix for older opencl devices, swap numbers
2023-05-17 18:25:46 +08:00
Concedo
76dc539172
change help text
2023-05-17 18:06:47 +08:00
Concedo
487ac226b4
need to set the unshuffle before loading the model
2023-05-17 17:58:21 +08:00
Concedo
31c105c746
fix typo
2023-05-17 17:18:12 +08:00
Concedo
2c6ac06936
gpu offload not working for other arch. debug in future.
2023-05-17 17:13:01 +08:00
Concedo
57230b5196
upgrade all other formats
2023-05-17 16:28:20 +08:00
Concedo
00da2a5f4e
neox is updated
2023-05-17 14:56:54 +08:00
Concedo
90fe9096b4
clean and refactoring pass before supporting newer models for different arch
2023-05-17 11:23:29 +08:00
Concedo
60ee00428b
updated lite
2023-05-17 10:26:36 +08:00
Concedo
d8d39f1ba8
Merge branch 'master' into concedo_experimental
...
# Conflicts:
# Makefile
2023-05-17 10:07:43 +08:00
Concedo
f561fe5a4a
switch back to ofast for c
2023-05-17 10:04:54 +08:00
Concedo
504a2aa874
Merge remote-tracking branch 'fixmake/concedo' into concedo_experimental
2023-05-17 10:01:57 +08:00
