Commit graph

105 commits

Author SHA1 Message Date
Kevin Kwok
b64ca1c07c
Merge pull request #40 from rupeshs/windows-console-ansi-color-fix
Windows console ANSI color issue fixed
2023-03-18 07:37:29 -07:00
Rupesh Sreeraman
a83e2e7a24 Windows console ANSI color issue fixed 2023-03-18 16:41:20 +05:30
antimatter15
4a524c51ba commenting out aarch 2023-03-18 01:15:51 -07:00
antimatter15
ddc4e24cb8 maybe macos-arm64 is case sensitive 2023-03-18 01:11:02 -07:00
antimatter15
564b861bac archiving artifacts 2023-03-18 01:06:44 -07:00
antimatter15
3f7d187b6b more copying stuff 2023-03-18 00:55:00 -07:00
antimatter15
1c62e35984 create release 2023-03-18 00:37:34 -07:00
antimatter15
7e126618c4 ci releases for mac and linux 2023-03-18 00:34:53 -07:00
antimatter15
501a8e19d9 adding to credit section 2023-03-18 00:28:37 -07:00
antimatter15
1cb9215e5d removing random prompt generation 2023-03-18 00:28:37 -07:00
thement
e95e64bd49 Implement non-greedy tokenizer that tries to maximize token lengths (#242)
* Implement non-greedy tokenizer that tries to maximize token lengths

* Insert single space in front of the prompt

- this is to match original llama tokenizer behavior

---------

Co-authored-by: Jakub Horak <jakub.horak@ibawizard.net>
2023-03-18 00:28:37 -07:00
Kevin Kwok
7b24407613
Merge pull request #31 from anzz1/ci_test
CI fine tuning
2023-03-18 00:06:16 -07:00
antimatter15
96e0519ae1 extending context window 2023-03-17 23:46:31 -07:00
Kevin Kwok
97d327e1bf
Update chat.cpp 2023-03-17 23:43:09 -07:00
Kevin Kwok
7cd84a7027
Update README.md 2023-03-17 22:57:27 -07:00
Kevin Kwok
d0f855a8df
Update README.md 2023-03-17 11:13:47 -07:00
anzz1
e7bdee6cc9
CI fine tuning 2023-03-17 19:17:59 +02:00
Kevin Kwok
1e82fa82c6
Merge pull request #26 from mcmonkey4eva/master
add easy Windows install instructions to the readme
2023-03-17 09:44:40 -07:00
Kevin Kwok
71d097898d
Merge pull request #12 from anzz1/ci_test
Fix Makefile and Linux/MacOS CI
2023-03-17 09:44:26 -07:00
Kevin Kwok
197df5f096
Merge pull request #18 from jxy/limit_tokens
Compute remaining tokens along the way and exit if over
2023-03-17 09:44:12 -07:00
Alex "mcmonkey" Goodwin
af02c94798 add easy Windows install instructions to the readme
Also fix a typo of LLaMA's casing in the chat.cpp file, and add cmake's generated files to the gitignore
2023-03-17 04:49:41 -07:00
Xiao-Yong Jin
5be098f51e Compute remaining tokens along the way and exit if over 2023-03-17 00:22:37 -05:00
anzz1
376a4a2ab0
Merge branch 'master' into ci_test 2023-03-17 04:11:13 +02:00
anzz1
8a3d6f2ea4
CI: Enable Linux/MacOS builds 2023-03-17 04:00:40 +02:00
anzz1
f2eda96137
Fix Makefile 2023-03-17 03:58:34 +02:00
Kevin Kwok
235a4115df
Update build.yml 2023-03-16 18:39:41 -07:00
Kevin Kwok
72f9fbe4d1
Fix #2 2023-03-16 18:36:09 -07:00
Kevin Kwok
2af2331add
Merge pull request #3 from bigattichouse/master
process the scanf() output so Ubuntu 22 compiler doesn't error due to…
2023-03-16 18:30:17 -07:00
Kevin Kwok
bf244623ef
Merge pull request #5 from anzz1/master
Windows fixes for CMake & Github CI
2023-03-16 18:26:03 -07:00
Michael E. Johnson
0660aeed69 process the scanf() output so Ubuntu 22 compiler doesn't error due to default warn_unused_result instead of Makefile -Wunused-result 2023-03-16 16:18:12 -05:00
anzz1
c8917ca358
Fix Windows CI and autorelease
AI for the masses
2023-03-16 23:08:18 +02:00
anzz1
6d973a699f
Fix CMake 2023-03-16 23:07:23 +02:00
antimatter15
e750735216 first commit 2023-03-16 09:16:36 -07:00
Nebula
9b4a15b17d
Fix RMS norm in GGML (#191) 2023-03-15 19:29:25 -04:00
hoangmit
6eac39ba95
Add RMS norm and use it (#187)
* add ggml_rms_norm

* update op num
2023-03-16 00:41:38 +02:00
moritzbrantner
27944c4206
fixed typo (#178) 2023-03-15 22:35:25 +02:00
Rickey Bowers Jr
2d15d6c9a9
add SIGINT support for _WIN32 environments (#120)
* add SIGINT support for _WIN32 environments

* perhaps more consistent
2023-03-15 21:56:24 +02:00
Justin Suess
2d64715ad4
added ctx_size parameter (#148)
* added ctx_size parameter

* added it in more places

* Apply suggestions from code review

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-15 21:42:40 +02:00
Justin Suess
16b2c61a22
fixed color reset on exit (#149)
* fixed color reset on exit

* added sigint handler for ansi_color_reset

* Update main.cpp

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-15 21:39:38 +02:00
Musab Gultekin
977295c700
Fix potential licensing issue (#126)
* Update README.md

* Update README.md

remove facebook
2023-03-15 21:39:06 +02:00
Ronsor
956dfda8ad
Use tokenizer.vocab_size() instead of hardcoding 32000 in convert-pth-to-ggml.py (#142)
There are ways that special tokens or other new tokens could be added to the tokenizer; therefore it's probably best not to assume the vocabulary is only 32000 tokens.
2023-03-15 21:37:50 +02:00
hoangmit
113e685d18
inline -> static inline for "bytesFromNibbles" (#161)
Without "static" prefix, it fails to compile in clang
2023-03-15 21:05:14 +02:00
Ronsor
47857e564c
Don't use vdotq_s32 if it's not available (#139)
* Don't use vdotq_s32 if it's not available

`dotprod` extensions aren't available on some ARM CPUs (e.g. Raspberry Pi 4), so check for them and only use them if they're available.

Reintroduces the code removed in 84d9015 if `__ARM_FEATURE_DOTPROD` isn't defined.

* Update ggml.c

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-14 21:34:37 +02:00
Radoslav Gerganov
60f819a2b1
Add section to README on how to run the project on Android (#130) 2023-03-14 15:30:08 +02:00
Georgi Gerganov
97ab2b2578
Add Misc section + update hot topics + minor fixes 2023-03-14 09:43:52 +02:00
Sebastián A
2f700a2738
Add windows to the CI (#98) 2023-03-13 22:29:10 +02:00
Georgi Gerganov
c09a9cfb06
CMake build in Release by default (#75) 2023-03-13 21:22:15 +02:00
Georgi Gerganov
7ec903d3c1
Update contribution section, hot topics, limitations, etc. 2023-03-13 19:21:51 +02:00
Georgi Gerganov
4497ad819c
Print system information 2023-03-13 19:15:08 +02:00
Sebastián A
ed6849cc07
Initial support for CMake (#75) 2023-03-13 19:12:33 +02:00