Kevin Kwok
b64ca1c07c
Merge pull request #40 from rupeshs/windows-console-ansi-color-fix
...
Windows console ANSI color issue fixed
2023-03-18 07:37:29 -07:00
Rupesh Sreeraman
a83e2e7a24
Windows console ANSI color issue fixed
2023-03-18 16:41:20 +05:30
antimatter15
4a524c51ba
commenting out aarch
2023-03-18 01:15:51 -07:00
antimatter15
ddc4e24cb8
maybe macos-arm64 is case sensitive
2023-03-18 01:11:02 -07:00
antimatter15
564b861bac
archiving artifacts
2023-03-18 01:06:44 -07:00
antimatter15
3f7d187b6b
more copying stuff
2023-03-18 00:55:00 -07:00
antimatter15
1c62e35984
create release
2023-03-18 00:37:34 -07:00
antimatter15
7e126618c4
ci releases for mac and linux
2023-03-18 00:34:53 -07:00
antimatter15
501a8e19d9
adding to credit section
2023-03-18 00:28:37 -07:00
antimatter15
1cb9215e5d
removing random prompt generation
2023-03-18 00:28:37 -07:00
thement
e95e64bd49
Implement non-greedy tokenizer that tries to maximize token lengths ( #242 )
...
* Implement non-greedy tokenizer that tries to maximize token lengths
* Insert single space in front of the prompt
- this is to match original llama tokenizer behavior
---------
Co-authored-by: Jakub Horak <jakub.horak@ibawizard.net>
2023-03-18 00:28:37 -07:00
Kevin Kwok
7b24407613
Merge pull request #31 from anzz1/ci_test
...
CI fine tuning
2023-03-18 00:06:16 -07:00
antimatter15
96e0519ae1
extending context window
2023-03-17 23:46:31 -07:00
Kevin Kwok
97d327e1bf
Update chat.cpp
2023-03-17 23:43:09 -07:00
Kevin Kwok
7cd84a7027
Update README.md
2023-03-17 22:57:27 -07:00
Kevin Kwok
d0f855a8df
Update README.md
2023-03-17 11:13:47 -07:00
anzz1
e7bdee6cc9
CI fine tuning
2023-03-17 19:17:59 +02:00
Kevin Kwok
1e82fa82c6
Merge pull request #26 from mcmonkey4eva/master
...
add easy Windows install instructions to the readme
2023-03-17 09:44:40 -07:00
Kevin Kwok
71d097898d
Merge pull request #12 from anzz1/ci_test
...
Fix Makefile and Linux/MacOS CI
2023-03-17 09:44:26 -07:00
Kevin Kwok
197df5f096
Merge pull request #18 from jxy/limit_tokens
...
Compute remaining tokens along the way and exit if over
2023-03-17 09:44:12 -07:00
Alex "mcmonkey" Goodwin
af02c94798
add easy Windows install instructions to the readme
...
Also fix a typo of LLaMA's casing in the chat.cpp file, and add cmake's generated files to the gitignore
2023-03-17 04:49:41 -07:00
Xiao-Yong Jin
5be098f51e
Compute remaining tokens along the way and exit if over
2023-03-17 00:22:37 -05:00
anzz1
376a4a2ab0
Merge branch 'master' into ci_test
2023-03-17 04:11:13 +02:00
anzz1
8a3d6f2ea4
CI: Enable Linux/MacOS builds
2023-03-17 04:00:40 +02:00
anzz1
f2eda96137
Fix Makefile
2023-03-17 03:58:34 +02:00
Kevin Kwok
235a4115df
Update build.yml
2023-03-16 18:39:41 -07:00
Kevin Kwok
72f9fbe4d1
Fix #2
2023-03-16 18:36:09 -07:00
Kevin Kwok
2af2331add
Merge pull request #3 from bigattichouse/master
...
process the scanf() output so Ubuntu 22 compiler doesn't error due to…
2023-03-16 18:30:17 -07:00
Kevin Kwok
bf244623ef
Merge pull request #5 from anzz1/master
...
Windows fixes for CMake & Github CI
2023-03-16 18:26:03 -07:00
Michael E. Johnson
0660aeed69
process the scanf() output so Ubuntu 22 compiler doesn't error due to default warn_unused_result instead of Makefile -Wunused-result
2023-03-16 16:18:12 -05:00
anzz1
c8917ca358
Fix Windows CI and autorelease
...
AI for the masses
2023-03-16 23:08:18 +02:00
anzz1
6d973a699f
Fix CMake
2023-03-16 23:07:23 +02:00
antimatter15
e750735216
first commit
2023-03-16 09:16:36 -07:00
Nebula
9b4a15b17d
Fix RMS norm in GGML ( #191 )
2023-03-15 19:29:25 -04:00
hoangmit
6eac39ba95
Add RMS norm and use it ( #187 )
...
* add ggml_rms_norm
* update op num
2023-03-16 00:41:38 +02:00
moritzbrantner
27944c4206
fixed typo ( #178 )
2023-03-15 22:35:25 +02:00
Rickey Bowers Jr
2d15d6c9a9
add SIGINT support for _WIN32 environments ( #120 )
...
* add SIGINT support for _WIN32 environments
* perhaps more consistent
2023-03-15 21:56:24 +02:00
Justin Suess
2d64715ad4
added ctx_size parameter ( #148 )
...
* added ctx_size parameter
* added it in more places
* Apply suggestions from code review
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-15 21:42:40 +02:00
Justin Suess
16b2c61a22
fixed color reset on exit ( #149 )
...
* fixed color reset on exit
* added sigint handler for ansi_color_reset
* Update main.cpp
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-15 21:39:38 +02:00
Musab Gultekin
977295c700
Fix potential licensing issue ( #126 )
...
* Update README.md
* Update README.md
remove facebook
2023-03-15 21:39:06 +02:00
Ronsor
956dfda8ad
Use tokenizer.vocab_size()
instead of hardcoding 32000 in convert-pth-to-ggml.py ( #142 )
...
There are ways that special tokens or other new tokens could be added to the tokenizer; therefore it's probably best not to assume the vocabulary is only 32000 tokens.
2023-03-15 21:37:50 +02:00
hoangmit
113e685d18
inline -> static inline for "bytesFromNibbles" ( #161 )
...
Without "static" prefix, it fails to compile in clang
2023-03-15 21:05:14 +02:00
Ronsor
47857e564c
Don't use vdotq_s32 if it's not available ( #139 )
...
* Don't use vdotq_s32 if it's not available
`dotprod` extensions aren't available on some ARM CPUs (e.g. Raspberry Pi 4), so check for them and only use them if they're available.
Reintroduces the code removed in 84d9015
if `__ARM_FEATURE_DOTPROD` isn't defined.
* Update ggml.c
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-14 21:34:37 +02:00
Radoslav Gerganov
60f819a2b1
Add section to README on how to run the project on Android ( #130 )
2023-03-14 15:30:08 +02:00
Georgi Gerganov
97ab2b2578
Add Misc section + update hot topics + minor fixes
2023-03-14 09:43:52 +02:00
Sebastián A
2f700a2738
Add windows to the CI ( #98 )
2023-03-13 22:29:10 +02:00
Georgi Gerganov
c09a9cfb06
CMake build in Release by default ( #75 )
2023-03-13 21:22:15 +02:00
Georgi Gerganov
7ec903d3c1
Update contribution section, hot topics, limitations, etc.
2023-03-13 19:21:51 +02:00
Georgi Gerganov
4497ad819c
Print system information
2023-03-13 19:15:08 +02:00
Sebastián A
ed6849cc07
Initial support for CMake ( #75 )
2023-03-13 19:12:33 +02:00