cosmopolitan/third_party/radpajama/scripts/install-RedPajama-INCITE-Chat-3B-v1.sh

// clang-format off
#!/bin/bash

# cd to scripts dir
cd `dirname $0`

# download model to models dir
echo "Downloading model"
python ./convert_gptneox_to_ggml.py togethercomputer/RedPajama-INCITE-Chat-3B-v1 ../models/pythia

# remove temp cache dir
echo "Removing temp cache dir"
rm -r ../models/pythia-cache

# quantize model
echo "Quantizing model (q4_0)"
cd ../../..
python ./examples/redpajama/scripts/quantize-gptneox.py ./examples/redpajama/models/pythia/ggml-RedPajama-INCITE-Chat-3B-v1-f16.bin


# done!
echo "Done."
Get radpajama to build make -j8 o//third_party/radpajama/radpajama.com make -j8 o//third_party/radpajama/radpajama-chat.com This change gets the radpajama.mk config working. This package depends on THIRD_PARTY_GGML but it's configured to call ggjt_v1(), so that the library will provide the old quantizers. The ggml_quantize_chunk() API will now dispatch to older quantizers based on the configured version. 2023-05-14 03:44:36 +00:00			`// clang-format off`
Import radpajama (a redpajama.cpp fork) (#814) This is the relevant commit: https://github.com/togethercomputer/redpajama.cpp/commit/bfa6466199b8ef92185ecb72e2a550e12baf6602 Model download links: https://huggingface.co/ceonlabs/radpajama/tree/main 2023-05-11 14:12:08 +00:00			`#!/bin/bash`

			`# cd to scripts dir`
			cd `dirname $0`

			`# download model to models dir`
			`echo "Downloading model"`
			`python ./convert_gptneox_to_ggml.py togethercomputer/RedPajama-INCITE-Chat-3B-v1 ../models/pythia`

			`# remove temp cache dir`
			`echo "Removing temp cache dir"`
			`rm -r ../models/pythia-cache`

			`# quantize model`
			`echo "Quantizing model (q4_0)"`
			`cd ../../..`
			`python ./examples/redpajama/scripts/quantize-gptneox.py ./examples/redpajama/models/pythia/ggml-RedPajama-INCITE-Chat-3B-v1-f16.bin`


			`# done!`
			`echo "Done."`