diff --git a/README.md b/README.md index 086618315..9ac48bbbe 100644 --- a/README.md +++ b/README.md @@ -48,6 +48,7 @@ Inference of Meta's [LLaMA](https://arxiv.org/abs/2302.13971) model (and others)
  • Interactive mode
  • Constrained output with grammars
  • Instruct mode
  • +
  • Cli commands
  • Obtaining and using the Facebook LLaMA 2 model
  • Seminal papers and background on the models
  • Perplexity (measuring model quality)
  • @@ -893,6 +894,21 @@ cadaver, cauliflower, cabbage (vegetable), catalpa (tree) and Cailleach. > ``` +### Cli commands + +- #### Numa (attempt optimizations that help on some NUMA systems): +To use it in numactl mode you will need the package + +## Unix +- Fedora linux package: +```bash +sudo dnf install numactl +``` +- Debian or Ubuntu linux package: +```bash +sudo apt install numactl +``` + ### Obtaining and using the Facebook LLaMA 2 model - Refer to [Facebook's LLaMA download page](https://ai.meta.com/resources/models-and-libraries/llama-downloads/) if you want to access the model data.