Merge 2b2fd541c2 into d5c05821f3

README.md

@@ -51,6 +51,7 @@ Inference of Meta's [LLaMA](https://arxiv.org/abs/2302.13971) model (and others)
         <li><a href="#interactive-mode">Interactive mode</a></li>
         <li><a href="#constrained-output-with-grammars">Constrained output with grammars</a></li>
         <li><a href="#instruct-mode">Instruct mode</a></li>
+        <li><a href="#numa">Numa</a></li>
         <li><a href="#obtaining-and-using-the-facebook-llama-2-model">Obtaining and using the Facebook LLaMA 2 model</a></li>
         <li><a href="#seminal-papers-and-background-on-the-models">Seminal papers and background on the models</a></li>
         <li><a href="#perplexity-measuring-model-quality">Perplexity (measuring model quality)</a></li>
@@ -901,6 +902,19 @@ The majority (54%) are using public transit. This includes buses, trams and metr
 cadaver, cauliflower, cabbage (vegetable), catalpa (tree) and Cailleach.
 >
 ```
+#### Numa
+- <details>
+  <summary>Unix:</summary>
+
+    - Fedora linux package:
+    ```bash
+    sudo dnf install numactl
+    ```
+    - Debian or Ubuntu linux package:
+    ```bash
+    sudo apt install numactl
+    ```
+  </details>
 
 ### Obtaining and using the Facebook LLaMA 2 model