We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent e33002d commit 324e823Copy full SHA for 324e823
README.md
@@ -255,7 +255,11 @@ Using Metal allows the computation to be executed on the GPU for Apple devices:
255
```
256
257
When built with Metal support, you can enable GPU inference with the `--gpu-layers|-ngl` command-line argument.
258
-Any value larger than 0 will offload the computation to the GPU.
+Any value larger than 0 will offload the computation to the GPU. For example:
259
+
260
+```bash
261
+./main -m ./models/7B/ggml-model-q4_0.bin -n 128 -ngl 1
262
+```
263
264
### BLAS Build
265
0 commit comments