Update quantization.md for low bit: Add Warning for supporting only ARM (#1324)

metascroy · web-flow · commit 70260eb4963b · 2024-10-25T10:14:48.000-07:00
diff --git a/docs/quantization.md b/docs/quantization.md
@@ -120,6 +120,8 @@ python3 torchchat.py generate llama3 --pte-path llama3.pte  --prompt "Hello my n
 
 ## Experimental TorchAO lowbit kernels
 
+WARNING: These kernels only work on devices with ARM CPUs, for example on Mac computers with Apple Silicon.
+
 ### Use
 
 #### linear:a8wxdq
