Skip to content

Commit 26ff76d

Browse files
committed
Add requirements to readme
1 parent d3f202d commit 26ff76d

File tree

1 file changed

+8
-1
lines changed

1 file changed

+8
-1
lines changed

README.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -155,7 +155,14 @@ python3 convert-pth-to-ggml.py models/7B/ 1
155155

156156
When running the larger models, make sure you have enough disk space to store all the intermediate files.
157157

158-
TODO: add model disk/mem requirements
158+
### Requirements
159+
160+
| model | original download size | quantized size (4-bit) |
161+
|-------|------------------------|------------------------|
162+
| 7B | 13 GB | 3.9 GB |
163+
| 15B | 24 GB | 7.8 GB |
164+
| 30B | 60 GB | 19.5 GB |
165+
| 65B | 120 GB | 38.5 GB |
159166

160167
### Interactive mode
161168

0 commit comments

Comments
 (0)