Skip to content

Commit 554b541

Browse files
committed
Add memory/disk requirements to readme
1 parent d3f202d commit 554b541

File tree

1 file changed

+11
-1
lines changed

1 file changed

+11
-1
lines changed

README.md

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -155,7 +155,17 @@ python3 convert-pth-to-ggml.py models/7B/ 1
155155

156156
When running the larger models, make sure you have enough disk space to store all the intermediate files.
157157

158-
TODO: add model disk/mem requirements
158+
### Memory/Disk Requirements
159+
160+
As the models are currently fully loaded into memory, you will need adequate disk space to save them
161+
and sufficient RAM to load them. At the moment, memory and disk requirements are the same.
162+
163+
| model | original size | quantized size (4-bit) |
164+
|-------|---------------|------------------------|
165+
| 7B | 13 GB | 3.9 GB |
166+
| 15B | 24 GB | 7.8 GB |
167+
| 30B | 60 GB | 19.5 GB |
168+
| 65B | 120 GB | 38.5 GB |
159169

160170
### Interactive mode
161171

0 commit comments

Comments
 (0)