File tree Expand file tree Collapse file tree 1 file changed +11
-1
lines changed Expand file tree Collapse file tree 1 file changed +11
-1
lines changed Original file line number Diff line number Diff line change @@ -155,7 +155,17 @@ python3 convert-pth-to-ggml.py models/7B/ 1
155
155
156
156
When running the larger models, make sure you have enough disk space to store all the intermediate files.
157
157
158
- TODO: add model disk/mem requirements
158
+ ### Memory/Disk Requirements
159
+
160
+ As the models are currently fully loaded into memory, you will need adequate disk space to save them
161
+ and sufficient RAM to load them. At the moment, memory and disk requirements are the same.
162
+
163
+ | model | original size | quantized size (4-bit) |
164
+ | -------| ---------------| ------------------------|
165
+ | 7B | 13 GB | 3.9 GB |
166
+ | 15B | 24 GB | 7.8 GB |
167
+ | 30B | 60 GB | 19.5 GB |
168
+ | 65B | 120 GB | 38.5 GB |
159
169
160
170
### Interactive mode
161
171
You can’t perform that action at this time.
0 commit comments