Does this project support llama-2 model? #2328
-
|
Recently https://github.com/facebookresearch/llama have some instructions to download llama-2 so my question is does this project support llama-2? Or where can I download original llama model weights? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
Smaller models just work, biggest one almost works. Try hugginface/Thebloke, or go the official way from Facebook, then convert to ggml. |
Beta Was this translation helpful? Give feedback.
-
|
Yes, llama.cpp supports Llama2, Llama, Vicuna, Alpaca, and many more... TheBloke has LOTS of models on HuggingFace: try a 7B model, make sure it is ggmlv3 and check in the Model Card that it works on llama.cpp |
Beta Was this translation helpful? Give feedback.
Smaller models just work, biggest one almost works. Try hugginface/Thebloke, or go the official way from Facebook, then convert to ggml.