Are prompt templates required for ggml models? #1980
Unanswered
RahulVivekNair
asked this question in
Q&A
Replies: 1 comment 1 reply
-
I think you can use --in-prefix and --in-suffix for it |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I currently run every model with -i -ins which seems to be using the alpaca format. I see on the model pages though that most models have different templates such as ' USER: ' 'ASSISTANT:' etc. Do I need to and how do I use these in llama.cpp?
Also vicuna 1.1 onwards they mention a different prompt separator '', do I somehow mention this too for llama.cpp?
Beta Was this translation helpful? Give feedback.
All reactions