Skip to content

Commit 94008cc

Browse files
authored
arg : fix attention non-causal arg value hint (#9985)
This commit updates the argument value hint for the `--attention` argument to `non-causal`. The motivation for this change is that the only values for this argument are `causal` and `non-causal`.
1 parent dbd5f2f commit 94008cc

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

common/arg.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1097,7 +1097,7 @@ common_params_context common_params_parser_init(common_params & params, llama_ex
10971097
}
10981098
).set_examples({LLAMA_EXAMPLE_EMBEDDING, LLAMA_EXAMPLE_RETRIEVAL, LLAMA_EXAMPLE_SERVER}).set_env("LLAMA_ARG_POOLING"));
10991099
add_opt(common_arg(
1100-
{"--attention"}, "{causal,non,causal}",
1100+
{"--attention"}, "{causal,non-causal}",
11011101
"attention type for embeddings, use model default if unspecified",
11021102
[](common_params & params, const std::string & value) {
11031103
/**/ if (value == "causal") { params.attention_type = LLAMA_ATTENTION_TYPE_CAUSAL; }

0 commit comments

Comments
 (0)