Skip to content

Commit 5ea4339

Browse files
authored
make kv_f16 the default for api users (#1517)
1 parent ee96541 commit 5ea4339

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

llama.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -814,7 +814,7 @@ struct llama_context_params llama_context_default_params() {
814814
/*.n_ctx =*/ 512,
815815
/*.gpu_layers =*/ 0,
816816
/*.seed =*/ -1,
817-
/*.f16_kv =*/ false,
817+
/*.f16_kv =*/ true,
818818
/*.logits_all =*/ false,
819819
/*.vocab_only =*/ false,
820820
/*.use_mmap =*/ true,

0 commit comments

Comments
 (0)