Skip to content

Commit e22541a

Browse files
Green-Skyggerganov
authored andcommitted
make kv_f16 the default for api users (ggml-org#1517)
1 parent a94b334 commit e22541a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

llama.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -822,7 +822,7 @@ struct llama_context_params llama_context_default_params() {
822822
/*.n_ctx =*/ 512,
823823
/*.gpu_layers =*/ 0,
824824
/*.seed =*/ -1,
825-
/*.f16_kv =*/ false,
825+
/*.f16_kv =*/ true,
826826
/*.logits_all =*/ false,
827827
/*.vocab_only =*/ false,
828828
/*.use_mmap =*/ true,

0 commit comments

Comments
 (0)