Skip to content

Commit dad9208

Browse files
committed
finetune: rename feed-forward tensors (w1/w2/w3)
This commit renames the feed-forward tensors w1, w2 and w3 to ffn_gate, ffn_down and ffn_up respectively. The motivation for this change is to make it easier to understand the purpose of the tensors. This also seems to be inline with the names used in the llama_layer struct in llama.cpp. Signed-off-by: Daniel Bevenius <[email protected]>
1 parent 128de35 commit dad9208

File tree

1 file changed

+133
-133
lines changed

1 file changed

+133
-133
lines changed

0 commit comments

Comments
 (0)