Skip to content

Commit 93201ab

Browse files
committed
add trainable lora-only model with all big matrices C split into A,B with A*B=C
this is not a lora-finetune, but the whole model changed to have only low-rank "lora" matrices. training this instead of the normal model resulted in much worse results though...
1 parent e91b83b commit 93201ab

File tree

1 file changed

+503
-1
lines changed

1 file changed

+503
-1
lines changed

0 commit comments

Comments
 (0)