Skip to content

Commit ee04d79

Browse files
WillCorticesAIWillFindley
authored andcommitted
Update comment for AdamW implementation reference. (ggml-org#4604)
Co-authored-by: Will Findley <[email protected]>
1 parent e8eb7fa commit ee04d79

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

ggml.c

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17456,9 +17456,9 @@ static void ggml_opt_acc_grad(int np, struct ggml_tensor * const ps[], float * g
1745617456
}
1745717457

1745817458
//
17459-
// ADAM
17459+
// Using AdamW - ref: https://arxiv.org/pdf/1711.05101v3.pdf
1746017460
//
17461-
// ref: https://arxiv.org/pdf/1412.6980.pdf
17461+
// (Original Adam - ref: https://arxiv.org/pdf/1412.6980.pdf)
1746217462
//
1746317463

1746417464
static enum ggml_opt_result ggml_opt_adam(

0 commit comments

Comments
 (0)