How to use DDP + FP16 without fit? #6468
Unanswered
turian
asked this question in
DDP / multi-GPU / multi-node
Replies: 1 comment 1 reply
-
Seems to work? |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
We have a model that doesn't require fit(). We just want to run inference with it using DDP + FP16.
Shoe-horning it into lightning is a little strange, but it gives use DDP + FP16 very easily. However, it appears that we need a dummy fit() (with dummy optimizer and train_step).
Without fit(), we get strange errors just invoking test. How can we use DDP + FP16 without fit?
Beta Was this translation helpful? Give feedback.
All reactions