continuing training #900
taborzbislaw
started this conversation in
General
continuing training
#900
Replies: 2 comments
-
|
See #901 . Is there anything else we should discuss here? :-) |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Hi, no, everything is clear now. Thank you :) Best regards, |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I am trying to continue training for BrainTumour dataset of Medical Segmentation Decathlon.
After training for about 5000 epochs I reach the time limit of a queue system where I am doing computations so I have to restart training. I insert -c option to the command line. The training starts again but I got a strange behaviour as in the enclosed figure - it appears that the training is starting from scratch instead of starting from the latest checkpoint. What can be the cause of the problem?
Best regards,
Zbisław
Beta Was this translation helpful? Give feedback.
All reactions