Inconsistent training loss curve when training UNet with and without convergence criterion
7 次查看(过去 30 天)
显示 更早的评论
I want to train a semantic segmentation model using UNet layers. I trained the model one time without any convergence criterion and max epoch of 500 and the other time with a convergence criterion (validation patience of 10 and validation frequency of 25). The secnd training process converged at a lower epoch number compared to the first one. The results of the application of the second model is significantly less accurate than the first one on the test slices. I noticed that the training loss in the second training process is different from the first one. My question is that why defining a convergence criterion changes the training loss curve? I would be thankful if any one can help me understand why this is happening. The learning rate is constant and equal to 1e-05.
Training curves without convergence criterion:
Training curves with convergence criterion:
0 个评论
回答(1 个)
Matt J
2023-4-22
编辑:Matt J
2023-4-24
There should be a change in the training loss curve - it should be shorter. By loosening the stopping criteria, you cause fewer iterations to be run.
There will also be changes in the training loss curves due to the stochastic nature of the SGD algorithm and the parameter initialization.
3 个评论
另请参阅
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!