Can I tell trainNetwork() to return the net with the lowest validation or training loss, as opposed to the net at the last iteration?

Question

Nethtrick 2020-9-22

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/598039-can-i-tell-trainnetwork-to-return-the-net-with-the-lowest-validation-or-training-loss-as-opposed

回答： Madhav Thakker 2020-9-25

Sometimes training diverges and it's wasteful to re-run with a specific stopping epoch. I could use checkpoints and sift through the trainingInfo to find the lowest loss, but that carries costs in memory and time. Also I am using the Experiment Manager and I'd have to add special code to load the correct checkpoint in my custom metric function. Having a training option to return the net that minimizes the loss would allow me to easily compare multiple experiments, where divergence may occur at different training epochs. Also, minimizing the loss is the definition of training, so it just makes sense.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Nethtrick 2020-9-22

A similar question:

https://www.mathworks.com/matlabcentral/answers/409357-how-can-we-save-neural-network-with-best-validation-loss

I have implemented the checkpoint approach, but am also running into the same issue with batch normalization layers not being defined. So the checkpoint approach is NOT a workaround when your network has batch normalization layers.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Madhav Thakker 2020-9-25

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/598039-can-i-tell-trainnetwork-to-return-the-net-with-the-lowest-validation-or-training-loss-as-opposed#answer_500320

Hi Nethrick,

As of now, it is not possible to save the network with the least validation error in DAGNetwork.

However, you might want to explore Custom Training Loops -

Custom Training Loops with dlnetwork (More flexible that trainNetwork/DAGNetwork)
Custom Training Loop with Model as Function (Most flexible)

Here is the doc link to the Custom Training Loop page: https://www.mathworks.com/help/deeplearning/ug/define-custom-training-loops-loss-functions-and-networks.html

Examples (R2020a) for these features are available here:

Custom Training Loops with dlnetwork: https://www.mathworks.com/help/deeplearning/ug/train-network-using-custom-training-loop.html
Custom Training Loop with Model as Function: https://www.mathworks.com/help/deeplearning/ug/train-network-using-model-function.html

In order to use these more flexible tools, it is suggested to get the newest release.

You can also have a look at https://www.mathworks.com/help/deeplearning/ug/customize-output-during-deep-learning-training.html which has an example of defining the output function which stops network training if the best classification accuracy on the validation data does not improve for N network validations in a row.

Hope this helps.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Can I tell trainNetwork() to return the net with the lowest validation or training loss, as opposed to the net at the last iteration?

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

回答（1 个）

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

另请参阅

类别

标签

Community Treasure Hunt

Can I tell trainNetwork() to return the net with the lowest validation or training loss, as opposed to the net at the last iteration?

1 个评论 显示 -1更早的评论隐藏 -1更早的评论

回答（1 个）

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

另请参阅

类别

标签

Community Treasure Hunt

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

0 个评论
显示 -2更早的评论隐藏 -2更早的评论