Neural Network Checkpoint Frequency

4 次查看（过去 30 天）
Jordan Houri
Jordan Houri 2018-12-15
评论： Jordan Houri 2018-12-17
I am training a U-net for image segmentation and I noticed that it seems MATLAB does not allow you to specify the number of iterations per epoch in the training options, and instead defines an epoch as a single run through all the training images. I am using a very large number of images, so that the network runs through around 25,000 iterations per epoch and I would like to be able to test checkpoint networks more frequently than this.
Is there any way to save checkpoint networks more frequently than once per epoch, or to specify iterations per epoch?

请先登录，再回答此问题。

回答（1 个）

Akshay Kumar
Akshay Kumar 2018-12-17
To reduce the number of images(iterations) the network sees in every epoch, you can specify a mini batch.
For example: If you run mini-batch update with batch size = b, every parameter update requires your algorithm see b of n training instances, i.e., every epoch your parameters are updated about n/b times.
You can specify the mini batch size using the 'MiniBatchSize' name-value argument of the 'trainingOptions' function.You can refer the below documentation for more information regarding this:https://www.mathworks.com/help/deeplearning/ref/trainingoptions.html
It is not possible to save checkpoints more than once per epoch, however by this you can save checkpoints based on your mini batch size.
  2 个评论
Ash Ash
Ash Ash 2018-12-17
Is it possible to save checkpoints every x number of epochs insteadof every epoch ?
Jordan Houri
Jordan Houri 2018-12-17
Thank you Akshay. Unfortunately I am already using a minibatch size of 4, which is just about the maximum that memory allows with 512 by 512 images. It seems there is nothing I can do about it then.

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Image Data Workflows 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by