Neural Network Batch Training by calling train multiple times

4 次查看（过去 30 天）
Manos Kav
Manos Kav 2018-5-30
评论： Ana Guerra Langan 2019-11-19
Hello,
I have a huge dataset and I want to train my neural network using GPU. Unfortunatelly, I run out of memmory if I try to train it using the entire dataset. Is it the same If I train the network multiple times using mini-batches from the dataset or will the network just learn the last mini-batch?
I am using a custom neural network and train() function for the training.
Thanks in advance.

请先登录，再回答此问题。

回答（1 个）

Aditya Salveru
Aditya Salveru 2018-5-31
编辑：Aditya Salveru 2018-5-31
Hi,
Your machine is running out of memory as you trying to train network with entire data set at once.
I would suggest you to use mini-batches, for example mini batch gradient descent and also select the batch size appropriately to reduce the risk of running out of memory.
It is same as training the network with entire data set at once.
You can find more information about training parameters here.
Thank you.
Aditya Salveru.
  2 个评论
Manos Kav
Manos Kav 2018-5-31
Thanks for your response. I am using custom neural network. I am creating it with the network() function. Unfortunatelly, it can't be trained with trainNetwork function, but with the train function. So I am looking for mini-batch training with the train function.
Ana Guerra Langan
Ana Guerra Langan 2019-11-19
Did you find a way to do it in the end? I have the same problem at the moment and trying to figure out how to proceed...
  • Should I manually create a loop for each batch of data and run the train inside it for each batch for say 100 epochs each and then use the trained network as input for the next batch?
  • Should I just move to deep learning even though my data has nothing to do with images and I don't think I need an architecture that is that deep?
  • Or should I run the batch loop for just one single epoch adn then repeat this for so many iterations?
I'm also not sure how to deal with the validation set, since I have a separate batch of data for validation...

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Image Data Workflows 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by