incremental training (large data set)

3 次查看（过去 30 天）
Michal
Michal 2020-2-18
编辑： Michal 2020-3-26
Is the following approach suitable for NN incremental learning in general?
for bn = 1:num_batches
inputs = <get batch bn inputs>;
targets = <get batch bn targets>;
net = train(net, inputs, targets);
end
Is there any recomanded method how to split large data set on a separate batches and how to perform validation and testing?
I will be happy for any relevant reference and/or matlab examples (tutorial).

请先登录，再回答此问题。

回答（1 个）

Sai Bhargav Avula
Sai Bhargav Avula 2020-3-26
Hi,
You can try using tall array. Datastore object can also be used for this purpose. You can split the data using cvpartition for the validation and testing
Hope this helps!
  7 个评论
显示 5更早的评论
Michal
Michal 2020-3-26
编辑：Michal 2020-3-26
OK ... and my type of problem correspond to the "Batch Training" or "Incremental Training with adapt"?
I am still not sure, which method is suitable for integration of new information to one NN. Is the proper method "Batch Training" in my case?
May be, should be better to communicate directly via email.

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Sequence and Numeric Feature Data Workflows 的更多信息

标签

产品


版本

R2019b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by