How to retrain existing and trained Neural Network without destroying trained content?

37 次查看（过去 30 天）
Mirek Wilmer
Mirek Wilmer 2018-4-23
评论： TROY TULLY 2021-4-9
Matlab train() function used for training the neural network initializes all weights and other internal parameters of the network at the beginning. I would like to take a trained network and train it further using new set of data without reinitializing and starting from scratch (destroying the trained net basically). How do I do it ? Is there a way to use existing train() function or is there some re-train() function or do I need to build my own custom solution ? The last option seems unlikely, given the amount of the existing Matlab code. Please advise, Thanks, Mirek Wilmer mirek.wilmer@gmail.com

请先登录，再回答此问题。

回答（4 个）

Greg Heath
Greg Heath 2018-8-7
编辑：Greg Heath 2018-8-7
TRAIN initializes weights ONLY IF ALL weights are zero.
OTHERWISE
TRAIN will update weights with the new data.
Therefore old weights will be modified to fit the new data.
If the new data is unlike the old data, performance on the old data will be degraded.
In order to prevent "FORGETTING", a characteristic subset of the old data SHOULD BE MIXED with the new data for the retraining.
Hope this helps.
Thank you for formally accepting my answer
Greg
Greg Heath
Greg Heath 2018-8-3
In order to preserve the dominant characteristics of the 1st dataset you must include that information while adapting to the new data. Therefore I always represent the 1st data set by a representative subset and add that to the new set.
I have been most successful when using Elliptic or Gaussian basis functions (with limited effective range) in the net.
Hope this helps.
Thank you for formally accepting my answer
Greg
KSSV
KSSV 2018-4-23
The function train gives out a structure variable net with all the information of training the inputs have under gone.
[net,tr] = train(net,.......)
If you don't clear your workspace, you can use the variable net for what you want. It will retain all the previous data.
[net,tr] = train(net,newdata.....)
  4 个评论
显示 2更早的评论
Gideon Prior
Gideon Prior 2018-8-7
That isnt the case unfortunately. Calls to 'train' reinitialize the weights, which is odd since there is a method 'init' already included in the toolbox. I dont know why the mathworks folks decided to not include an option to prevent initialization when 'train' is called.
Kinga Wilmer
Kinga Wilmer 2018-8-7
As a mater of fact, if the workspace is not cleared and the definition of net is not changed, then train() function does not destroy the existing weights. I did trace the whole process with a debugger step by step and confirmed it. Therefore you can re-use your trained net for further training. Mind you, the additional data may re-train your net, so if you want to retain the existing trained capacity, you need to keep statistically important sample representation of your previous training data in the new training dataset. Therefore only small incremental retraining steps make sense. Another way is to train number of separate networks and combine them into hierarchical model.

请先登录，再进行评论。

kira
kira 2018-9-26
If you want to train incrementally on your data set, you can also do it all at once by dealing with them as concurrent data https://www.mathworks.com/help/deeplearning/ug/multiple-sequences-with-dynamic-neural-networks.html

类别

在 Help Center 和 File Exchange 中查找有关 Sequence and Numeric Feature Data Workflows 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by