How is it possible to use a validation set with a LSTM?

Question

Sofía 2018-4-26

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/397588-how-is-it-possible-to-use-a-validation-set-with-a-lstm

编辑： M J 2020-10-8

When I try to use the Validation set with a LSTM layer, it shows the following error:

options = trainingOptions('adam', ...
    'ExecutionEnvironment','gpu', ...
    'GradientThreshold',1, ...
    'MaxEpochs',maxEpochs, ...
    'ValidationData',{XTest,YTest},...
    'MiniBatchSize',miniBatchSize, ...
    'LearnRateSchedule','piecewise', ...
    'SequenceLength','longest', ...
    'Shuffle','never', ...
    'Verbose',0, ...
    'Plots','training-progress');
net = trainNetwork(XTrain,categorical(YTrain),layers,options);

Error:

Training with validation data is not supported for networks with LSTM layers.

Is there another way to use the Validation set during the training of the network?

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Kenta 2020-3-14

Now that, the use of validation data with LSTM network is available.

The example follows:

https://jp.mathworks.com/matlabcentral/fileexchange/74402-video-classification-using-lstm-lstm

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Joss Knight 2018-4-29

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/397588-how-is-it-possible-to-use-a-validation-set-with-a-lstm#answer_317732

It's ugly, but if you use Checkpoints, then you can use an OutputFcn to (once per epoch) load the network from a checkpoint and run it against your validation data. It isn't very efficient, but it's okay if you're only doing it once per epoch. You won't get it on the training plot of course.

10 个评论
显示 8更早的评论隐藏 8更早的评论

404: name not found 2020-6-17

Sadly, I only have access to 2018a with the Neural Network Toolbox at my university.

So I am still facing that problem. I already managed to setup the OutputFCN, but somehow the data gets lost after eacht epoch and is not saved. Also I can't fetch the LSTM - net after one epoch, with a checkpoint.

After setting optimoptions I can access the OutputFcn.

opt<-optimoptions (vargin)

options=( [....],...

'OutputFcn',@(info,output)outputFCN(info,opt,net));

Since info and net are output variables of 'trainNetwork', I had hoped that this variable would contain the network data (and that I won't need checkpoints). Essentially it stays empty. (if anyone was wondering...)

If I define output outside of the outputFCN as an empty struct (or an empty array), doTrainNetworks throws an error and it says:

Error using nnet.internal.cnn.util.UserCallbackReporter>iCallbackWrapper (line 115) Not enough input arguments.

Error in nnet.internal.cnn.util.UserCallbackReporter>@(f)iCallbackWrapper(f,this.Info) (line

85)

stop = cellfun( @(f) iCallbackWrapper(f, this.Info), this.Callbacks );

Error in nnet.internal.cnn.util.UserCallbackReporter/callCallbacks (line 85)

stop = cellfun( @(f) iCallbackWrapper(f, this.Info), this.Callbacks );

Error in nnet.internal.cnn.util.UserCallbackReporter/start (line 48)

this.callCallbacks();

Error in nnet.internal.cnn.util.VectorReporter/computeAndReport (line 56)

feval( method, this.Reporters{i}, varargin{:} );

Error in nnet.internal.cnn.util.VectorReporter/start (line 16)

computeAndReport( this, 'start' );

Error in nnet.internal.cnn.Trainer/train (line 62)

reporter.start();

Error in trainNetwork>doTrainNetwork (line 250)

trainedNet = trainer.train(trainedNet, trainingDispatcher);

only if 'output' is empty this error is not generated. Even if the data in info is now not interesting to me, since it is the same information in info, after a regular 'trainNetwork run', it is a problem as soon as I can access the weights of the NN and calculate the Validation RMSE, since this data will be lost after each step too.

I'd really apprechiate it if you could help me with both problems.

Firstly --> getting the Neural Network data after one epoch.

Secondly ---> how to get the data out of the OutputFcn without throwing an error as soon as I try to save it.

THANK you very much!

Joss Knight 2020-10-6

Hey M J, you should probably ask a new question and provide a bit more detail and code. Thanks.

M J 2020-10-8

编辑：M J 2020-10-8

Hi, thank you for your answer. I did ask a new question (see link below) :

I do not have a code for this, as I am really not sure where to even start. Also, I am not sure if it is okay to post a link to the question here, but if not, please let me know. Thank you.

https://www.mathworks.com/matlabcentral/answers/605561-is-there-a-way-to-get-a-predicted-label-for-every-group-of-patches-at-every-iteration-while-trainin?s_tid=prof_contriblnk

请先登录，再进行评论。