Does ValidationData in trainingOptions influence training progress
1 次查看(过去 30 天)
显示 更早的评论
Hi,
I trained a convolutional network and used ValidationData in trainingOptions to cross-check the validation error during training.
There seems to be a threshold when the RMSE of my training data again increases but still the validation RMSE goes down.
So I was wondering if that option would have an influence on that as there is nothing mentioned in the matlab documentation.
thanks for any help!
![trainingProgress.png](https://www.mathworks.com/matlabcentral/answers/uploaded_files/240131/trainingProgress.png)
0 个评论
采纳的回答
Gaurav Garg
2019-9-30
Hi,
The ValidationData in trainingOptions does not have any influence in training progress.
In actual, validation set is used to evaluate the given model and used to fine tune the model hyper-parameters. So, the validation set affects the model, but indirectly.
Also, validation of the data has no effect on training. While, the vice-versa may not be true because the model sees and learns from the training data and the validation model then evaluates the validation data. So, RMSEs of the training and validation phases have no effect on each other.
However, you can use k-fold cross validation to tune/fine-tune your parameters and get the best results for validation and test data. You can use cvpartition function for this.
更多回答(0 个)
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Get Started with Statistics and Machine Learning Toolbox 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!