In learning curve, training error decrease with increase training datasize.

3 次查看（过去 30 天）
Qiang Wang
Qiang Wang 2021-2-2
回答： Shashank Gupta 2021-2-5
I’ve learned and observed that training loss / error increases with training data size as stated in Dr Andrew Ng’s ML course.
I’ve recently experienced an anomaly. Training error and Test error curves were decreasing while training data size was increasing.
is this normal?
Some post said because regularization. in my case I use trainbr :Bayesian regularization backpropagation
https://stats.stackexchange.com/questions/372278/how-is-it-possible-training-and-validation-loss-curves-were-decreasing-while-tr
is this reason?
Thank you.

请先登录，再回答此问题。

采纳的回答

Shashank Gupta
Shashank Gupta 2021-2-5
Hi,
These all figures boils down to number of learnable parameter v/s training data size. Regularization and all does have impact on the loss and yes it is possible that it might be the case. Also there are many other reasons, the graph which you plot describing the losses, are these optimal? does all hyperparameters are optimized properly? Prof. Andrew Ng talks about cases when optimality is reached. Now if you increase the training data. The optimal loss with same number of learnable parameter and more training data will be higher. It is a tradeoff. The explanation given in the link which you shared also make sense. There is no denial.
I hope my insight gave you enought help.
Cheers.

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Box Plots 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by