Neural Networks Gradient - what is a good value?

Question

Tiago Dias 2019-12-5

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/495061-neural-networks-gradient-what-is-a-good-value

回答： Mahesh Taparia 2019-12-10

Hello,

When building neural networks with the toolbox, in the display I have a performance parameter, lower the better since it is the Mean Squared Error (MSE).

My problem is with the gradient parameter, i think it is associate to the MSE and what is a good value for it? if I got a gradient of 0.03, should I increase the number of epochs in order to make it lower?

I would appreciate some suggestion on this part. Should I be happy with my model only looking to the MSE/R2 ou should the decision also include the gradient paramter?

Best regards,

Tiago

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Mahesh Taparia 2019-12-10

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/495061-neural-networks-gradient-what-is-a-good-value#answer_405720

Hi Tiago,

Gradient is associated with the rate of change of MSE with respect to the weights. You can’t justify the model performance based on gradient value. The optimization algorithm should be able to locate the global minima of the loss function. At global/ local minima the gradient is very small and tends to zero.