how does check gradient compare supplied gradients with finite difference gradients?

Question

omid Heydarnia 2023-5-10

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1960779-how-does-check-gradient-compare-supplied-gradients-with-finite-difference-gradients

评论： Torsten 2023-5-11

Dears,

I supplied objective function gradients for the fmincon that faced an error with a massive difference between supplied and finite difference! Since I checked the way I provide gradients multiple times and implemented it for other systems, I thought a singularity might cause this big difference!

I have 415 optimization parameters, and the error occurs for 380. Interestingly, my optimization problem is a direct multiple shooting for a system which means the error occurs on one of the control parameters that objective gradient respect to it was correct in the past shooting nodes!!

I'll be grateful if you know how the check gradient option works. And give some insight into this problem.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Alan Weiss 2023-5-11

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1960779-how-does-check-gradient-compare-supplied-gradients-with-finite-difference-gradients#answer_1233159

The CheckGradients option causes solvers to compare a finite-difference gradient estimate to the supplied gradient value, and if the relative difference is more than 1e-6 apart, CheckGradients throws an error.

Sorry, the option has no provision for changing the 1e-6 tolerance. The option does respond appropriately to the FiniteDifferenceType and FiniteDifferenceStepSize options, so you can play around with those options to see if you can get the CheckGradients option to work more effectively for you.

Alan Weiss

MATLAB mathematical toolbox documentation

2 个评论
显示无隐藏无

omid Heydarnia 2023-5-11

Thank Alen for your answer.

Would you please tell me how I can interpret the error log? For example, when the log demonstrates the error between supplied and finite-difference gradient for derivative element (368,1) is high, can I interpret that the supplied gradient elements between 1 to 367 are less than 1e-6?