Tolerances are relative or not in interior-point for fmincon?

2 次查看(过去 30 天)
Hi, my colleges,
The document for Tolerances and Stopping Criteria in Matlab says, StepTolerance and FunctionTolerance could be relative or absolute. https://fr.mathworks.com/help/optim/ug/tolerances-and-stopping-criteria.html
But in the introducetion for interior-point for fmincon, there is not any information about this method whether the tolerances are relative or absolute.
https://fr.mathworks.com/help/optim/ug/choosing-the-algorithm.html#btr9d6u
Is there anyone know about it?
Best regards.

回答(2 个)

Alan Weiss
Alan Weiss 2017-3-16
You can find out the answer using the exit message link stopping criteria details. Here is what I just saw after running a small problem:
Optimization completed: The relative first-order optimality measure, 4.268868e-08,
is less than options.OptimalityTolerance = 1.000000e-06, and the relative maximum constraint
violation, 0.000000e+00, is less than options.ConstraintTolerance = 1.000000e-06.
Optimization Metric Options
relative first-order optimality = 4.27e-08 OptimalityTolerance = 1e-06 (default)
relative max(constraint violation) = 0.00e+00 ConstraintTolerance = 1e-06 (default)
Clearly, relative tolerances were used.
Alan Weiss
MATLAB mathematical toolbox documentation
  3 个评论
Mohammad
Mohammad 2020-4-21
Hi
How can find an exact definition of relative first-order optimality?
I search a lot in MATLAB document and net but I can not find any.
Tnx
Huayu Tian
Huayu Tian 2020-10-16
Hi,
Yes that's also my question. I cannot find the exact definition for the relative first-order optimality.
In the link below it mentions the scaling factor to define a relative first order optimality can be either (1) the infinity norm of the gradient at the starting point, or (2) the infinity norm of inputs to the solver, but it does not state specifically what scaling factor fmincon is using. I guess it's using (1) but I am not sure.
I also checked exit message but it only contains a link to first-order optimality measure, not a definition of relative one.
Does anybody know the definition of relative first-order optimality for each solver (especially fmincon)?
Many thanks.

请先登录,再进行评论。


Nick Van Oosterwyck
编辑:Nick Van Oosterwyck 2023-3-27
You can also get an overview of all the algorithms and whether the tolerances are relative or absolute on:

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by