Why MATLAB uses the Newton’s Gradient Descent as the solver for fitcnet?

7 次查看（过去 30 天）
Memo Remo
Memo Remo 2023-1-28
评论： Memo Remo 2023-2-23
I want to train a neural network to perform image segmentation using fitcnet. I noticed that MATLAB uses the Newton’s Gradient Descent solver (LBFGS) to perform parameters optimization. Does anyone know why MATLAB selected this method over other optimization methods such as Adam or SGDM?
I would appreciate any help you could provide.

请先登录，再回答此问题。

采纳的回答

Lucas García
Lucas García 2023-2-20
L-BFGS is used both in in fitcnet and fitrnet. These functions ship in Statistics and Machine Learning Toolbox and allow you to get started in solving Machine Learning problems using Neural Networks.
For more customization capabilities, more advanced architectures and additional solver methods, you may use Deep Learning Toolbox. This includes the use of solvers such as SGDM, RMSProp or Adam. See trainingOptions for more details.
  3 个评论
显示 1更早的评论
Lucas García
Lucas García 2023-2-20
Good point Walter. I wanted to highlight that the solver available in Statistics and Machine Learning Toolbox is more appropriate for shallow networks (i.e. MLPs). L-BFGS has great convergence properties for small networks using smaller datasets.
For more complex networks, such as the one highlighted in the question (image segmentation), Deep Learning Toolbox does provide solvers such as SGDM and Adam (more appropriate for deeper network architectures).
It might be worth checking one of the Computer Vision Toolbox examples leveraging Deep Learning Toolbox: https://www.mathworks.com/help/vision/ug/semantic-segmentation-using-deep-learning.html
Memo Remo
Memo Remo 2023-2-23
Dear Lucas and Walter,
Thank you very much for your responses. They are very helpful.

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Sequence and Numeric Feature Data Workflows 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by