Using bayesopt instead of fmincon in Matlab example of "Solving Burgers PDE with Deep Learning

8 次查看(过去 30 天)
Hello everyone,
I am trying to understand how to solve PDE with PINNs using different optimization methods. in this example (https://www.mathworks.com/help/releases/R2022b/deeplearning/ug/solve-partial-differential-equations-with-lbfgs-method-and-deep-learning.html)
the fmincon and L-BFGS are used to optimize the hyperparameters of the PINN. Actually I am trying to solve this example using the bayesopt but I do not have clue how to replace fmincon.
I hava read the documentation of bayesopt
But what is not clear to me is how to make the hyperparameters of PINNs in this example like neurons, weights and biases to be optimizable variables?
Thanks in advance.
  4 个评论
Alan Weiss
Alan Weiss 2023-4-23
I don't know how many optimizable variables your model has now. If just a dozen or so then yes, you can use bayesopt, though I am not sure why you would want to. What do you hope to gain? bayesopt is much, much slower than fmincon and cannot use derivative information. Do you suspect that there are multiple local minima? If so, you would almost certainly be better advised to use MultiStart with fmincon instead of bayesopt. But do what you want.
Alan Weiss
MATLAB mathematical toolbox documentation
Muhammad Mahmoud
Muhammad Mahmoud 2023-4-24
In fact, I do suspect multiple local minimums, but not in the present case. I simply wish to use this example to solve another PDE of the "Advection-Diffusion-Reaction" type. Also, I do not know based on what criteria the number of layers and number of neurons in this example would be selected, so I used bayesopt to find the optimal combination of number of layers and number of neurons. Many thanks for your helpful advices and insightful suggestions.

请先登录,再进行评论。

回答(0 个)

类别

Help CenterFile Exchange 中查找有关 Model Building and Assessment 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by