How to retain the derivative trace of a dlarray out of dlfeval function

2 次查看（过去 30 天）
Xiaowen Jiang
Xiaowen Jiang 2021-7-18
回答： Akshat 2024-2-16
Hi! In the deep learning toolbox, when we set 'RetainData' to be true in dlgradient function, a dlarray retains the derivative trace until the end of the dlfeval function call that evaluates the dlgradient. If we want to reuse this trace again outside the function, for example, to compute higher order derivatives but not in the original function which is used to compute gradient, how can we do that? Thank you very much for you help.

请先登录，再回答此问题。

回答（1 个）

Akshat
Akshat 2024-2-16
Hi Xiaowen,
As you asked in the question, you want to retain the trace in order to perform some tasks like computing higher order derivatives.
If you go through https://www.mathworks.com/help/deeplearning/ref/dlarray.dlgradient.html#mw_ef6d7d9f-bce7-4417-ade7-fa36594d55bb, it is written that if you set the flag "EnableHigherDerivatives" as true, you can retain the intermediate values for future calls of the "dlgradient" function.
An example given for this is https://www.mathworks.com/help/deeplearning/ug/trainwasserstein-gan-with-gradient-penalty-wgan-gp.html, you can refer to the documentation page for more examples.
Link to the documentation page is https://www.mathworks.com/help/deeplearning/ref/dlarray.dlgradient.html.
Hope this helps!

类别

在 Help Center 和 File Exchange 中查找有关 Custom Training Loops 的更多信息

标签

产品


版本

R2021a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by