Modify weights update rule of DDPG traning

2 次查看（过去 30 天）
Vu Thang
Vu Thang 2024-9-20
评论： Vu Thang 2024-9-24
Currently, i have studied DDPG algorithm for my control project. I want to modify a bit in the weight update rule (gradient descent) to reduce the steady state error of system. How can i do this?

请先登录，再回答此问题。

回答（1 个）

Shubham
Shubham 2024-9-22
Hey Vu,
In order to make modifications in your gradient descent function, you can make changes in "rlOptimizerOptions" object as mentioned in the documentation for DDPG agent: https://www.mathworks.com/help/releases/R2023b/reinforcement-learning/ug/ddpg-agents.html
In order to make changes in the weight update rule,
  • modify the "LearnRate" to change the rate at which the the model is converged.
  • modify the "L2RegularizationFactor" to avoid overfitting.
Have a look at the "rlOptimizerOptions" for more details:
https://www.mathworks.com/help/reinforcement-learning/ref/rl.option.rloptimizeroptions.html#d126e67296
Happy coding!
  1 个评论
Vu Thang
Vu Thang 2024-9-24
Thank you for your comment. I have tried modify the 'LearnRate' but it seem not work, the steady state error still available. I want to add an Integral component to weight update rule as some papers suggest. Is there any way to do it?

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Reinforcement Learning 的更多信息

标签

产品


版本

R2023b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by