The definition of the Target update frequency in Reinforcement Learning Designer.

8 次查看(过去 30 天)
In DDPG Agent, there are four networks. Online policy, Target policy, Online Q and Target Q.
The [Target update frequency] is used to the Target policy and Target Q in Reinforcement Learning Designer.
Are the Update frequency of the Online policy and Online Q same as the [Target update frequency] ?

采纳的回答

UDAYA PEDDIRAJU
UDAYA PEDDIRAJU 2024-3-12
Hi Xian,
No, the update frequency of the Online Policy and Online Q networks is not the same as the Target Update Frequency. The Target Update Frequency specifically applies to how often the Target Policy and Target Q networks are updated, which is typically less frequent or managed differently to ensure stability in learning.
  1 个评论
Xian Zheng Hong
Xian Zheng Hong 2024-3-16
Thanks for answering. Here is my another question.
Are the Online policy and Online Q updated at every time step in Reinforcement Learning Designer Toolbox?

请先登录,再进行评论。

更多回答(0 个)

类别

Help CenterFile Exchange 中查找有关 Deep Learning Toolbox 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by