DDPG - Noise Model - sample time step - definition
显示 更早的评论
Hello!
At the moment i am tuning the Parameters of my DDPG Algorithm and i don´t fully understand the Updating process of the Ornstein-Uhlenbeck Noise Model.
The Matlab Documentation describes the Process of Updating the Noise Model of a DDPG-algorithm, consisting of a Formula, which is used in every "sample time step".
(https://www.mathworks.com/help/reinforcement-learning/ref/rlddpgagentoptions.html Chapter: Input Arguments)
But how is the "sample time step" defined? Does this correlate with the episode or step count of the RL trainingprocess?
Thanks
Niklas
采纳的回答
Emmanouil Tzorakoleftherakis
2019-8-2
0 个投票
Hi Niklas,
This post should be helpful. By "sample time step" the documentation refers to the "step count of the RL trainingprocess", i.e. each episode consists of a number of time steps, and noise is applied to the selected action at the begining of each time step. See this link for a description of DDPG (and specifically step #1). The time step value can be specified in the agent options here.
2 个评论
Niklas Reinisch
2019-8-5
Hello Emmanouil,
Thank you for your fast answer! It was helpful to understand the noise generation process.
But I got a consequential question, because the NoiseDecay(-Rate) is not explaned in the Link you mentioned. Am i right when saying:
?I hope you can help me with that one as well.
Thanks
Niklas
Emmanouil Tzorakoleftherakis
2019-8-5
Correct. This is why you want to keep the decay rate small or zero if you want to promote exploration.
更多回答（0 个）
类别
在 帮助中心 和 File Exchange 中查找有关 Waveform Generation 的更多信息
2019-8-2
2019-8-5
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
Translated by 
