Difference between using a rlContinuo​usGaussian​Actor and a rlContinuo​usDetermin​isticActor with a Gaussian Explorationmodel

1 次查看（过去 30 天）
Jonas Woeste
Jonas Woeste 2022-6-25
编辑： Manas 2023-9-8
Hi,
Someone please explain the difference between using a rlContinuousGaussianActor and using a rlContinuousDeterministicActor with a Gaussian Explorationmodel (namely the GaussianActionNoise) in reinforcement learning with e.g. a rlTD3agent.
With possibly using the rlContinuousGaussianActor using the Gaussian Explorationmodel would not be impossible: What is the point/ use case of this combination?
Thank you.
  1 个评论
Jonas Woeste
Jonas Woeste 2022-6-25
Despite rlContinuousGaussianActor not being applicable to rlTD3agent, some explanation about similarities of the GaussianActionNoise and the rlContinuousGaussianActor would be useful.

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

Manas
Manas 2023-9-8
编辑：Manas 2023-9-8
Hi Jonas Woeste,
I understand that you wish to know the difference between "rlContinuousGaussianActor" and "rlContinuousDeterministicActor" with a Gaussian exploration model.
The choice between these two approaches depends on the specific problem and the trade-off between exploration and exploitation.
“rlContinuousGaussainActor” is suitable when exploration is crucial and stochastic actions are desired. “rlContinuousDeterministicActor” is suitable for providing a stable policy with controlled exploration. It strikes a balance between exploration and exploitation. To introduce exploration, a Gaussian exploration model like “GaussianActiveNoise” is used. The exploration model adds Gaussian noise to the actor's output action, making it slightly perturbed and allowing exploration.
In summary, the choice of the combination depends on the nature of the problem and the desired behaviour of the agent you are seeking.
Hope this helps!

类别

在 Help Center 和 File Exchange 中查找有关 Noncentral t Distribution 的更多信息

标签

产品


版本

R2022a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by