Training a DDPG agent for MIMO system

5 次查看（过去 30 天）
TANUJA JOSHI
TANUJA JOSHI 2022-8-24
回答： Hornett 2024-9-17
I am trying to train a DDPG agent for a MIMO system. The issue which I am facing is that the actor output i.e 'action values ' are very high (not in the action range ). These action values when given to the environment results in nan states. To solve this problem, i tried confining the action between the desired bounds by appling a tanh actuvation at the output layer of the actor and then scaled the action it to the actual bounds. Doing this, the action values are now in the range but the values are always on the higher bound and i am getting a constant action throughout. Not able to solve this issue now for a long time. PLease help me with this.
  1 个评论
Yi Zhao
Yi Zhao 2022-11-22
Hello, I have encountered the same problem. How did you solve it, please.

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

Hornett
Hornett 2024-9-17
Hi Tanuja,
I understand that you want to train a DDPG agent for MIMO system but the action values you are getting are always on the higher side with constant action throughput, here are a few things you can try to get the correct action values
  • Adjust the exploration rate or use different exploration strategies, such as epsilon-greedy or noise-based exploration. This can allow the agent to explore a wider range of actions and potentially discover better control strategies.
  • Learning rate: If the learning rate is too high, the weights in your neural network might be updating too drastically, which can lead to instability and constant action values. Try reducing the learning rate.
  • Reward function: The design of the reward function can significantly affect the learning of the agent. Make sure that your reward function is designed in such a way that it encourages the agent to learn the desired behaviour.
Please find links to below documentation which I believe will help you for further reference:
Hope this helps!

类别

在 Help Center 和 File Exchange 中查找有关 Reinforcement Learning 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by