Realize MADDPG in Matlab

48 次查看（过去 30 天）
Huan Yang
Huan Yang 2021-1-3
评论： MAZBAHUR KHAN 2023-9-11
I am working on a multi agent DRL issue. My environment is created by the MATLAB environment template. As MADDPG uses a common critic but different actors during the training process, I'm afraid that I still cannot realize this DRL model currently. The experience buffer is also different from the one of DDPG agent.

请先登录，再回答此问题。

回答（1 个）

Emmanouil Tzorakoleftherakis
To create agents that share critics I believe you would have to implement that using a custom agent/training loop (see here and here). The built-in algorithms don't allow you to do that.
Also, as of R2020b, you can have (decentralized) multi-agent training in Simulink only (not with a MATLAB environment). If this is of interest to you, you can turn your MATLAB environment into a Simulink one using a MATLAB Function block.
  3 个评论
显示 1更早的评论
Emmanouil Tzorakoleftherakis
Emmanouil Tzorakoleftherakis 2023-9-11
Unfortunately, this is not possible as of R2023a unless you write your own custom loop, but this is something we are looking at.
MAZBAHUR KHAN
MAZBAHUR KHAN 2023-9-11
@Emmanouil Tzorakoleftherakis thank you very much for replying.
I am going through one more issue I was hoping you could help me with.
For a decentralised multi agent training for multiple mobile robot path planning, I have set the episode termination criteria ( in simulink :isdone) for each robot individually such that when the robot clashes with an obstacle or reaches the goal position, the episode is terminated. But I noticed that when one robot has reached its episode termination criteria but the other robots haven’t, the episode terminates and new episode begins. And in the next episode all the robots are assigned into new initial positions. Hence inefficiency is induced in training of each robot since their reward collection is getting interrupted for the other robots episode termination even though they havent reached their own termination criteria.
I was wondering, is there a way to make a robot wait for other robots to reach their termination criteria after it reaches its own episode termination criteria before a new episode starts for all robots?

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Reinforcement Learning 的更多信息

标签

产品


版本

R2020b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by