Reinforcement Learning multiple agent validation: Can I have a Simulink model host TWO agents and test them

Question

Rajesh Siraskar 2021-4-6

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/794287-reinforcement-learning-multiple-agent-validation-can-i-have-a-simulink-model-host-two-agents-and-te

评论： Rajesh Siraskar 2021-4-8

采纳的回答： Emmanouil Tzorakoleftherakis

在 MATLAB Online 中打开

Hi,

I am conducting research to see how PPO performs versus DDPG - for non-linear plants. I have trained two agents.

Can I have a Simulink circuit host TWO agents and test them? Basically trying to create a unified validation bench. Please see image below.

I did go through the documentation and tried this implementation but am getting errors.

Code:

% Set Simulink model pointers
PLANT_SIMULATION_MODEL = 'sm_Experimental_Setup'; % Simulink experimentation circuit
DDPG_AGENT = '/DDPG Sub-System/DDPG_Agent';
PPO_AGENT = '/PPO Sub-System/PPO_Agent';
% Load experiences from pre-trained agent    
DDPG_agent = load(DDPG_MODEL_FILE,'agent');
PPO_agent = load(PPO_MODEL_FILE,'agent');
% Code here for setting (1) obsInfo and (2) actionInfo_DDPG and (3) actionInfo_PPO
% .... ... 
% Intialise the environment with the serialised agent and run the test
env = rlSimulinkEnv(VALVE_SIMULATION_MODEL, [DDPG_AGENT PPO_AGENT], [obsInfo obsInfo], [actionInfo_DDPG actionInfo_PPO]);
simOpts = rlSimulationOptions('MaxSteps', 2000);
xpr = sim(env,[DDPG_agent.agent, PPO_agent.agent]);

ERROR message:

Error using rlSimulinkEnv (line 108)
No block diagram name specified.
Error in code_DDPG_PPO_Experimental_Setup (line 97)
env = rlSimulinkEnv(VALVE_SIMULATION_MODEL, [DDPG_AGENT PPO_AGENT], [obsInfo obsInfo], [actionInfo_DDPG actionInfo_PPO]);

Screen capture of Simulink model:

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Emmanouil Tzorakoleftherakis 2021-4-6

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/794287-reinforcement-learning-multiple-agent-validation-can-i-have-a-simulink-model-host-two-agents-and-te#answer_668682

在 MATLAB Online 中打开

That should be possible. Did you follow the multi-agent examples? Since the agents are trained already you may want to check the last part in the links below where agents are simulated.

https://www.mathworks.com/help/reinforcement-learning/ug/train-agents-for-path-following.html

https://www.mathworks.com/help/reinforcement-learning/ug/train-3-agents-for-area-coverage.html

By the way, the error you are getting makes me think the the path you provide below is not complete

DDPG_AGENT = '/DDPG Sub-System/DDPG_Agent';
PPO_AGENT = '/PPO Sub-System/PPO_Agent';

Try adding the model name too.

Hope this helps

3 个评论
显示 1更早的评论隐藏 1更早的评论

Emmanouil Tzorakoleftherakis 2021-4-7

Based on what I see on the screenshot it should be something along the lines of 'sm_DDPG_PPO_Experimental_Setup/DDPG_Sub_System/DDPG_Agent'

I suggest taking a look at any of the Simulink examples in Reinforcement Learning Toolbox to see how the path is defined. Even the links above should work. The first thing in the path should be the model name.

Rajesh Siraskar 2021-4-8

Thank you Emmanouil - that worked.

请先登录，再进行评论。

Reinforcement Learning multiple agent validation: Can I have a Simulink model host TWO agents and test them

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

3 个评论
显示 1更早的评论隐藏 1更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

Reinforcement Learning multiple agent validation: Can I have a Simulink model host TWO agents and test them

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

3 个评论 显示 1更早的评论隐藏 1更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

3 个评论
显示 1更早的评论隐藏 1更早的评论