Sending episode number to simulink during training

Question

Esan freedom 2023-1-24

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1899615-sending-episode-number-to-simulink-during-training

编辑： Emmanouil Tzorakoleftherakis 2023-1-25

Hello every one,

I am using reinforcement learning with two agents and I am going to laod the number of episode from workspace in simulink by "from workspace block". I tried trainingStats.EpisodeIndex(1) but I recieved error. As trainingStats would appear after terminating episode 1, I dont have any idea to find the episode number in simulink.

I would appreciate any help.

@Emmanouil Tzorakoleftherakis

3 个评论
显示 1更早的评论隐藏 1更早的评论

Benjamin Thompson 2023-1-24

Can you provide a listing of the error message and more examples of what you are doing and how you are doing it?

Esan freedom 2023-1-24

workspace.PNG

Thanks at first.

For my reinforcement learning agent, I need to build a special reward for my reinforcement learning agent that starts giving a penalty after episode 100th. For that, I need to read the number of episode in Simulink and if it is below the 100th episode, then the reward is set to zero, and after the 100th episode, It starts getting a penalty.

I have to agents and for example after 4 episods in the Workspace I have this index in the below Fig.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Emmanouil Tzorakoleftherakis 2023-1-24

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1899615-sending-episode-number-to-simulink-during-training#answer_1155255

编辑：Emmanouil Tzorakoleftherakis 2023-1-24

The training stats are not available until after training is done, so you cannot use trainingStats.EpisodeIndex during training. The easiest way to accomplish what you want is by using the reset function. Take a look at this example.

The reset function is called before every episode, so you can use it to create a counter for the episode number and assign it either to a workspace variable, or directly to e.g. a Constant block in Simulink.

Hope that helps

4 个评论
显示 2更早的评论隐藏 2更早的评论

Esan freedom 2023-1-25

Dear Emmanouil, you are the best.

I am grateful for your help and time. Thank you so much. By the following code, I have solved my problem.

function in= localResetFcn(in)
persistent n
if isempty(n)
n = 0;
end
n = n+1
blk = 'PV/Control_rll/count';
in = setBlockParameter(in,blk,'Value',num2str(n));
end

Emmanouil Tzorakoleftherakis 2023-1-25

编辑：Emmanouil Tzorakoleftherakis 2023-1-25

Glad it was helpful

请先登录，再进行评论。

Answer 2

Fangjun Jiang 2023-1-24

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1899615-sending-episode-number-to-simulink-during-training#answer_1155150

Try the Constant block and specify the value as trainingStats.EpisodeIndex(1). Read the document of the "From Workspace" block to see if it is what you needed.