Obtaining Information from Reinforcement Learning while Training

Question

Huzaifah Shamim 2020-8-4

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/575119-obtaining-information-from-reinforcement-learning-while-training

回答： Stephan 2020-8-16

While training my custom environment using a DQN, I want to be able to store the reward and another value at the end of each episode somewhere so that I may look at it at the end of training. How may I do that?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Stephan 2020-8-16

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/575119-obtaining-information-from-reinforcement-learning-while-training#answer_480651

The reward of each training episode is stored in the trainsStats struct which is the output argument of the train function. Inside this struct you find a bunch of informations regarding the training process. See here for what is strored int this struct.

If you want to store additional information you have to do some more effort. For example you could save additional informations inside a .mat-file always if the isDone flag is true in your step function.

The disadvantage of this apporach is, that loading a .mat-file, adding one or more values to it and saving it again can be a time consuming operation. Since you would do this only one time each episode (if the episode is over, indicated by the isDone flag), maybe this is an acceptable way to learn more about your agents behaviour during the training process.