Why do agents trained by the reinforcement learning PPO algorithm get different results each time they load？

Question

ye 2024-8-17

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2145889-why-do-agents-trained-by-the-reinforcement-learning-ppo-algorithm-get-different-results-each-time-th

回答： Shivansh 2024-8-18

In the process of reinforcement learning, a problem will be encountered. During the training process, an effective agent will appear. At this time, the training will be finished in advance, but the result of the saved agent running out will be worse

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Shivansh 2024-8-18

Hello Ye,

The behaviour shown by the agents trained by the reinforcement learning PPO algorithm suggests there might be some randomness involved in the environment. Since, the performance worsens for saved agents, it is also possible that the agent might be overfitted on certain episodes while training and the performance might not be same for other episodes. Try to remove any stochasticity in the model using deterministic seeds. You can also try to evaluate the model on various episodes to get a better understanding of the issue.

If the issue still remains unclear, share more information regarding the model and the environment.

I hope it helps!