Stopping conditions for DQN training

Question

Zonghao zou 2020-10-18

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/617448-stopping-conditions-for-dqn-training

回答： Madhav Thakker 2020-11-25

Hello all,

I am currently playing around with DQN trainning. I am trying to find a systemic way to stop the trainning process rather than to stop it mannually. However, for my trainning process, I have no idea what the end rewards will be and I don't have a target point to reach. Therefore, I do not know when to stop.

Is there a way for me to stop DQN agent without those information and guarentee some type of convergence?

Thanks for helping!

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Madhav Thakker 2020-11-25

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/617448-stopping-conditions-for-dqn-training#answer_555743

Hi Zonghao zou,

One possible parameter to consider when stopping training is Q-Values. If the Q-Values are saturated, it means that no learning is happening in the network. You can perhaps look at your Q-values and decide a threshold, to perform early-stopping in the network. You don't need the end-reward or target-point to perform early stopping based on Q-Values.

Hope thi helps.