Why does the SAC trainning stop at the first episode? What can trigger it?

18 次查看（过去 30 天）
Renaldo
Renaldo 2024-11-14，8:41
编辑： Ayush Aniket 2024-11-14，8:56
I am trainning an SAC Agent for a path following mobile robot in matlab with 2 different PI controllers one for the linear velocity controll and the other for the angular velocity. I connected the parameters Ki and Kp of both Controllers to the SAC Agent. I decided to define the Reward as (Reward = -0.1*(abs(Error_Linear)+abs(Error_Angular))) and the stopping condition (Is_done = (abs(Error_Linear)+abs(Error_Angular))<1). I am not understanding what triggers the trainning process to stop at the first episode.

请先登录，再回答此问题。

回答（1 个）

Ayush Aniket
Ayush Aniket 2024-11-14，8:55
编辑：Ayush Aniket 2024-11-14，8:56
Hi Renaldo,
The reason for the agent training stopping after first episode could be due to the "Training termination" condition specified as the StopTrainingCriteria argument in the rlTrainingOptions function. Refer to the following documentation link to read about the argument:
https://www.mathworks.com/help/reinforcement-learning/ref/rl.option.rltrainingoptions.html#mw_1f5122fe-cb3a-4c27-8c80-1ce46c013bf0_sep_mw_048b4e51-aaae-49c2-9079-d7df54898ced
One similar example can be found here: https://www.mathworks.com/matlabcentral/answers/1779640-reinforcement-learning-agent-stops-training-unexpectedly
If this is not the issue, please share the script you are using.

类别

在 Help Center 和 File Exchange 中查找有关 Reinforcement Learning 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by