Reinforcement learning agent saving error

Question

Yihao 2024-2-24

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2086278-reinforcement-learning-agent-saving-error

评论： Yihao 2024-2-29

Hi, I am not able to save the agent due to the warning "Warning: Unable to save the agent to the directory "savedAgents". Increase the disk space or check SaveAgentCriteriaValue in training options." However, I have sufficient space for at least 200 GB for the matlab directory.

How to solve it? Thanks in advance.

2 个评论
显示无隐藏无

Emmanouil Tzorakoleftherakis 2024-2-27

Do you have write access to that folder?

Yihao 2024-2-29

Maybe because of this, I will try again. Btw, In the rlTrainingOptions, I modified the storage type as 'SimulationStorageType',"none" rather than using default "memory". And it works which also lowers the data size.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Yihao 2024-2-29

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2086278-reinforcement-learning-agent-saving-error#answer_1418676

编辑：Yihao 2024-2-29

In the rlTrainingOptions, I modified the storage type as 'SimulationStorageType',"none" rather than using default "memory". And it works which also lowers the data size.

2 个评论
显示无隐藏无

Ari Biswas 2024-2-29

Hello Yihao,

The message is displayed if there were any issues when saving agents during training. It should not be related to setting the SimulationStorageType value, which saves simulation results (not agents) to memory or disk. If possible, please send some steps to reproduce the issue, such as how you created the agent, environment, and configured the training options. We will look into it. Thanks for using our tools.

Yihao 2024-2-29

Hi, Ari. Sorry I cannot share the detailed code. Basically what I did is to run a simulation with around 20us for like 0.02s for each training episode. And the agent at round 4000th training episode cannot be saved even though my disk space is quite sufficient.

Thanks for your help.

请先登录，再进行评论。