Load data into experience buffer: DDPG agent

9 次查看（过去 30 天）

Daksh Shukla 2020-2-23

2
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/507154-load-data-into-experience-buffer-ddpg-agent

评论： Francisco Serra 2023-12-20

I am using RL toolbox version 1.1 with Matlab R2019b and using the DDPG agent to design a controller. Is there a way to load in data (state, action, reward, next state) collected from real experiments into the experience buffer before startting training?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

回答（2 个）

JiaZheng Yan 2020-3-31

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/507154-load-data-into-experience-buffer-ddpg-agent#answer_423064

I find a way to show the Memory of the experience buffer.

You can open the file "ExperienceBuffer.m", which is in "...\Matlab\toolbox\rl\rl\+rl\+util".

In this file, you can the property value of the variable Memory. For example:

Then you set:

agentOpts.SaveExperienceBufferWithAgent = true;

agentOpts.ResetExperienceBufferBeforeTraining = false;

After your training, you can get the data in ''agent.ExperienceBuffer.Memory''

This also means that you can modify and use the training data.

I hope this method works for you : )

8 个评论
显示 6更早的评论隐藏 6更早的评论

zimeng Wang 2022-4-1

您好，我可以用这个方法查看buffer里的数据，但是如何修改或者删除buffer里的数据？

Arman Ali 2022-8-1

have you found the answer? if yes please guide?

请先登录，再进行评论。

Priyanshu Mishra 2020-2-26

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/507154-load-data-into-experience-buffer-ddpg-agent#answer_417398

Hi Daksh,

You may find following link useful for your answer.

2 个评论
显示无隐藏无

Daksh Shukla 2020-2-26

Hello Priyanshu,

Thanks for your response.

However, the link does not exactly resolve the problem I am having. The link talks about running a lot of initial simulations and saving the agent with the experience buffer. But, what I would like to do is use data from "real experiments" and NOT simulations. I would like to add this data to the experience buffer or the replay memory to kick start the DDPG learning.

Based on all my reading and trying to access experience buffer in Matlab, it seems like experience buffer object is a hidden property and I cannot upload data to it directly from an external source.

I would really appreciate if you could let me know a direct way to upload data to the experience buffer, if there is one.