is actor-critic agent learning?

Question

karim bio gassi 2021-8-21

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1437914-is-actor-critic-agent-learning

回答： Ahmed R. Sayed 2022-10-4

I built a actor critic agent for microgrid energy management. it has to decide the discharging/charging energy among a set of action

in total 9 action can be taken for 7008 time steps. I am training the agent over 2000 episodes. But I notice when the agent start learning at a cetain episodes,

at the next episodes it fall completely down. I tattached the training for the first 250 episodes.

I wonder if there something wrong in my code.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Ahmed R. Sayed 2022-10-4

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1437914-is-actor-critic-agent-learning#answer_1066290

Hi, karim bio gassi,

From your figure, the discounted reward value is very large. try to rescale it to a certain value [-10, 10] in the environment. For example, r(t) = 10 * Microgrid operational cost (t) / MaxCost , where MaxCost is the maximum possible cost per time step.

Another point is you can use another agent.

I hope these suggestions can solve your concerns.