How to show the loss change of critic network or actor network when training with DDPG algorithm

Question

蔷蔷汪 2022-2-22

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1655880-how-to-show-the-loss-change-of-critic-network-or-actor-network-when-training-with-ddpg-algorithm

回答： Poorna 2023-9-29

How to show the loss change of critic network or actor network when training with DDPG algorithm?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Poorna 2023-9-29

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1655880-how-to-show-the-loss-change-of-critic-network-or-actor-network-when-training-with-ddpg-algorithm#answer_1322004

在 MATLAB Online 中打开

Hi,

I understand that you would like to view/show the change in the loss values of actor/critic networks of a DDPG agent during training.

You can achieve this by utilizing the “MonitorLogger” functionality. Follow these steps:

Create a “monitor” object using “trainingProgressMonitor” function:

%create a monitor object 
monitor = trainingProgressMonitor(); 

2. Create a “logger” object using the “rlDataLogger” function with the “monitor” as input:

%create a logger 
logger = rlDataLogger(monitor); 

3. Use the “AgentLearnFinishedFcn” callback property of the “monitor” object to log the losses. Create a custom callback function that receives a structure containing the actor and critic losses, as well as other useful information. Customize the callback function to extract and return the data you want to log.

4. At the end of the training, you can access the logged data for further analysis or visualization.

For more information on these functions, please refer to the following documentation:

MonitorLogger: https://www.mathworks.com/help/reinforcement-learning/ref/rl.logging.monitorlogger.html

trainingProgressMonitor: https://www.mathworks.com/help/deeplearning/ref/deep.trainingprogressmonitor.html

rlDataLogger: https://www.mathworks.com/help/reinforcement-learning/ref/rldatalogger.html

Hope this Helps.