Hi Federico Toso,
I see you want to save simulation data to workspace to later use it in your "ResetFcn". A suitable tool for this is the "rlDataLogger" object, which enables you to log simulation data at various points, such as after each step, episode and after each learn subroutine. You can craft a custom function for logging the specific statistics you're interested in and then assign this function to the appropriate callback property of the rlDataLogger. Although logging typically saves data to a folder after training concludes, your custom callback function can be used to immediately write the necessary statistics to the MATLAB workspace.
You can create a "rlDataLogger" object as below:
logger = rlDataLogger();
For instance, to log the ActorLoss value after every episode, your episode finish callback function could be structured like this:
function dataToLog = episodeFinish(data)
assignin('base', 'actorLoss', data.ActorLoss);
dataToLog = data.ActorLoss;
end
And then assign the function handle to the corresponding callback property of the data logger object as below:
logger.EpisodeFinishedFcn = @episodeFinish;
To learn more about the "rlDataLogger" function refer to the below documentation:
Hope this Helps!
