Parsim function consumes lot of memory. How to clear temporary MATLAB files?

Question

Antonio Carlo Bertolino 2018-3-2

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/385898-parsim-function-consumes-lot-of-memory-how-to-clear-temporary-matlab-files

回答： Reid Spence 2024-4-12

Hello everyone,

I'm running lots of simulations with parsim function. I realized that MATLAB started to store lots of temporary files in the "AppData\Local\Temp" folder. The used memory was increasing rapidly, and I received an alert from windows that the system memory was running out!

Then I divided the simulation in several parsim sessions, but the memory runned out again. Does it exists a way to clear those temporary files in that folder which have been created by MATLAB? Maybe I could do it between the various parsim sessions.

Thank a lot, Antonio

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Max Helbing 2019-2-20

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/385898-parsim-function-consumes-lot-of-memory-how-to-clear-temporary-matlab-files#answer_361931

编辑：Max Helbing 2019-2-20

在 MATLAB Online 中打开

I'm running into the same problem. When I use

parsim(simIn)

MATLAB stores loads of data in "AppData\Local\Temp".

I already tried

Simulink.sdi.cleanupWorkerResources

after all simulations are done. But this is a just kind of a "cleanUpFcn" and does not prevent MATLAB to increasingly consume memory while performing parallel simulations.

I don't know where to integrate:

parfevalOnAll(gcp, @sdi.Repository.clearRepositoryFile, 0)

Is there a way to implement a "cleanUpFcn" that deletes all the unused temporary files in the simIn.postSimFcn? This would clean temporary working folders after each simulation.

3 个评论
显示 1更早的评论隐藏 1更早的评论

Max Helbing 2019-9-26

Unfortunately, I haven't found a solution. To make it work, I cleared memory, which is probably the simplest but definitely not the most elegant solution.

Antonio Carlo Bertolino 2019-10-9

在 MATLAB Online 中打开

I inserted at the end of the script the command line

parfevalOnAll(gcp, @sdi.Repository.clearRepositoryFile, 0)

suggested by @Tony Mohan Varghese.

In addition, since my script creates several files that I don't want to save, before launching parsim, at the beginning of the script, I've added the following lines:

% Add to path the current folder (will be removed at the end of the script)
cwd = pwd;
oldpath = path;
path(oldpath,pwd)
tmpdir = tempname;
mkdir(tmpdir);
cd(tmpdir);

which add the current working directory to the path and change the working directory to a temporary one.

Then, all the code is executed.

In the end, the following lines try to remove ALL the temporary folders created by MATLAB in the current and in the past sessions, if any.

cd .. % Back up by 1 level in the folder tree
% Remove the temporary folder
list=dir;
result=regexp({list.name},'tp','match'); % Temporary folders start with tp
ind_folder=find(~cellfun(@isempty,result));
for kk = 1:length(ind_folder)
    folder = list(ind_folder(kk)).name;
    if 7 == exist(list(ind_folder(kk)).name,'dir')
        try
            rmdir(folder)
            disp(['Removed folder: ',list(ind_folder(kk)).name])
        catch
            disp('Ehi, folder',list(ind_folder(kk)).name],' not removed!')
        end
    end
end
clear folder list result ind_folder
cd(cwd) % Come back to the original working directory
path(oldpath) % Restore the original path list, removing the original working directory