清空筛选条件
清空筛选条件

How to avoid memory leaks when function inside parfor generates warning?

9 次查看（过去 30 天）
Jonas
Jonas 2017-3-30
评论： xl z 2023-11-13
Hello!
I use matlab R2015b for Win Server 2012 OS with local parpool. I have memory leaks on local workers when function inside parfor-loop generate warning. Also memory is not released after parfor-loop ends. Example:
x = rand(78, 1);
for j = 1:100
parfor i = 1:1000
[~, z] = kpsstest(x);
end
end
[~, z] = kpsstest(x) generates warning:
Warning: Test statistic #1 below tabulated critical values:
maximum p-value = 0.100 reported.
> In kpsstest>getStat (line 632)
In kpsstest (line 291)
Memory leaks on workers even when i use constructions:
warning('off', 'econ:kpsstest:StatTooSmall');
pctRunOnAll warning('off', 'econ:kpsstest:StatTooSmall')
Memory on start workers:
Memory on after executing code:
How to avoid memory leaks when function inside parfor generates warning?
Thank you.

请先登录，再回答此问题。

采纳的回答

Edric Ellis
Edric Ellis 2017-3-31
This problem is the subject of this bug report. If you are able to upgrade to R2017a, that's the simplest workaround.
  4 个评论
显示 2更早的评论
Jonas
Jonas 2018-10-12
Hello Isabel.
As I remember, in my case the solution was to divide the calculations into batches and after calculating one data batch, the parpool stopped and then restarted again (see pseudocode below).
for i = 1:numel(batches)
parpool('local', 'SpmdEnabled', false);
curData = batches{i};
parfor j = 1:numel(curData)
% DO SEMETHING THAT LEADS TO MEMORY LEAKAGE
end
delete(gcp('nocreate'));
end
It was a bad idea in point of performance, but it was quite stable. I hope it helps.

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Performance and Memory 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by