Behavior of persistent variables with parfeval

2 次查看（过去 30 天）
James Ryan
James Ryan 2016-9-5
评论： GTRI_user 2018-7-14
I have a project in which the results of each of about 2000 test cases need to be plotted and saved as a PDF (the need to save so many plots is beyond my control). The math to compute the test cases is several times faster than the plotting and PDF generation, so I have been using parfeval to make the PDFs in parallel workers. That works great, with a nearly linear speedup until I catch up with the test case calculations.
I then learned that the plotting code itself could be more efficient by re-using the figure, legends, and other items which are constant between cases (news to me - I just started with MATLAB last month). Running serially, this also makes a big difference, saving over 40% in the PDF generation.
Here's the problem. I used persistent variables to be able to re-use things between calls. When I go back to parallel computation, I still get the correct outputs and there are no error messages, but there is a big memory leak. Workers which used to stabilize at about 500 MB are now getting to almost 900 MB after just 25 calls per worker. The code progressively slows down.
What is the expected behavior of persistent variables with parfeval? I had assumed that each worker would have its own independent copy, but maybe that's not what's happening.
MATLAB 2016a, Windows 7, 6 cores, 16 GB.
Thanks for any help!
% New code example (a chopped down version of the function)
persistent figHandle;
persistent plotSST1 plotSST2;
persistent plotSD1 plotSD2;
if isempty(figHandle) || ~isvalid(figHandle)
close all;
figHandle = figure(1);
set(gcf,'Visible', 'off');
first = true;
else
first = false;
set(0, 'CurrentFigure', figHandle)
% Replace the Y data in each curve
set(plotSST1, 'YData', temp);
set(plotSST2, 'YData', [hist hist]);
set(plotSD1, 'YData', S(:,1)./C(:,1));
set(plotSD2, 'YData', S(:,2)./C(:,2));
% and so on for all the plots...
end
if first % Sorry about the odd logic with "first"
Lots of code deleted which uses subplot to create 6 plots with 2 to
3 curves each. It is run only when first is true.
end
print('-dpdf', someFileName);
  2 个评论
James Ryan
James Ryan 2016-9-6
Just for fun, here's the speedup I'm seeing. If the new code would accelerate as well as the old, I'd be very happy.
Now normalized to the speed using one worker:
GTRI_user
GTRI_user 2018-7-14
Has this been clarified anywhere in the documentation yet? I still haven't seen Mathworks state what the correct behavior is supposed to be for persistent variables in functions called via parfeval. I think you are saying that they DO behave as normal, i.e., they keep their values from one parfeval call to another right?

请先登录，再进行评论。

请先登录，再回答此问题。

回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Asynchronous Parallel Programming 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by