Problem working with parfor

Question

Ahmadreza 2024-4-17

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2108301-problem-working-with-parfor

评论： Ahmadreza 2024-4-18

Dear all,

I am working with the parallel tool in order to optimize the run time of my simulations. I am using a resevoir simulator (MATLAB Reservoir Simulation Toolbox). I am adding a function after each time convergence, to do a parallel calculations on each cell. However, it seems there is a problem with the parallel tool. It stuck in a cetrain function as found in the attached image.

The code stucks here does not proceed anymore. Do you have any idea why it is happening?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Edric Ellis 2024-4-18

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2108301-problem-working-with-parfor#answer_1443671

That stack frame in the profiler is simply where your MATLAB client is waiting for the workers to complete their work. You can get profiling information from the workers using mpiprofile.

3 个评论
显示 1更早的评论隐藏 1更早的评论

Ahmadreza 2024-4-18

编辑：Ahmadreza 2024-4-18

在 MATLAB Online 中打开

I found that the code is stucked in below function:

        function [tags, results] = getCompleteIntervals(obj, numIntervals)
            
            tags = nan(numIntervals, 1);
            results = cell(numIntervals, 2);
            for i = 1:numIntervals
                err = [];
                r = parallel.internal.pool.ParforIntervalResult();
                while r.isEmpty()
                    assert(obj.NumIntervalsInController > 0, ...
                        'Internal error in PARFOR - no intervals to retrieve.');
                    r = obj.ParforController.waitForNextCompletedInterval(obj.AwaitIntervalPollPeriod);
                    
                    % In each poll tick of the polling wait, yield to any
                    % events allowed to interrupt the parallel language.
                    parallel.internal.pool.yield();
                    if r.isEmpty()
                        % Only test to see if the session is failing if we didn't get a
                        % results from the queue
                        if ~obj.isSessionValidAndRunning()
                            errorMessageInput = iGetParpoolLinkForError();
                            error(message('parallel:lang:parfor:SessionShutDown', errorMessageInput));
                        end
                    else
                        obj.NumIntervalsInController = obj.NumIntervalsInController - 1;
                        if r.hasError()
                            % Maybe try again
                            [r, err] = obj.handleIntervalErrorResult(r);
                        end
                    end
                end
                % Check to see if the interval result has an error
                if r.hasError()
                    throw(err);
                else
                    tags(i) = r.getTag();
                    data = parallel.internal.pool.optionallyDeserialize(r.getResult());
                    assert(numel(data) == 2, ...
                        'Unexpectedly received the incorrect number of outputs.');
                    results(i,:) = data;
                    obj.IncompleteIntervalsCell{tags(i)} = [];
                end
            end
            % Yield one final time to ensure all events directly generated by
            % code in the PARFOR loop are executed before we give control back
            % to the user.
            parallel.internal.pool.yield();
        end

It is stucked in the while loop, and it does not go further as r is empty (r.isEmpty()).

Edric Ellis 2024-4-18

That means the workers are still working on your loop. The simplest way to check that things are still proceeding on the workers is to add a disp statement to the body of your parfor loop to see where things are getting to.

Ahmadreza 2024-4-18

Thanks for your help. As a matter of fact you are right. There was a problem inside the third party software that I fixed it. I MUST NEVER LOSE MY FAITH IN MATLAB!

请先登录，再进行评论。