bug parfor: analyzing and transferring files to worker: not done: blocked

Question

student student 2024-1-17

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2071046-bug-parfor-analyzing-and-transferring-files-to-worker-not-done-blocked

编辑： Walter Roberson 2024-7-7，20:33

Hello there,

I am a running a working script with parfor on matlab, after a while (~1200 iteration on parfor), matlab block without appareant reasons while producing the following message: "analyzing and transferring files to workers...". I am running the parfor on matlab 2023a, on local parfor only. I did validate the cluster of parfor before. The code is working correctly as the 1200 files were done. I tried with other very similar files and it did block also similarly. There is largely enough memory space on my PC. I tried to restart matlab, and also my PC, but this did not solve the problem. I also tried to find solution online, unsuccesfully. Anyone would have an idea ? many thanks for your attention.

2 个评论
显示无隐藏无

Ganesh 2024-1-17

Hi @student student,

In order for us to reproduce this issue, it would be a helpful if you share your code files.

I would also request you to share the stack trace of the error you are encountering.

student student 2024-1-17

编辑：Walter Roberson 2024-7-7，20:33

在 MATLAB Online 中打开

Thanks Ganesh,

The code is working, so there is no error message.

The code is very classic, and as following:

---------------------------------------------------------------------------------------------------

a=1:1:10000;
parfor amF=1:length(a)
    functAA(a,amF)
end

---------------------------------------------------------------------------------------------------

So, I guess it is more low level, matlab bug on parfor

thanks

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Edric Ellis 2024-1-17

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2071046-bug-parfor-analyzing-and-transferring-files-to-worker-not-done-blocked#answer_1391736

在 MATLAB Online 中打开

The "analyzing and transferring files to workers" message occurs only when the workers encounter a failure to find some code that they need. If you're using the "local" cluster type, then you should basically never see this. You can diagnose what got transferred by using listAutoAttachedFiles after your parfor loop, like this:

parfor i = 1:n
    doStuff()
end
% Assuming "analyzing and transferring..." message has occurred
listAutoAttachedFiles(gcp())

3 个评论
显示 1更早的评论隐藏 1更早的评论

Steven Lord 2024-1-17

Without seeing the body of your functAA function, I suspect it's probably going to be difficult or impossible to offer any specific suggestions.

student student 2024-1-22

thank you for your responses. what I suspect here is that the parfor display: "analyzing and transferring files to workers..." as it cannot find some unproduced data into the loop: so it should stop and report the problem. but instead it display this message. thanks

请先登录，再进行评论。

Answer 2

Felix 2024-7-7，8:07

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2071046-bug-parfor-analyzing-and-transferring-files-to-worker-not-done-blocked#answer_1482161

Ok. This is a bit late but hope it still helps. Also this may help people like me who encountered the same problem.

The behavior of stucking on 'analyzing and transferring files to worker ...' is most likely caused by error thrown by whatever functions called within the parfor loop somewhere in the middle of the parfor iterations.

When this happens, for reasons, instead of actually reporting the error, MATLAB will stuck on the message 'analyzing and transferring files to worker ...'.

The fix of this problem is obviously to resolve the error within the parfor loop. To see the error message, the workaround for MATLAB 2024a/2023b (I didn`t check other releases) is using thread based parpool, i.e., pool = parpool('Threads') before the parpool.

I hope this helps.