Fail to start parpool with workers more than 32

Question

yanci zhang 2023-12-26

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2064082-fail-to-start-parpool-with-workers-more-than-32

编辑： Matthew 2024-5-7

I have been attempting to enable a parallel pool with multiple workers on my local machine. The parallel pool launches normally with 12 workers, but I encounter an error when I try to increase the number to 32. Here are some reference details: Local hardware configuration: CPU(s) = 336, available memory = 694GB MATLAB version: matlab2023b The error message for the 32 workers Parallel pool test is as follows:

Error Report: Failed to initialize the interactive session.

Caused by: Error using parallel.internal.pool.AbstractInteractiveClient>iThrowIfBadParallelJobStatus The interactive communicating job failed with no message.

Interactive client bound to URL: tcp://tcpnodelay=localhost:27370/protocol/catapult and port 27370 Session failed to start when creating InteractiveClient. Error: Error using parallel.internal.pool.AbstractInteractiveClient>iThrowWithCause Failed to initialize the interactive session.

Has anyone encountered a similar issue? I believe that local hardware resources should not be a limiting factor for utilizing more workers, but why am I unable to use more than 12 workers?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Sachin 2023-12-29

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2064082-fail-to-start-parpool-with-workers-more-than-32#answer_1379726

在 MATLAB Online 中打开

Hi Yanci,

To address the issue you are experiencing, I kindly suggest performing the following troubleshooting steps in the MATLAB Command Window:

>> restoredefaultpath
>> savepath

After completing these steps, I recommend restarting MATLAB. Once MATLAB has been restarted, attempt to initiate a parallel pool once more.

Should you encounter an error related to the inability to access the file located at C:\Program Files\MATLAB\R2023b\toolbox\local\pathdef.m, it may be necessary to remove the pathdef.m file.

Doing so will allow MATLAB to recreate it upon the next execution of the relevant command.

You may also refer the following MATLAB Answer : https://in.mathworks.com/matlabcentral/answers/1948303-error-using-parpool-parallel-pool-failed-to-start-with-the-following-error-for-more-detailed-info?s_tid=answers_rc1-2_p2_MLT

I trust that the provided solution will assist in resolving your query.

Thanks

4 个评论
显示 2更早的评论隐藏 2更早的评论

yanci zhang 2024-1-2

I tried to follow the solution you provided, but I couldn't resolve the issue. I attempted to validate this process. From the report, it appears that the failure occurred in the SPMD job test. The report details are as follows: Description: Job errored or did not reach the state 'finished'.

Details: Error Report: Job errored or did not reach the state 'finished'. Command Line Output: Debug Log: LOG FILE OUTPUT:

[27]======BEGIN LICENSE MANAGER ERROR====== [27]Unexpected error during communication with services required to run MATLAB (error 5013). [27]Troubleshoot this issue by visiting: [27]https://www.mathworks.com/support/lme/5013[27]======END LICENSE MANAGER ERROR======

[7]MPID_Init(371).......: PMI_Init returned -1

0~6: 127.0.0.1: -2 ... (remaining exit codes and error messages omitted)

7: 127.0.0.1: 1: process 7 exited without calling finalize ... (remaining exit codes and error messages omitted)

8~26: 127.0.0.1: -2 ... (remaining exit codes and error messages omitted)

27: 127.0.0.1: 1

28~31: 127.0.0.1: -2 ... (remaining exit codes and error messages omitted)