Compiled MATLAB with TORQUE

Question

Danny 2013-1-3

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/57895-compiled-matlab-with-torque

I need to process a lot of data in parallel, and then plot the result of that processing. I have access to a cluster (~100 cores), and currently run the parallel data processing using compiled matlab code (mcc -mv), and then using qsub. What would be optimal, however, is to be able to call qsub from within a matlab script, have it submit the jobs to the cluster, wait until they are all completed, and then continue plotting, processing, in serial, in matlab. Is such a thing possible? If so, any help would be great.

Thanks!

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Jason Ross 2013-1-3

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/57895-compiled-matlab-with-torque#answer_70075

If you have Parallel Computing Toolbox and MATLAB Distributed Computing Engine installed/configured on the cluster, you can set up a direct integration using the Parallel menu (this assumes a number of things -- you have qsub on the path, and a common file system). If you don't have those things, there are examples in matlabroot/toolbox/distcomp/examples that detail how to set up the integration between MATLAB and your cluster for a variety of scenarios.

Once the integration is set up, you can submit the jobs to the cluster using various commands and techniques (batch, job/task, spmd, parfor) from within MATLAB that are detailed in the Parallel Computing Toolbox documentation.