parallel computing speed question when the body of the parfor loop takes about 2 seconds

Question

Guanfeng Gao 2015-5-13

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/216470-parallel-computing-speed-question-when-the-body-of-the-parfor-loop-takes-about-2-seconds

评论： Walter Roberson 2015-5-13

I have a question about parallel:

parfor ii=1:N dosomething%% end

in the parfor loop, the time of dosomething is 2 seconds in each loop, and N is about 100. In that condition, is it efficient to use parfor here???

I feel confused about that as I test the time and find the more core I use, the more time I spend!!!!!! Could someone help to answer this question?!!!!

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Ken Atwell 2015-5-13

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/216470-parallel-computing-speed-question-when-the-body-of-the-parfor-loop-takes-about-2-seconds#answer_178897

It really depends on what "dosomething" is doing. If it is pure computation, it should be a big win. If there is file or network I/O going on, your mileage will vary depending on the application and hardware.

Also keep an eye on memory usage on your computer -- if you're using all of your physical RAM, your computer may be spending much of its time swapping, more than offsetting and gain you'd get from multiprocessor operation.

2 个评论
显示无隐藏无

Guanfeng Gao 2015-5-13

Thanks for your help. I could not quite understand what the network I/O refers to. Actually, in the "do somthing", there only exist some simply computation and another loop to call a c function by mex file. Is it what you are saying?

Walter Roberson 2015-5-13

Pure computation on a local system is fine. If you were using the Distributed Computing Engine to send to several hosts then there would be network traffic. If you were load()'ing files then there would be file I/O.

请先登录，再进行评论。

Answer 2

Guanfeng Gao 2015-5-13

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/216470-parallel-computing-speed-question-when-the-body-of-the-parfor-loop-takes-about-2-seconds#answer_178981

Thanks!!! I do not have several hosts or file I/O in my parallel loop!!! However, I am still not satisfied with the speed. E.G. there are 100 iterations (parfor ii=1:100), and for each iteration it takes 2 seconds; when I use 32 cores it takes 129 seconds, which means that the parallel only speedup to "2*100/129~2" than the regular one when I use 32 cores!!!! That really confused me!!!!!!

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Walter Roberson 2015-5-13

Are the matrices large? If so then you might be encountering a lot of overhead in transmitting the values back. Try experimenting with drange() instead of parfor()

请先登录，再进行评论。