Running two functions in parallel of which one would like to use parfor

2 次查看(过去 30 天)
Challenge: I repetitively read external data needing 250ms per data set. Then I process the data which takes 300ms on 20 phyical cores.
Now, it would of course be good to read data, and while the processing is in action, already read the next set. But, since I already use "parfor" in data processing, I cannot put both functions (reading and processing) in an smpd environment.
Ok, I think I know the long answer to this question: Put everything in smpd, send one of the workers in the data reading function and 20 of them to data processing and "rebuild" parfor functionality (means distribute loop indices and accumulate results on a master worker).
Maybe there is a shortcut I don't know? This problem should not be so unusual that there is no chance for an easy solution
Thanks,
Michael

采纳的回答

Mohammad Abouali
Mohammad Abouali 2015-12-23
Use non-blocking parfeval().

更多回答(0 个)

类别

Help CenterFile Exchange 中查找有关 Parallel for-Loops (parfor) 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by