Slow access of large composite element

2 次查看（过去 30 天）

rp 2017-4-10

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/334692-slow-access-of-large-composite-element

评论： Walter Roberson 2018-2-9

I am using spmd to run some parallel algorithms which periodically communicate. At the end, each process has a structure which I would like to pull back to the client for further analysis. Unfortunately, the size of the structure is large (but I don't think they are excessive), and trying to pull just one of the composite elements leads to a timeout of the cluster (30 min) and therefore fails. Is there any way to have the client as one of the spmd processes, or a more efficient way to transfer data from one or more of the workers back to the client in a more efficient way?

EDIT:

A clunky workaround is to have each process save their workspace to a directory. This seems to work pretty quickly, but it's obnoxious to have to import all the workspaces to do the diagnostics. I would appreciate more elegant solutions.

5 个评论
显示 3更早的评论隐藏 3更早的评论

rp 2018-2-9

@Walter -- yes you must be right. I quickly read through and saw that the example wouldn't work in an spmd block, but there are probably other examples which may.