is it faster to load a big file (198MB) once and pass it onto a function in a parfor loop or let the function in parfor loop to load it every iteration?

Question

xiaojun 2013-2-7

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/62635-is-it-faster-to-load-a-big-file-198mb-once-and-pass-it-onto-a-function-in-a-parfor-loop-or-let-the

Dear All,

is it faster to load a big .mat file (198MB) once and pass it onto a function in a parfor loop or let the function in parfor loop to load it every iteration? My hunch is that to load it once (which take about 10min) and let it pass to the function. But I am not sure. Also, are there faster ways to load .mat file? Currently, I am simply using the "load" function.

Another question is that will the script run faster if I put all the codes in a single m file as compared to separating them into different functions (also m files). The readability will improve but I am not sure if the computation efficiency is significantly impacted. Thanks! best, Gene

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Jason Ross 2013-2-7

编辑：Jason Ross 2013-2-7

Are you running everything locally on one machine, or are your workers distributed among several machines? Do you plan on running this on a cluster anytime soon? Is there a shared file system if you are planning on doing so?

请先登录，再进行评论。

请先登录，再回答此问题。