Trying to read text file inside parfor loop versus passing it as a parameter

Question

Giang Le 2020-3-24

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/512540-trying-to-read-text-file-inside-parfor-loop-versus-passing-it-as-a-parameter

回答： Rashed Mohammed 2020-5-19

I have a couple txt/csv files that contain upward to 5000 lines. Each line contains information that I intend to read in as input to a function inside parfor loop. Is it best if I read the text files as a matrix/struct/etc. and the parfor loop can access the information from said matrix/struct? Or is it better have the part that read files inside the parfor loop?

3 个评论
显示 1更早的评论隐藏 1更早的评论

Giang Le 2020-3-24

Same file! The file basically contains multiple lines. Each line is a set of different parameters/function input.

Mohammad Sami 2020-3-24

编辑：Mohammad Sami 2020-3-24

I suggest just load it once before parfor loop. As long as each loop is not modifying the contents, it should be fine.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Rashed Mohammed 2020-5-19

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/512540-trying-to-read-text-file-inside-parfor-loop-versus-passing-it-as-a-parameter#answer_433331

Hi Giang Le,

Assuming that you are trying to call a function with its parameters read from a file parallelly. However, using IO functions inside parfor loop can be slow. Hence as suggested by Sami, read the data before hand using readmatrix and then pass the content as parameters to function parallelly using parfor.

Hope this helps!