Readmatrix in struct using parfor

6 次查看(过去 30 天)
Hi,
My for-loop that reads multiple .csv files (1 file per iteration) takes too much time. Therefore, I would like to increase the performance using parfor.
Using parfor and structs seems not to be straightforward. How can I adjust the following code to use a parfor?
Thanks.
% load the data from each file
% parfor i = 1:length(Files2Read)
for i = 1:length(Files2Read)
% create fieldname for each file to read
fld = ['File#', num2str(i) ];
% load data
Data.(fld) = readmatrix(Files2Read{i});
% store additional information:
Data.General.FieldName{i} = fld;
end
  1 个评论
Stephen23
Stephen23 2022-6-27
" How can I adjust the following code to use a parfor?"
Use actual indexing into a structure array rather than forcing a pseudo-index into the fieldname.

请先登录,再进行评论。

采纳的回答

Jan
Jan 2022-6-27
编辑:Jan 2022-6-27
Fields names cannot contain the charcater '#' .
fld = sprintf('File_%d', i);
Data.(fld) = readmatrix(Files2Read{i});
This should work.
AS Stephen told already, this would be nicer:
Data(i).Value = readmatrix(Files2Read{i});
or
Data.File(i) = readmatrix(Files2Read{i}); % Or File{i}
By the way, if the disk access is the bottleneck, parfor cannot help. Please post, if you code runs faster than with for.
  3 个评论
Jan
Jan 2022-6-28
Starting the parallel pool takes some time, but remember, that reading the files might store their contents in a RAM cache also. Then optimizing the code for repeated reading has much less effects in real applications.

请先登录,再进行评论。

更多回答(0 个)

类别

Help CenterFile Exchange 中查找有关 Matrices and Arrays 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by