Unable to use parfor with strcmpi

3 次查看（过去 30 天）
Anurag Passi
Anurag Passi 2017-11-28
评论： Walter Roberson 2017-11-28
Hello, I am trying to use PARFOR in a loop which runs a strcmpi() function. The code is:
parfor i = 1:size(data_1,1)
idx = find(strcmpi(data_1{i,1},data_2(:,1)));
dd = data_2(idx,:);
for j = 1:size(dd,1)
fprintf(file,'%s\t%s\n',dd{j,1},dd{j,2}); % print to file
end
end
I am not able to slice the "data_2" which is a 31mn x 2 cell array due to which I am not able to run parfor. Can anyone suggest how I can modify this program for parfor? Moreover, will this effect the way I am printing the data in the file?
Thank you.
  1 个评论
Walter Roberson
Walter Roberson 2017-11-28
find(strcmpi(data_1{i,1},data_2(:,1)))
... you are expecting multiple matches?
Is either data_1(:,1) or data_2(:,1) a set of unique strings?

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Edric Ellis
Edric Ellis 2017-11-28
编辑：Edric Ellis 2017-11-28
The variable data_2 is not being sliced because every iteration of the parfor loop needs access to the whole array. This is not an error though - the code analyzer warning is simply telling you that the code is incurring extra communication because the whole of data_2 is being sent to each worker.
  4 个评论
显示 2更早的评论
Anurag Passi
Anurag Passi 2017-11-28
So I think maybe I should try some other way of working with this data. Thank you for your replies.
Walter Roberson
Walter Roberson 2017-11-28
If either data_1(:,1) or data_2(:,1) are sets of unique strings then ismember() can be used before-hand to find the indexing.

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Large Files and Big Data 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by