Parallel Processing An Array/Array Appending

Question

Matthew Mellor 2016-7-29

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/297722-parallel-processing-an-array-array-appending

编辑： James Tursa 2016-7-29

I'm attempting to store data in internal memory (an array) until I'm ready to export the data to an excel document. However, my current implementation slows down my program after a while as I'm consistently 'growing' the array by adding another array to the end of it.

This is my current implementation:

memoryArray = [memoryArray, arrayToAdd] (x6)

I'm wondering if it would be easy to implement parallel programming to do something like this:

%Psuedo Code
 serial code...
 serial code tell parallel process workers to start the following:
     memoryArray1 = [memoryArray1, arrayToAdd1] %memoryArray is a global variable
     memoryArray2 = [memoryArray2, arrayToAdd2]
     memoryArray3 = [memoryArray3, arrayToAdd3]
     memoryArray4 = [memoryArray4, arrayToAdd4]
     memoryArray5 = [memoryArray5, arrayToAdd5]
     memoryArray6 = [memoryArray6, arrayToAdd6]
 serial code continues without waiting for results..

Is this possible to do? Perhaps my array manipulations are highly inefficient? I'm wondering if it might be as simple as using an spmd block... I apologize for the poorly written question. Thanks :)

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

James Tursa 2016-7-29

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/297722-parallel-processing-an-array-array-appending#answer_230238

编辑：James Tursa 2016-7-29

在 MATLAB Online 中打开

Can you save up all of the arrayToAdd stuff in a cell array and then cat all the results at once at the end to minimize the data copying? E.g., something like this:

     arrayToAdd{1} = stuff;
     arrayToAdd{2} = stuff;
     arrayToAdd{3} = stuff;
     arrayToAdd{4} = stuff;
     arrayToAdd{5} = stuff;
     arrayToAdd{6} = stuff;
         :
     memoryArray = [memoryArray, arrayToAdd{:}];