Allocating elements in a large matrix takes a VERY long time. Why?

Question

Matlab2010 2013-2-14

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/63505-allocating-elements-in-a-large-matrix-takes-a-very-long-time-why

MATLAB is doing something I have never seen before. Can anyone explain to me the following behaviour:

I have some code:

function myFuncMain()
myMat = NaN(1E5, 5E2);
for t = 1: T
%carry out some tests
%allocate elements to the matrix, eg
myMat(i, j) = 10;
myMat(z,y) = now;
%etc
%Now go into an external function
myMat = myFunc(myMat, variables); 
end
end
function myMat = myFunc(myMat, variables)
%carry out some more tests
%allocate some more elements to the matrix, eg
myMat(ii, jj) = 10;
myMat(zz,yy) = now;
%etc
end

When I look at this code in the profiler, I see that >99.99% of the time is spent on the first allocation to the matrix in myFunc.m

Everytime, this function is called it takes a HUGE amount of time, according to the profiler, for the first element to be assigned to the matrix. Then according to the profiler, all the other assignations are instantaneous as expected.

whats going on? Is this something to do with the size of the matrix? Is it be copied somewhere behind the scenes?

I use a 64bit, 16GB machine.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Matt J 2013-2-14

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/63505-allocating-elements-in-a-large-matrix-takes-a-very-long-time-why#answer_75059

编辑：Matt J 2013-2-14

Because you are changing myMat inside myFunc, MATLAB assumes that a new copy of the entire myMat matrix is required. This happens the instant myFunc makes the first change, resulting in the large memory allocation time that you see.

If MATLAB knew that you were planning to overwrite your original myMat in the calling workspace with the one generated inside myFunc, it would not need to create a new copy, but its parsing mechanism isn't smart enough to know that.

4 个评论
显示 2更早的评论隐藏 2更早的评论

Matt J 2013-2-14

编辑：Matt J 2013-2-14

在 MATLAB Online 中打开

Eliminating function calls from for-loops tends to make them faster, so if this is speed critical, I tend to think that would be the most optimal course. However, you could also use my Reference class below, which I created as a workaround to this kind of thing.

classdef  Reference < handle
%Reference - a handle class with basic struct-like assignment capabilities.
%
%  obj=Reference(inputStruct)
%
%will turn an ordinary structure inputStruct into a handle object 
%having much the same behavior as the original struct, i.e., fields can be 
%dynamically added to it via
%
%   obj.field1=...;
%   obj.field2=...;
%   etc...
%
%However, because it is a handle object, the field data it carries gets passed
%around by reference.
%
%This is useful, for example, if we want a variable X to be processed by 
%reference in a function call, i.e.,
%
%  obj=Reference;
%  obj.X=X;
%  clear X
%  func(obj,...)
%
%would allow func() to process obj.X arbitrarily, without making a 2nd deep
%copy of X, and so that obj.X  in the base workspace would feel the 
%changes made by func.
    properties 
       data;
    end
    methods
        function obj=Reference(dataInput)
            if nargin==0, return; end
            obj.data=dataInput;
        end
        function out=subsref(obj,S)
            if isequal(S(1).type,'.')
                out=builtin('subsref',obj.data,S);
            else
                disp 'Indexing method unimplemented'
                keyboard
            end
        end
        function obj=subsasgn(obj,S,rhs)
            if isequal(S(1).type,'.')
                obj.data=builtin('subsasgn',obj.data,S,rhs);
            else
                disp 'Indexing method unimplemented'
                keyboard
            end
        end    
        function obj=display(obj)
             lbl=inputname(1);
             if isempty(lbl), lbl='ans'; end
             lbl=[lbl ' ='];
             T=evalc('obj.data');
             T=strrep(T,'ans =', lbl);
              jj=find(T~=sprintf('\n'),1,'last');
              T=T(1:jj);
              disp(T), disp ' '
        end  
    end
end

Matt J 2013-2-14

编辑：Matt J 2013-2-14

在 MATLAB Online 中打开

Just to elaborate a little on my previous Comment, using the Reference class, your code would get modified as follows

    function myFuncMain()
    obj=Reference;
    myMat = NaN(1E5, 5E2);
    for t = 1: T
    myMat(i, j) = 10;
    myMat(z,y) = now;
    %etc
    %Now go into an external function
    obj.X=myMat; clear myMat
    myMat = myFunc(obj, variables); 
    end
    end
    function myMat = myFunc(obj, variables)
    %carry out some more tests
    %allocate some more elements to the matrix, eg
    myMat=obj.X; obj.X=[];
    myMat(ii, jj) = 10;
    myMat(zz,yy) = now;
    %etc
    end

Matlab2010 2013-2-14

thank you

请先登录，再进行评论。

Answer 2

James Tursa 2013-2-14

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/63505-allocating-elements-in-a-large-matrix-takes-a-very-long-time-why#answer_75075

You might also consider using this fast matrix allocation function UNINIT from the FEX:

http://www.mathworks.com/matlabcentral/fileexchange/31362-uninit-create-an-uninitialized-variable-like-zeros-but-faster

The UNINT function allocates arrays of uninitialized values and can be useful in cases where you know the values will be overwritten downstream before their use.