bizarre SPMD error

Question

0 个投票

I was using Matlab R2011b and had strange SPMD error.

The structure of the code looks like this:

load A.mat               % A is super large, e.g. 7GB
spmd
        B = ...; C = ...  % create some "small" local variable
        do something with A,B,C ...
end

Our machine has over 40GB memory.

Here are the problems:

1) The program runs perfectly well in parallel, if A is smaller, e.g 0.5G;

2) The serial version of the program runs perfectly well, if A is as huge as 7GB.

3) spmd reports error if A is huge:

---------------------------------------

Error using distcompserialize
Error during serialization
Error in spmdlang.RemoteSpmdExecutor/initiateComputation (line 82)
                fcns  = distcompMakeByteBufferHandle( ...
Error in spmdlang.spmd_feval_impl (line 14)
    blockExecutor.initiateComputation();
Error in spmd_feval (line 8)
        spmdlang.spmd_feval_impl( varargin{:} );
Error in myprogram >(spmd) (line xx)
        spmd