I have problem with runnig an exmple from Matlab for tall arrays.
My question: I want to save a big cell array (12GB,20*35*5). I wanted to make a datastore (first tall array) to work efficiently in future but I am getting an error.
Do you have a suggestion to save this big array properly? I would appreciate if there is a script.
location = 'C:\ExampleData';
Error I get:>>>>
Writing tall data to folder C:\ExampleData
Evaluating tall expression using the Parallel Pool 'local':
Evaluation 8% complete
Error using parallel.internal.bigdata.MatArrayShuffleSortStrategy/createReduceInputSource (line 83)
Internal problem while evaluating tall expression. The problem was:
Error: File: C:\Program Files\MATLAB-R2020a\toolbox\matlab\datastoreio\+matlab\+io\+datastore\@TallDatastore\TallDatastore.m Line: 501 Column: 24
The import statement 'import matlab.io.internal.cellArrayDisp' cannot be found or cannot be imported. Imported names must end with '.*' or be fully qualified.
Error in parallel.internal.bigdata.ParallelPoolExecutor>@(partition)shuffleSortStrategy.createReduceInputSource(partition.PartitionIndex) (line 233)
readerFactory = @(partition) shuffleSortStrategy.createReduceInputSource(partition.PartitionIndex);
Error in matlab.bigdata.internal.executor.convertToIndependentTasks>@(partition)LocalReadProcessor(readerFactory(partition),numOutputs) (line 337)
readerExecution = CompositeDataProcessorBuilder([], @(partition) LocalReadProcessor(readerFactory(partition), numOutputs));
Error in ...
Error in tall/write (line 248)
iDoWrite(location, ta, writeFunction);
Caused by:
Error using matlab.io.datastore.TallDatastore
Error: File: C:\Program Files\MATLAB-R2020a\toolbox\matlab\datastoreio\+matlab\+io\+datastore\@TallDatastore\TallDatastore.m Line: 501 Column: 24
The import statement 'import matlab.io.internal.cellArrayDisp' cannot be found or cannot be imported. Imported names must end with '.*' or be fully
qualified.
