In expressions of the form T.X = B where T is a tall table, B must be a tall array.

1 次查看（过去 30 天）

显示更早的评论

Michael 2019-9-6

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/479252-in-expressions-of-the-form-t-x-b-where-t-is-a-tall-table-b-must-be-a-tall-array

评论： Michael 2019-9-8

在 MATLAB Online 中打开

Hello,

I am trying to convert a tall array with a column of strings to numbers. I tried this:

ds = datastore(fullfile(p,'tallFinal.csv'));            % CREATE A DATASTORE
ds.SelectedFormats={'%q','%C','%C','%s'};               % DEFINE COLUMN FORMATS
ds.VariableNames = {'DATE','TICKER','FIELD','VALUE'};   % DEFINE COLUMN NAMES
tds = tall(ds);                                         % CREATE A TALL ARRAY
tmp = str2double(tds.VALUE);                            % CONVERT TO STRING
[tds.fVALUE]=gather(tmp);

And recieved an error after over two hours of processing.

Evaluating tall expression using the Parallel Pool 'local':
- Pass 1 of 2: Completed in 10 min 50 sec
- Pass 2 of 2: Completed in 2 hr 11 min
Evaluation completed in 2 hr 22 min
In expressions of the form T.X = B where T is a tall table, B must be a tall array.

Thank You,

Michael

7 个评论
显示 5更早的评论隐藏 5更早的评论

Michael 2019-9-6

在 MATLAB Online 中打开

Dear Mr. Roberson,

When I try that I get an error.

Thank You,

Michael

>> ds = datastore(fullfile(p,'tallFinal.csv'));            % CREATE A DATASTORE
>> ds.SelectedFormats={'%q','%C','%C','%f'};               % DEFINE COLUMN FORMATS
>> ds.VariableNames = {'DATE','TICKER','FIELD','VALUE'};   % DEFINE COLUMN NAMES
>> tds = tall(ds);                                         % CREATE A TALL ARRAY
Starting parallel pool (parpool) using the 'local' profile ...
Connected to the parallel pool (number of workers: 8).
>> x=max(tds.VALUE);
>> X=gather(x);
Evaluating tall expression using the Parallel Pool 'local':
- Pass 1 of 2: 0% complete
Evaluation 0% complete
Error using matlab.io.datastore.TabularTextDatastore/readData (line 77)
Mismatch between file and format character vector.
Trouble reading 'Numeric' field from file (row number 6923, field number 4) ==> IG8     \n
Learn more about errors encountered during GATHER.
Error in matlab.io.datastore.TabularDatastore/read (line 120)
            [t, info] = readData(ds);
Error in tall/gather (line 50)
[varargout{:}, readFailureSummary] = iGather(varargin{:});
Caused by:
    Reading the variable name 'VALUE' using format '%f' from file: 'tallFinal.csv' starting at offset -15.

Walter Roberson 2019-9-6

The error message above says there is a 'IG8 \n' in input.

Michael 2019-9-8

在 MATLAB Online 中打开

tallEcon_Anon.zip

Hello,

1) I attached some data.

2) tall(str2double(... didn't work.

3) I don't understand what you mean by "'IG8 \n"

ds = datastore(fullfile(p,'tallFinal.csv'));            % CREATE A DATASTORE
ds.SelectedFormats={'%q','%C','%C','%s'};               % DEFINE COLUMN FORMATS
    ds.VariableNames = {'DATE','TICKER','FIELD','VALUE'};   % DEFINE COLUMN NAMES
    tds = tall(ds);                                         % CREATE A TALL ARRAY
tmp = tall( str2double(tds.VALUE));                     % CONVERT TO NUMBER
[tds.fVALUE]=gather(tmp);
Evaluating tall expression using the Parallel Pool 'local':
- Pass 1 of 2: Completed in 11 min 49 sec
- Pass 2 of 2: Completed in 2 hr 5 min
Evaluation completed in 2 hr 17 min
In expressions of the form T.X = B where T is a tall table, B must be a tall array.