Separating data from a CSV file

Question

Jake 2020-3-3

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/508652-separating-data-from-a-csv-file

评论： Star Strider 2020-3-3

采纳的回答： Star Strider

Hello,

I have a huge CSV file and it has data stored as follows.

Column A stores ID numbers and the Column B stores dates (yyyymmdd hhmmss). Other columns are random.

I want to seperate the data based on ID numbers (Column A) and store them in different *.csv or *.txt files. The problem is that the number of data sets per one ID number is also random.

Ex: ID 102030 has 3 data while 125125 has 4 data

My CSV file has over 10,000 data rows, which makes is quite difficult to do this manually.

Is there a way to use MATLAB to sort this out? I know this is a big task but it would be a great help if anyone can at least point me in the right direction.

Thank you in advance!

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Star Strider 2020-3-3

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/508652-separating-data-from-a-csv-file#answer_418182

It woiuld be necessary to convert column B to strings in order for datetime to parse it, however that is not difficult. Grouping them is strraightforward, using either findgroups or the third output of unique. The accumarray function might be the best way to segregate them.

Example —

a = rand(10, 5);                                            % Create Matrix
A = [[3 3 3 4 4 6 6 6 6 7]' a];                             % Create Matrix
G = findgroups(A(:,1));
M = accumarray(G, (1:size(A,1)).', [], @(x){A(x,:)});
Cell_1 = [M{1}]
Cell_3 = [M{3}]

This does not include the datetime calls, howefver that would be straightforward if the date and time numbers needed to be converted.

5 个评论
显示 3更早的评论隐藏 3更早的评论

Jake 2020-3-3

Perfect!

It works without a single error. You made the day.

Thanks a lot!

Star Strider 2020-3-3

As always, my pleasure!

That should not make any difference, even if the ‘ID’ values are not contiguous in the original file. The tables will have them in the order they appear in the original file, and the individual files will be the same as the cell arrays accumarray created, that are then created as tables.

Note that the tables also give you the ability to label the columns (variables) to be what you want. See the documentation on table (and associated documentation) for those options.

Also, I would put them all in the same folder/subdirectory so you can find them easily. Use fullfile to create the appropriate filenames (including the subdirectory path), and use addpath to add that path to your MATLAB search path. See What Is the MATLAB Search Path? for those details, if you are not familiar with them.

请先登录，再进行评论。