How to read\open a csv file with millions of rows and hundreds of coloumns to compare/delete and save

1 次查看(过去 30 天)
Hi
i have csv files with millions of rows and hundreds of coloumns that i want to open\read in order to compare the files, remove duplicates and save the new file as csv also, and many other modifications..
when i used csvreader the PC stuck! so any help here
  9 个评论
Shayma
Shayma 2016-9-21
编辑:Shayma 2016-9-21
o.k it have been a long time now, but i got the R2014b,i tried to use datastore and it works, at least it opens the first chunk thank you :)

请先登录,再进行评论。

回答(1 个)

George
George 2016-8-12
You can do this with textscan, but your formatSpec is going to be pretty gnarly.
fid = fopen('data.csv');
% your formatSpec will be very long because of the number of fields
formatSpec = '%s %s %f %d'; % reads a string, a string, a float, an integer
A = textscan(fid, formatSpec, 'HeaderLines', 1, 'Delimiter', ',');
fclose(fid);
csvread

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by