Extracting huge data from csv file
2 次查看(过去 30 天)
显示 更早的评论
I am working on huge csv file of around 100-200 Mb's. I am trying to extract the data using COM server and activex application. But for the very first time when i fetch the data it is extracted without any problem but when I try to re extract I get an error stating that ' Not enough memory to complete this operation '. My C drive has around 5 Gb of free space. Do I have to clear the data from COM server first and then proceed. If it is then how do I do that
0 个评论
回答(2 个)
Barry Greene
2012-1-23
This is usually a problem with RAM rather than hardrive space. Suggest reading your file in chunks using fread within a for/while loop and concatenating the results.
Hope this helps
0 个评论
owr
2012-1-23
Agree on the RAM comment from Barry. If fread is too tedious, you can also try textscan. Specifying a format for each line of the csv file (which columns are numeric vs. string, ignoring columns that you may not need using something like %*f) has drastically increased the efficiency of textscan for me in the past.
0 个评论
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Use COM Objects in MATLAB 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!