Extracting huge data from csv file

3 次查看（过去 30 天）
Aditya
Aditya 2012-1-23
I am working on huge csv file of around 100-200 Mb's. I am trying to extract the data using COM server and activex application. But for the very first time when i fetch the data it is extracted without any problem but when I try to re extract I get an error stating that ' Not enough memory to complete this operation '. My C drive has around 5 Gb of free space. Do I have to clear the data from COM server first and then proceed. If it is then how do I do that

请先登录，再回答此问题。

回答（2 个）

Barry Greene
Barry Greene 2012-1-23
This is usually a problem with RAM rather than hardrive space. Suggest reading your file in chunks using fread within a for/while loop and concatenating the results.
Hope this helps
owr
owr 2012-1-23
Agree on the RAM comment from Barry. If fread is too tedious, you can also try textscan. Specifying a format for each line of the csv file (which columns are numeric vs. string, ignoring columns that you may not need using something like %*f) has drastically increased the efficiency of textscan for me in the past.

类别

在 Help Center 和 File Exchange 中查找有关 Use COM Objects in MATLAB 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by