Import 450MB csv file

Question

0 个投票

Hi,

I am trying to import a huge csv file (515000 rows and 93 columns) onto matlab. So far I have tried the Import Data wizard, xlsread command. Both cases I've got 'not enough memory available' error.

I am running v 7.10.0(R2010a) on a 32-bit Windows XP system powered by 2.93 GHz processor and 2 GB of RAM.

Increasing Java heap memory in MATLAB preferences didn't help (not sure if that's what I am supposed to do though).

Is there a way load the file apart from splitting it up into parts ?

thanks, Chetan

5 个评论
显示 3更早的评论隐藏 3更早的评论

Image Analyst 2011-10-24

Are you sure it all needs to be in memory at the same time? What's wrong with reading in part of it and processing parts of it at a time?

Walter Roberson 2011-10-24

There is no way to specify MATLAB memory usage on Windows. The most you can do is add swap space and use the /3G boot switch.

Unless perhaps you are running a fully-occupied laptop, probably the most cost effective way by far to resolve the problem would be to increase your physical RAM.

请先登录，再进行评论。

请先登录，再回答此问题。

Follow Question