Loading big CSV, and laptops with 8GB doesn't work

Question

Tina Zhao 2016-3-16

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/273860-loading-big-csv-and-laptops-with-8gb-doesn-t-work

回答： Dave Behera 2016-3-21

My script loads big CSV files and processes it. But some end users said csv files bigger than 350MB won't work. Is there a way to manage the RAM issue? Can Matlab split it and load it into smaller files or is there any other ways? Thanks.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Dave Behera 2016-3-21

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/273860-loading-big-csv-and-laptops-with-8gb-doesn-t-work#answer_214438

Hi Tina,

To read huge .csv files in MATLAB, the datastore feature may be helpful. Please see the following link: Datastore

Using a datastore, you can load a .csv file and specify how many rows to read at a time. The datastore would read only that many rows into memory, and not the entire file. This way, you won't need to split your file into multiple files.