How to handle big csv files

3 次查看（过去 30 天）
Ancalagon8
Ancalagon8 2018-9-1
重新打开： Ancalagon8 2018-11-21
I have huge .csv files comming daily and i want to know how i can handle them. For the moment, only to have an idea, i run a python script first in order to decrease the size by averaging the file. Is splitting the big file the only option i have?
P.S. one line of my file looks like:
00:00:0;0.0;0.00540500736377

请先登录，再回答此问题。

回答（1 个）

Walter Roberson
Walter Roberson 2018-9-1
See https://www.mathworks.com/help/matlab/datastore.html for the general solution.
Another approach is to fopen() the file, and textscan() using a repeat count (a number as the parameter after the format string) to control how many lines are read at a time; you would read a chunk, process it, go back to read another chunk, and so on.

类别

在 Help Center 和 File Exchange 中查找有关 Text Files 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by