edit large CSV file before reading it to a table

Question

0 个投票

hi,

I have a very large (16Gb) CSV file that contains one column with data separated by semicolumn.

I only need 2 columns from this data, but I cannot read it first since the memory is running out (I have 16Gb ram).

Is it possible to somehow separate the semicolumn to a column and read only the data I need (which is 2/6 columns)?

2 个评论
显示无隐藏无

Stephen23 2021-5-6

编辑：Stephen23 2021-5-6

How do you expect to get "...2 columns from this data..." from a "...CSV file that contains one column with data..." ?

sani 2021-5-6

It contain one column but the data is saperated in ';'.

basicly I needed to saperate it first and than to read only whats relevant for me.

see wallter solution, it was actually really halpful.

请先登录，再进行评论。

请先登录，再回答此问题。

请先登录再关注

Answer 1

Walter Roberson 2021-5-6

2 个投票

https://www.mathworks.com/help/matlab/ref/matlab.io.text.delimitedtextimportoptions.html

Use 'delimiter', ';', and 'SelectedVariableNames' with a vector that is the two column numbers.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

sani 2021-5-6

thank you very much walter!

for some reason not only that it maneged to read the data, it also write it really fast in readtable() function. much faster than other smaller files I'm reading.

请先登录，再进行评论。

edit large CSV file before reading it to a table

2 个评论
显示无隐藏无

采纳的回答

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

更多回答（0 个）

类别

标签

Community Treasure Hunt

edit large CSV file before reading it to a table

2 个评论 显示 无 隐藏 无

采纳的回答

1 个评论 显示 -1更早的评论 隐藏 -1更早的评论

更多回答（0 个）

类别

标签

另请参阅

Community Treasure Hunt

2 个评论
显示无隐藏无

1 个评论
显示 -1更早的评论隐藏 -1更早的评论