Efficient way to read in large dataset

Question

Mads 2011-11-1

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/19992-efficient-way-to-read-in-large-dataset

Hi all.

I am to read in a set of data to Matlab which has 6 columns and more than 2 million rows. I tried reading the data as a tab delimited .txt file with the dataset function as such:

   pricedata = ...
  dataset('File',file,'Delimiter','tab','ReadObsNames',true)          ;

This has gone on for more than 3 hours. Can someone suggest a better way to do it?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Peter Perkins 2011-11-1

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/19992-efficient-way-to-read-in-large-dataset#answer_26421

在 MATLAB Online 中打开

Mads, you will most likely find that this:

>> help dataset/dataset
dataset Create a dataset array.
[snip]
DS = dataset('File',FILENAME,'Format',FORMAT, ...) creates
a dataset array using the TEXTSCAN function to read column-
oriented data in a text file.  Specifying a format can
improve speed significantly for large files.