Data access performance tips

5 次查看（过去 30 天）

显示更早的评论

Azura Hashim 2019-11-2

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/488824-data-access-performance-tips

Hi,

Need some tips please. I need fast performance when:

1) Reading datafiles saved to disk

2) Accessing and modifying data when loaded

On reading data files I did some tests. Surprisingly parquet file is the slowest, .mat second and .csv fastest. Tried uncompressed .mat file as well. Data is saved as a table.

Are there any other recommendations? Should I split the numeric and text data and save them separately?

On accessing data when loaded - have had lackluster experience using table even though convenient. I'm assuming I should separate numeric and text data then create separate arrays.

Any other tips?

Have ~1 million rows with about 20 columns and want the access and calc to be fast.

Thanks