Data access performance tips

5 次查看（过去 30 天）
Azura Hashim
Azura Hashim 2019-11-2
Hi,
Need some tips please. I need fast performance when:
1) Reading datafiles saved to disk
2) Accessing and modifying data when loaded
On reading data files I did some tests. Surprisingly parquet file is the slowest, .mat second and .csv fastest. Tried uncompressed .mat file as well. Data is saved as a table.
Are there any other recommendations? Should I split the numeric and text data and save them separately?
On accessing data when loaded - have had lackluster experience using table even though convenient. I'm assuming I should separate numeric and text data then create separate arrays.
Any other tips?
Have ~1 million rows with about 20 columns and want the access and calc to be fast.
Thanks

请先登录，再回答此问题。

回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Data Import and Analysis 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by