NetCDF Read Slow Down - Sometimes

3 次查看（过去 30 天）
Brandon Sackmann
Brandon Sackmann 2012-2-17
I am reading data from very large NetCDF files (>25GB/file). The data are stored in separate 2D variables within the NetCDF file and depending on the syntax I use for netcdf.getVar I get dramatically different performance.
If I retrieve 'X' data values from the NetCDF file (different parts of the code require different subsets of the data):
(1) Always Fast: netcdf.getVar(ncid,varid,[0 0],[X 1]) (2) Initially Slow: netcdf.getVar(ncid,varid,[0 0],[1 X]) ...however subsequent reads from the same variable seem much faster.
Any thoughts as to what might be going on...is there any way to optimize things such that (1) and (2) are equally fast???

请先登录，再回答此问题。

采纳的回答

John
John 2012-2-21
If your variable's 2nd dimension crosses a lot of chunk boundaries, that might explain why the initial read might be slow.

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 NetCDF 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by