read multiple netcdf files

Question

YH 2018-12-12

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/435344-read-multiple-netcdf-files

编辑： Jan 2018-12-12

在 MATLAB Online 中打开

Hallo,

I have 54 net cdf files, which I need to read in matlab. they contain 4 variables

I tried the code below but it always reads until the 7th file then gives me '' Out of memory error''

I tried to fix the problem by setting the java head memory to the max, but that did not help.

Can someone help with that?

% my code
vars_to_load =  {'lat', 'lon', 'series', 'time'};
projectdir = 'location of the data';
info = dir( fullfile(projectdir, '*.nc') );
n_files = length(info);
filenames = fullfile( projectdir, {info.name} );
lat = cell(n_files,1);
lon = cell(n_files,1);
series = cell(n_files, 1);
time= cell(n_files,1);
for k = 1 : n_files
  f = filenames{K};
  lat{k} = ncread(f, vars_to_load{1});
  lon{k} = ncread(f, vars_to_load{2});
  series{k} = ncread(f, vars_to_load{3});
  time{k} = ncread(f, vars_to_load{4});
end

2 个评论
显示无隐藏无

KSSV 2018-12-12

YOu are keep on piling/ adding the data...so obisously going out of memory....why you want to load entire data into workspace?

YH 2018-12-12

编辑：Jan 2018-12-12

I need the entire dataset so to get timeseries of 54 years. each file represents timeseries (hourly time series) for one year. the whole dataset is required for further editing.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Jan 2018-12-12

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/435344-read-multiple-netcdf-files#answer_351933

If ncread is not a Java method, increasing the heap memory of Java decreases the memory available for Matlab, so I assume this is couterproductive. Try to reduce the Java heap size instead, close other application, install more RAM, increase the virtual memory, clear unused huge variables, install even more RAM and use a 64 bit version of Matlab (2015b was the last version, which existed in a 32 bit version also, so all newer versions are 64 bit).