Reading uint8 from raw data takes much more RAM then expected

Question

Jonas 2023-1-18

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1896340-reading-uint8-from-raw-data-takes-much-more-ram-then-expected

评论： Jonas 2023-1-19

I am trying to read some MB of data from big files of several GB. I am using the follwing code:

fid=fopen(filename,'r');
fseek(fid,someStartValue,'bof');
raw = fread(fid, [3 ceil(numOfPixels/2)*numOfFrames],'uint8','b');

number of uint8 are

3*ceil(numOfPixels/2)*numOfFrames=184688640

so this is also the value in bytes, corresponding to about 185MB. But when calling the fread line, the taken RAM increases by 1.6 GB.

Any ideas?

Running the fread line mutiple times in a row gives the peaks shown in the attached image. I also don't understand, why there is more RAM available after the peak compared to before the peak. The image shows three calls of the line

4 个评论
显示 2更早的评论隐藏 2更早的评论

Les Beckham 2023-1-18

编辑：Les Beckham 2023-1-18

That should fix your issue. If you specify the precision argument as 'uint8' as your initial post shows, it will take the uint8 source data and put it into doubles. Using 'uint8=>uint8' will keep the data as uint8, reducing the memory usage by a factor of 8. As Image Analyst suggests in his answer, use the whos command to check the data type and memory size of your raw array after you read it in .

Jonas 2023-1-19

issue solved, thanks.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Image Analyst 2023-1-18

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1896340-reading-uint8-from-raw-data-takes-much-more-ram-then-expected#answer_1151275

在 MATLAB Online 中打开

Put the memory command before and after your code. What do you see? Are you sure you're closing the file?

memory
fid=fopen(filename,'r');
fseek(fid,someStartValue,'bof');
raw = fread(fid, [3 ceil(numOfPixels/2)*numOfFrames],'uint8','b');
fclose(fid);
whos raw
memory