Reading uint8 from raw data takes much more RAM then expected

6 次查看（过去 30 天）
Jonas
Jonas 2023-1-18
评论： Jonas 2023-1-19
I am trying to read some MB of data from big files of several GB. I am using the follwing code:
fid=fopen(filename,'r');
fseek(fid,someStartValue,'bof');
raw = fread(fid, [3 ceil(numOfPixels/2)*numOfFrames],'uint8','b');
number of uint8 are
3*ceil(numOfPixels/2)*numOfFrames=184688640
so this is also the value in bytes, corresponding to about 185MB. But when calling the fread line, the taken RAM increases by 1.6 GB.
Any ideas?
Running the fread line mutiple times in a row gives the peaks shown in the attached image. I also don't understand, why there is more RAM available after the peak compared to before the peak. The image shows three calls of the line
  4 个评论
显示 2更早的评论
Les Beckham
Les Beckham 2023-1-18
编辑：Les Beckham 2023-1-18
That should fix your issue. If you specify the precision argument as 'uint8' as your initial post shows, it will take the uint8 source data and put it into doubles. Using 'uint8=>uint8' will keep the data as uint8, reducing the memory usage by a factor of 8. As Image Analyst suggests in his answer, use the whos command to check the data type and memory size of your raw array after you read it in .

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

Image Analyst
Image Analyst 2023-1-18
Put the memory command before and after your code. What do you see? Are you sure you're closing the file?
memory
fid=fopen(filename,'r');
fseek(fid,someStartValue,'bof');
raw = fread(fid, [3 ceil(numOfPixels/2)*numOfFrames],'uint8','b');
fclose(fid);
whos raw
memory

类别

在 Help Center 和 File Exchange 中查找有关 Get Started with MATLAB 的更多信息

标签

产品


版本

R2022a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by