Error using gunzip function

15 次查看（过去 30 天）

ASJ 2018-5-13

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/400545-error-using-gunzip-function

评论： ASJ 2018-5-14

Hi,

I have been using gunzip to process large quantities of data as shown below. I have about 100,000 files per year and 14 years to do.

This does exactly what I need - decompresses the .gz file and returns it to the original folder using exactly the same name but in .dat format.

files=gunzip('*.gz');

I have successfully (and very slowly) decompressed the first 7 years worth. However, I now keep getting the following error:

Error using gunzip>gunzipwrite (line 234)
Unexpected end of input stream when attempting to GUNZIP the file "metoffice-c-band-rain-radar_uk_201103071320_1km-composite.dat".
    Error in gunzip>gunzipEntries (line 154)
        names{k} = gunzipwrite(entries(k).file, outputDir, baseName, streamCopier);
    Error in gunzip (line 90)
       names = gunzipEntries(entries, outputDir);
    Error in open2011 (line 1)
    files=gunzip('*.gz');

Is there anything I can do to fix this error? When I restart the code, it decompresses the files that have already been decompressed and stops at the same error eventually.

Also, any suggestions in terms of speeding up the decompression process would be great. Also, it might be worth noting that I am using a mac.

Thanks in advance.

6 个评论
显示 4更早的评论隐藏 4更早的评论

Walter Roberson 2018-5-13

I recommend using an external unzip instead of using gunzip(). gunzip() uses java methods and so is limited to java efficiency and has runs the risk of exceeding allocated java memory.

ASJ 2018-5-14

Thanks for your suggestions. The main issue that I have encountered with this is that due to the large number of files, the programs that I had a go running so far eventually crash.

The mac Utilities actually works pretty well and all you have to do is set it as the preferred program to open .gz files. And just by the process of trying to open a .gz file, it creates a .dat file next to the original one. However, you can only select about 500 files at a time (otherwise it crashes) so it is unfeasible to do this.

Is there a way I can work around this issue by perhaps using matlab to decompress using the utility software?

请先登录，再进行评论。

请先登录，再回答此问题。