How can I prevent MATLAB 2024a from creating large hidden sge(number) folders with unnecessary logs and outputs when running jobs via SSH?
36 次查看(过去 30 天)
显示 更早的评论
I work with SSH in MATLAB for two versions: 2020a and 2024a. When running the same code on both versions, I noticed that MATLAB 2024a creates hidden folders named sge(number). Inside these folders, there are additional subfolders for logs and outputs that I don't need. These folders can quickly grow to over 50GB, which is problematic. I believe this behavior is due to the version difference, but I'm unsure how to prevent it. Can you help me resolve this issue
回答(1 个)
Hitesh
about 6 hours 前
Hi roi,
The logs and output that are generated when running the jobs via SSH in large hidden sge(number) folders. There are some ways to handle them :
- Adjust Logging Level: It generates verbose logs. You need to adjust the logging level to reduce the amount of log data.
cluster = parcluster();
cluster.LoggingLevel = 'off'; % Options: 'off', 'minimal', 'normal', 'detailed'
- Cleanup Jobs: After the jobs are executed successfully, ensure that you are cleaning up the job's data.
delete(cluster.Jobs);
- Check Job Storage Location: MATLAB stores job data in the default job storage location. You can change this location to a directory with more space or a temporary directory that gets cleaned up regularly.
cluster = parcluster();
cluster.JobStorageLocation = '/path/to/your/desired/directory';
0 个评论
另请参阅
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!