How can I prevent MATLAB 2024a from creating large hidden sge(number) folders with unnecessary logs and outputs when running jobs via SSH?
2 次查看(过去 30 天)
显示 更早的评论
I work with SSH in MATLAB for two versions: 2020a and 2024a. When running the same code on both versions, I noticed that MATLAB 2024a creates hidden folders named sge(number). Inside these folders, there are additional subfolders for logs and outputs that I don't need. These folders can quickly grow to over 50GB, which is problematic. I believe this behavior is due to the version difference, but I'm unsure how to prevent it. Can you help me resolve this issue
回答(2 个)
Hitesh
2024-11-21
编辑:Hitesh
2024-11-22
Hi roi,
The logs and output that are generated in large hidden sge(number) folders when running the jobs via SSH. There are some ways to handle them :
- Adjust Logging Level: It generates verbose logs. You need to adjust the logging level to reduce the amount of log data.
cluster = parcluster();
cluster.LoggingLevel = 'off'; % Options: 'off', 'minimal', 'normal', 'detailed'
- Cleanup Jobs: After the jobs are executed successfully, ensure that you are cleaning up the job's data.
delete(cluster.Jobs);
- Check Job Storage Location: MATLAB stores job data in the default job storage location. You can change this location to a directory with more space or a temporary directory that gets cleaned up regularly.
cluster = parcluster();
cluster.JobStorageLocation = '/path/to/your/desired/directory';
0 个评论
Sam Marshalik
2024-12-2
What you are seeing is the result of the MathWorksServiceHost (MSH). I would recommend that you reach out to our Installation and Licensing team. They will be able to provide next steps on how to go about this issue.
0 个评论
另请参阅
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!