How can I prevent MATLAB 2024a from creating large hidden sge(number) folders with unnecessary logs and outputs when running jobs via SSH?

I work with SSH in MATLAB for two versions: 2020a and 2024a. When running the same code on both versions, I noticed that MATLAB 2024a creates hidden folders named sge(number). Inside these folders, there are additional subfolders for logs and outputs that I don't need. These folders can quickly grow to over 50GB, which is problematic. I believe this behavior is due to the version difference, but I'm unsure how to prevent it. Can you help me resolve this issue

[Rik]

Where exactly are those folders created?

[roi]

They created in folders named ServiceHost that in hidden foldes named .mathWorks

Answer 1

[Hitesh]

Hi roi,

The logs and output that are generated in large hidden sge(number) folders when running the jobs via SSH. There are some ways to handle them :

• Adjust Logging Level: It generates verbose logs. You need to adjust the logging level to reduce the amount of log data.

cluster = parcluster();
cluster.LoggingLevel = 'off'; % Options: 'off', 'minimal', 'normal', 'detailed'

• Cleanup Jobs: After the jobs are executed successfully, ensure that you are cleaning up the job's data.

delete(cluster.Jobs);

• Check Job Storage Location: MATLAB stores job data in the default job storage location. You can change this location to a directory with more space or a temporary directory that gets cleaned up regularly.

cluster = parcluster();
cluster.JobStorageLocation = '/path/to/your/desired/directory';