possible reasons for increasing time of batch

2 次查看(过去 30 天)
Hi all!
I send jobs to a remote cluster machine and do a tic-toc around my batch command. Unfortunately the measured time increases a lot during a loop over 300 of similar jobs... Staring from 20s in the beginning I come to 200s already for job number 75...
Any ideas what could be the reason for that???
Thanks very much!
Rafael
  1 个评论
Rafael
Rafael 2013-9-12
编辑:Rafael 2013-9-12
By the way, I tried to restart my local matlab and go on with the loop:
I again find times around 20s, so something happens on my local machine which slows me down...
No, it does not have the same effect if I "clear all". Then increasing starts at same already increased amount of time...

请先登录,再进行评论。

回答(2 个)

Image Analyst
Image Analyst 2013-9-12
It might depend on what you're doing. Are you doing anything with axes? I once noticed that when I was in an intensive loop repeatedly displaying new images in the same axes, it would get slower and slower until it was crawling along. Then I put in a "cla reset" just before I showed an image and after that it was uniformly speedy. Could that help you?

Rafael
Rafael 2013-9-17
Hi all. Thanks for the suggestion with these axes, but thats not relevant here I think.
I "simply" submit a function with a few basic parameters (no big data, only paths where to load the data from on the cluster) and a new CurrentDirectory via batch. The function then loads, processes and stores data on the clusters harddrives, so I dont keep the connection to the jobs.
Only thing what really bothers me is the incrasing amount of time my loop needs per job-submission.
(Cluster uses torque as jobmanager)
As a start, I would like to have some trick to uncover the bottleneck...

类别

Help CenterFile Exchange 中查找有关 Startup and Shutdown 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by