[Swift-user] Swift/PBS Scheduler Slow to Report "Finished"?

Andrew Boyce ajboyce at jacks.sdstate.edu
Thu Mar 19 02:42:25 CDT 2009


Hello,

I am currently running Swift in conjunction with the PBS scheduler. My  
annoyance at the moment is this:

When running any script, even a simple script such as first.swift  
(which normally finishes almost instantaneously), Swift always takes  
precisely five minutes to tell me that my job Finished successfully  
and copy the files back to the appropriate folder. It is always almost  
exactly five minutes; I've checked many logs - it polls the scheduler  
for five minutes. When I run a script (like first.swift) without using  
the PBS scheduler, everything happens as normal; execution and  
"Finished successfully" are nearly immediate.

I think I know what the problem is: even after the scheduler says that  
the job is 'completed,' (which is generally right away) the scheduler  
keeps the job up on qstat and such for 5 minutes after (this setting  
is a PBS server attribute known as 'keep_completed', and I have  
checked that it is indeed set to 300 seconds; unfortunately I don't  
have permissions to change it). So when Swift polls the scheduler, the  
job is still up on qstat, and Swift must think that the task has not  
yet "Finished successfully."

My question is this:
Am I indeed right that Swift does not "understand" that when the PBS  
scheduler says a job is 'completed', the job really has "Finished  
successfully"?
Can this be changed so that Swift does "understand" that a 'completed'  
job has "Finished successfully"?

I have not included any files because I think I have narrowed the  
problem down to a question that does not require those that I would  
usually provide, but if I am wrong, then I can provide.

Thank you and sorry for the length.

Regards,

Andrew Boyce



More information about the Swift-user mailing list