[Swift-user] walltime in sites does not match the walltime of submitted job

Mihael Hategan hategan at mcs.anl.gov
Sat Jan 31 15:02:04 CST 2015


... although I do not see how 11 hours came into the picture. For a job
that size and with the default settings, the coaster job should have at
most twice the walltime of the actual job.

Ketan, can you send the swift log from this run?

Mihael

On Sat, 2015-01-31 at 11:50 -0600, Michael Wilde wrote:
> MaxWallTime is the estimate/ceiling you provide Swift for your app tasks 
> for this site.
> 
> I think that if you don't specify a MaxTime (which puts an upper bound 
> on the wall time of the scheduler jobs which Swift/coasters will submit) 
> then Swift uses what's in its ready-to-run task queue to determine the 
> scheduler job walltime.
> 
> If you want shorter jobs (e.g. to not wait so long in the queue) then 
> you should un-comment your maxtime tag in the sites entry and set it to 
> what you want to see.  Be aware that you need to consider what your 
> likely app task time will really be as you try to balance these two time 
> limits.
> 
> - Mike
> 
> On 1/31/15 11:44 AM, Ketan Maheshwari wrote:
> > Hi,
> >
> > On Blues, I submit a script with the following sites spec:
> >
> > <?xml version="1.0" encoding="UTF-8"?>
> > <config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
> > <pool handle="blues">
> >   <execution provider="coaster" jobmanager="local:pbs"/>
> >   <filesystem provider="local" url="none" />
> > <!--  <profile namespace="globus" key="maxtime">2040</profile>-->
> >   <profile namespace="globus" key="maxWalltime">03:40:00</profile>
> >   <profile namespace="globus" key="jobsPerNode">1</profile>
> >   <profile namespace="globus" key="slots">1</profile>
> >   <profile namespace="globus" key="ppn">2</profile>
> >   <profile namespace="globus" key="jobtype">single</profile>
> >   <profile namespace="globus" key="nodeGranularity">16</profile>
> >   <profile namespace="globus" key="maxnodes">16</profile>
> >   <profile namespace="karajan" key="jobThrottle">2.20</profile>
> >   <profile namespace="karajan" key="initialScore">10000</profile>
> > <!--  <profile namespace="globus" key="keepSiteDir">true</profile>-->
> > <workdirectory>/home/ketan/swift.workdir</workdirectory>
> > </pool>
> >
> > The maxWalltime being 3 hours 40 minutes. However, the job that gets 
> > submitted is with 11 hours of walltime:
> >
> > $ qstat
> >
> > bmgt1.lcrc.anl.gov <http://bmgt1.lcrc.anl.gov>:
> >   Req'd  Req'd   Elap
> > Job ID         Username Queue    Jobname    SessID NDS TSKS Memory 
> > Time  S Time
> > -------------- -------- -------- ---------- ------ --- ---- ------ 
> > ----- - -----
> > 851234.bmgt1.l ketan    batch    B0131-3911    --   16 32    --  11:00 
> > Q   --
> >
> > Any clues?
> >
> > Thanks,
> > Ketan
> >
> >
> > _______________________________________________
> > Swift-user mailing list
> > Swift-user at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
> 
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user





More information about the Swift-user mailing list