[Swift-devel] block coasters not registering on proper queue

Tue Jun 9 15:31:06 CDT 2009

ok.  so i guess i should file this on bugzilla...

2009/6/8 Mihael Hategan <hategan at mcs.anl.gov>:
> On Mon, 2009-06-08 at 16:24 -0500, Allan Espinosa wrote:
>> Is there a default maxwalltime being submitted to the LRM if nothing
>> is specified?
>
> The block maxwalltime varies depending on the job maxwalltimes and the
> overallocation parameters. So in a sense, yes.
>
>>   I made in this configuration to use the "fast" ueue in
>> sites.xml but i keep getting placed inside the "exteneded" queue.
>
> My gut feeling tells me that the LRM would not change the queue if the
> walltime didn't fit, but would instead complain that the maxwalltime is
> larger than what the queue accepts. So it looks more like the queue
> parameter doesn't get passed to the LRM properly.
>
>>
>> sites.xml
>> <config>
>>   <pool handle="teraport" >
>>     <gridftp url="gsiftp://tp-osg.ci.uchicago.edu" />
>>     <execution provider="coaster" url="tp-osg.ci.uchicago.edu"
>> jobmanager="gt2:gt2:pbs" />
>>     <profile namespace="globus" key="queue">fast</profile>
>>     <workdirectory>/home/aespinosa/work</workdirectory>
>>     <profile namespace="karajan" key="initialScore">50</profile>
>>     <profile namespace="karajan" key="jobThrottle">10</profile>
>>     <profile namespace="globus" key="slots">20</profile>
>>   </pool>
>> </config>
>>
>> gram log snippet:
>> ...
>> ...
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: New Perl JobManager created.
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Using jm supplied job dir:
>> /home/aespinosa/.globus/job/tp-grid1.ci.uchicago.edu/18222.1244495960
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Entering pbs submit
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: NFS sync for /usr/bin/perl failed
>> (may be harmless): Operation not permitted
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Sent NFS sync for /usr/bin/perl
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: NFS sync for /dev/null failed (may
>> be harmless): Operation not permitted
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Sent NFS sync for /dev/null
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Determining job max time cpu from
>> job description
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT:    using queue default
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Determining job max wall time
>> limit from job description
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT:    using maxwalltime of 60
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Building job script
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Using jm supplied job dir:
>> /home/aespinosa/.globus/job/tp-grid1.ci.uchicago.edu/18222.1244495960
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Transforming argument
>> "/home/aespinosa/.globus/coasters/cscript6820117662705473060.pl"
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Transformed to
>> "/home/aespinosa/.globus/coasters/cscript6820117662705473060.pl"
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Transforming argument
>> "http://128.135.125.118:56015"
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Transformed to
>> "http://128.135.125.118:56015"
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Transforming argument "0608-190415-000000"
>> Mon Jun  8 16:19:21 2009 JM_SCRIPT: Transformed to "0608-190415-000000"
>> ...
>> ...
>>
>> $grep fast gram*.log:
>> gram_job_mgr_18021.log:6/8 16:19:15 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18021.log:6/8 16:19:25 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18021.log:6/8 16:19:36 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:19:22 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:19:32 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:19:43 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:19:53 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:20:03 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:20:14 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:20:24 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:20:34 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:20:45 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:20:55 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:21:05 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:21:16 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:21:26 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:21:36 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:21:47 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:21:57 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:22:08 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:22:18 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:22:28 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:22:39 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:22:49 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:23:00 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:23:10 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>> gram_job_mgr_18222.log:6/8 16:23:20 JMI: poll_fast: returning -1 =
>> GLOBUS_FAILURE (try Perl scripts)
>>
>>
>> Swift version: Swift svn swift-r2949 cog-r2406
>>
>> -Allan

-- 
Allan M. Espinosa <http://allan.88-mph.net/blog>
PhD student, Computer Science
University of Chicago <http://people.cs.uchicago.edu/~aespinosa>