[Swift-devel] SWIFT_JOBDIR_PATH env not passed on remote sites

[Allan Espinosa]

It works with gt2.  Is this a pbs problem?

Other provider that I am testing that it does not work is on
provider-deef.  For my purposes, I would like to have it work under
provider-deef and provider-pbs

Thanks,
-Allan

2009/5/8 Mihael Hategan <hategan at mcs.anl.gov>:
> Does it also happen if you use GT2 instead of PBS?
>
> On Fri, 2009-05-08 at 15:46 -0500, Allan Espinosa wrote:
>> Hi,
>>
>> SWIFT_JOBDIR_PATH only works in local executions.  it looks like the
>> environment variable is not being passed for remote job submissions:
>>
>> sites.xml:
>> <config>
>>   <pool handle="TERAPORT" sysinfo="INTEL32::LINUX">
>>     <execution provider="pbs" url="none" />
>>     <profile namespace="globus" key="queue">fast</profile>
>>     <gridftp url="local://localhost" />
>>     <workdirectory >/home/aespinosa/workflows/jobdirpath/sitedir</workdirectory>
>>     <profile namespace="env"
>> key="SWIFT_JOBDIR_PATH">/home/aespinosa/workflows/localnode</profile>
>>   </pool>
>> </config>
>>
>> resulting wrapper log:
>> Progress  2009-05-08 15:33:31.258501000-0500  LOG_START
>>
>> _____________________________________________________________________________
>>
>>         Wrapper
>> _____________________________________________________________________________
>>
>> Job directory mode is: link on shared filesystem
>> DIR=jobs/v/cat-vbmpqiaj
>> EXEC=/bin/cat
>> STDIN=
>> STDOUT=061-cattwo.out
>> STDERR=stderr.txt
>> DIRS=
>> INF=061-cattwo.1.in|061-cattwo.2.in
>> OUTF=061-cattwo.out
>> KICKSTART=
>> ARGS=061-cattwo.1.in 061-cattwo.2.in
>> ARGC=2
>> Progress  2009-05-08 15:33:31.277785000-0500  CREATE_JOBDIR
>> Created job directory: jobs/v/cat-vbmpqiaj
>> Progress  2009-05-08 15:33:31.289956000-0500  CREATE_INPUTDIR
>> Progress  2009-05-08 15:33:31.294467000-0500  LINK_INPUTS
>> Linked input: /home/aespinosa/workflows/jobdirpath/sitedir/061-cattwo-20090508-1533-x71gz29g/shared/061-cattwo.1.in
>> to jobs/v/cat-vbmpqiaj/061-cattwo.1.in
>> Linked input: /home/aespinosa/workflows/jobdirpath/sitedir/061-cattwo-20090508-1533-x71gz29g/shared/061-cattwo.2.in
>> to jobs/v/cat-vbmpqiaj/061-cattwo.2.in
>> Progress  2009-05-08 15:33:31.327217000-0500  EXECUTE
>> Moving back to workflow directory
>> /home/aespinosa/workflows/jobdirpath/sitedir/061-cattwo-20090508-1533-x71gz29g
>> Progress  2009-05-08 15:33:31.338850000-0500  EXECUTE_DONE
>> Job ran successfully
>> Progress  2009-05-08 15:33:31.343910000-0500  COPYING_OUTPUTS
>> Progress  2009-05-08 15:33:31.373251000-0500  RM_JOBDIR
>> Progress  2009-05-08 15:33:31.383733000-0500  TOUCH_SUCCESS
>> Progress  2009-05-08 15:33:31.398652000-0500  END
>>
>> the directory "localnode" is also not created.  Test peformed using
>> 061-cattwo.  my testcase script is in ~aespinosa/workflows/jobdirpath
>>
>> [aespinosa at tp-login1 jobdirpath]$ ./runtest.sh
>> Swift svn swift-r2911 cog-r2394
>>
>> RunID: remoterun
>> Progress:  uninitialized:1
>> Progress:  Active:1
>> Final status:  Finished successfully:1
>> Remote test FAIL
>> Swift svn swift-r2911 cog-r2394
>>
>> RunID: localrun
>> Progress:
>> Final status:  Finished successfully:1
>> Local test PASS
>>
>> -Allan
>>
>>
>
>
>



-- 
Allan M. Espinosa <http://allan.88-mph.net/blog>
PhD student, Computer Science
University of Chicago <http://people.cs.uchicago.edu/~aespinosa>