[Swift-devel] [Bug 208] New: SWIFT_JOBDIR_PATH env not passed on remote sites (pbs and deef)

[bugzilla-daemon at mcs.anl.gov]

https://bugzilla.mcs.anl.gov/swift/show_bug.cgi?id=208

           Summary: SWIFT_JOBDIR_PATH env not passed on remote sites (pbs
                    and deef)
           Product: Swift
           Version: unspecified
          Platform: PC
        OS/Version: Linux
            Status: NEW
          Severity: normal
          Priority: P2
         Component: General
        AssignedTo: hategan at mcs.anl.gov
        ReportedBy: aespinosa at cs.uchicago.edu
                CC: benc at hawaga.org.uk, wilde at mcs.anl.gov


Created an attachment (id=286)
 --> (http://bugzilla.mcs.anl.gov/swift/attachment.cgi?id=286)
test case: pbs (fail), gt2(pass), local(pass)

i,

SWIFT_JOBDIR_PATH only works in local executions.  it looks like the
environment variable is not being passed for remote job submissions:

sites.xml:
<config>
 <pool handle="TERAPORT" sysinfo="INTEL32::LINUX">
   <execution provider="pbs" url="none" />
   <profile namespace="globus" key="queue">fast</profile>
   <gridftp url="local://localhost" />
   <workdirectory >/home/aespinosa/workflows/jobdirpath/sitedir</workdirectory>
   <profile namespace="env"
key="SWIFT_JOBDIR_PATH">/home/aespinosa/workflows/localnode</profile>
 </pool>
</config>

resulting wrapper log:
Progress  2009-05-08 15:33:31.258501000-0500  LOG_START

_____________________________________________________________________________

       Wrapper
_____________________________________________________________________________

Job directory mode is: link on shared filesystem
DIR=jobs/v/cat-vbmpqiaj
EXEC=/bin/cat
STDIN=
STDOUT=061-cattwo.out
STDERR=stderr.txt
DIRS=
INF=061-cattwo.1.in|061-cattwo.2.in
OUTF=061-cattwo.out
KICKSTART=
ARGS=061-cattwo.1.in 061-cattwo.2.in
ARGC=2
Progress  2009-05-08 15:33:31.277785000-0500  CREATE_JOBDIR
Created job directory: jobs/v/cat-vbmpqiaj
Progress  2009-05-08 15:33:31.289956000-0500  CREATE_INPUTDIR
Progress  2009-05-08 15:33:31.294467000-0500  LINK_INPUTS
Linked input:
/home/aespinosa/workflows/jobdirpath/sitedir/061-cattwo-20090508-1533-x71gz29g/shared/061-cattwo.1.in
to jobs/v/cat-vbmpqiaj/061-cattwo.1.in
Linked input:
/home/aespinosa/workflows/jobdirpath/sitedir/061-cattwo-20090508-1533-x71gz29g/shared/061-cattwo.2.in
to jobs/v/cat-vbmpqiaj/061-cattwo.2.in
Progress  2009-05-08 15:33:31.327217000-0500  EXECUTE
Moving back to workflow directory
/home/aespinosa/workflows/jobdirpath/sitedir/061-cattwo-20090508-1533-x71gz29g
Progress  2009-05-08 15:33:31.338850000-0500  EXECUTE_DONE
Job ran successfully
Progress  2009-05-08 15:33:31.343910000-0500  COPYING_OUTPUTS
Progress  2009-05-08 15:33:31.373251000-0500  RM_JOBDIR
Progress  2009-05-08 15:33:31.383733000-0500  TOUCH_SUCCESS
Progress  2009-05-08 15:33:31.398652000-0500  END

the directory "localnode" is also not created.  Test peformed using
061-cattwo.  my testcase script is in ~aespinosa/workflows/jobdirpath

[aespinosa at tp-login1 jobdirpath]$ ./runtest.sh
Swift svn swift-r2911 cog-r2394

RunID: remoterun
Progress:  uninitialized:1
Progress:  Active:1
Final status:  Finished successfully:1
Remote test FAIL
Swift svn swift-r2911 cog-r2394

RunID: localrun
Progress:
Final status:  Finished successfully:1
Local test PASS


Tests indicated SWIFT_JOBDIR_PATH only works with gt2 and local providers.

Test case is attached in this bugzilla report

-- 
Configure bugmail: https://bugzilla.mcs.anl.gov/swift/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are watching the assignee of the bug.
You are watching someone on the CC list of the bug.