[Swift-user] mixing gram execution and local filesystem providers

[Allan Espinosa]

Hi Ben,

Here are the logs:
GT2 execution gridftp filesystem: (successful)
http://www.ci.uchicago.edu/~aespinosa/swift/blast-20090201-1519-5xtsovjd.log
sites.xml:
<config>

  <pool handle="TERAPORT" sysinfo="INTEL32::LINUX">
    <profile namespace="globus" key="queue">fast</profile>
    <gridftp url="tp-grid1.uchicago.edu"
storage="/disks/tp-gpfs/scratch/aespinosa" major="2" minor="2"
patch="4" />
    <jobmanager universe="vanilla"
url="tp-grid1.uchicago.edu/jobmanager-pbs" major="2" minor="2"
patch="4" />
    <workdirectory >/disks/tp-gpfs/scratch/aespinosa</workdirectory>
  </pool>

</config>

GT2 execution and local filesystem: (successful)
logs:  http://www.ci.uchicago.edu/~aespinosa/swift/blast-20090201-1808-ua9hhvz6.log
sites.xml:
<config>

  <pool handle="TERAPORT" sysinfo="INTEL32::LINUX">
    <profile namespace="globus" key="queue">fast</profile>
    <gridftp url="local://localhost" />
    <jobmanager universe="vanilla"
url="tp-grid1.uchicago.edu/jobmanager-pbs" major="2" minor="2"
patch="4" />
    <workdirectory >/disks/tp-gpfs/scratch/aespinosa</workdirectory>
  </pool>

</config>


coaster local:pbs and local filesystem: (errorr: Failed to transfer
wrapper log from blast-20090201-1818-e6uz834b/info/z on TERAPORT) I
aborted the run after a while...
logs: http://www.ci.uchicago.edu/~aespinosa/swift/blast-20090201-1818-e6uz834b.log
sites.xml
<config>

  <pool handle="TERAPORT" sysinfo="INTEL32::LINUX">
    <profile namespace="globus" key="queue">fast</profile>
    <gridftp url="local://localhost" />
    <execution provider="coaster" url="none"  jobmanager="local:pbs" />
    <workdirectory >/disks/tp-gpfs/scratch/aespinosa</workdirectory>
  </pool>

</config>

On Sun, Feb 1, 2009 at 5:01 PM, Ben Clifford <benc at hawaga.org.uk> wrote:
>
> On Sun, 1 Feb 2009, Allan Espinosa wrote:
>
>> I mixed the two providers since my files are at the remote site
>> already.  The data files were being staged successfully but the
>> wrapper scripts for submittiing the jobs are not being transferred
>> successfully.  I also got the same kind of error using coasters
>> (gt2:gt2:pbs)
>
> In addition to previous note, if you are running Swift from a CI machine
> then you should have a bunch of the same filesystems (such as teraport's
> GPFS) mounted already. In that case, using the local filesystem provider
> should work.
>
> Please can you send a full log file for a run using local filesystem and
> plain gt2 execution?
>
> --
>
>
>



-- 
Allan M. Espinosa <http://allan.88-mph.net/blog>
PhD student, Computer Science
University of Chicago <http://people.cs.uchicago.edu/~aespinosa>