[Swift-user] mixing gram execution and local filesystem providers

[Allan Espinosa]

Hi,

I mixed the two providers since my files are at the remote site
already.  The data files were being staged successfully but the
wrapper scripts for submittiing the jobs are not being transferred
successfully.  I also got the same kind of error using coasters
(gt2:gt2:pbs)

I used swift 0.8 .

Below are the logs

sites.xml
<config>

  <pool handle="TERAPORT" sysinfo="INTEL32::LINUX">
    <profile namespace="globus" key="queue">fast</profile>
    <profile namespace="globus"
key="coasterWorkerMaxwalltime">01:00:00</profile>
    <gridftp url="local://localhost" />
    <jobmanager universe="vanilla"
url="tp-grid1.uchicago.edu/jobmanager-pbs" major="2" minor="2"
patch="4" />
    <workdirectory >/disks/tp-gpfs/scratch/aespinosa</workdirectory>
  </pool>

</config>


runtime message:
rm -rf *.rlog *.d *.log blast.xml blast.kml test.out test.err
~/swift/vdsk/bin/swift -sites.file sites.xml -tc.file tc.data blast.swift
Swift 0.8 swift-r2448 cog-r2261

RunID: 20090201-0030-k9cb65gc
Progress:
Progress:  uninitialized:1
Progress:  Selecting site:3 Stage in:2
Progress:  Selecting site:3 Stage in:2
Progress:  Selecting site:3 Submitting:1 Submitted:1
Failed to transfer wrapper log from
blast-20090201-0030-k9cb65gc/info/u on TERAPORT
Failed to transfer wrapper log from
blast-20090201-0030-k9cb65gc/info/v on TERAPORT
Progress:  Selecting site:1 Stage in:1 Submitting:1 Failed but can retry:2
Progress:  Selecting site:1 Submitting:1 Submitted:1 Failed but can retry:2
Failed to transfer wrapper log from
blast-20090201-0030-k9cb65gc/info/y on TERAPORT
Progress:  Stage in:1 Submitting:1 Failed but can retry:3
Failed to transfer wrapper log from
blast-20090201-0030-k9cb65gc/info/0 on TERAPORT
Progress:  Submitted:1 Failed but can retry:4
Failed to transfer wrapper log from
blast-20090201-0030-k9cb65gc/info/2 on TERAPORT
Progress:  Failed but can retry:5


log file
2009-02-01 00:31:40,129-0600 DEBUG TaskImpl Task(type=FILE_OPERATION,
identity=urn:0-6-5-1-1233469825381) setting status to Active
2009-02-01 00:31:40,130-0600 DEBUG TaskImpl Task(type=FILE_OPERATION,
identity=urn:0-6-5-1-1233469825381) setting status to Failed
org.globus.cog.abstraction.impl.file.FileNotFoundException:
blastall-2qgpuz5j-info not found.
2009-02-01 00:31:40,130-0600 WARN  vdl:transferwrapperlog Failed to
transfer wrapper log from blast-20090201-0030-k9cb65gc/info/2 on
TERAPORT
2009-02-01 00:31:40,131-0600 DEBUG vdl:transferwrapperlog Exception
for wrapper log failure from blast-20090201-0030-k9cb65gc/info/2 on
TERAPORT: File not found:
/disks/tp-gpfs/scratch/aespinosa/blast-20090201-0030-k9cb65gc/info/2/blastall-2qgpuz5j-info
	task:transfer @ vdl-int.k, line: 356
	sys:try @ vdl-int.k, line: 356
	vdl:transferwrapperlog @ vdl-int.k, line: 466
	sys:maybe @ vdl-int.k, line: 466
	sys:discard @ vdl-int.k, line: 466
	sys:catch @ vdl-int.k, line: 457
	sys:try @ vdl-int.k, line: 394
	task:allocatehost @ vdl-int.k, line: 370
	vdl:execute2 @ execute-default.k, line: 24
	sys:try @ execute-default.k, line: 23
	sys:parallelfor @ execute-default.k, line: 21
	sys:restartonerror @ execute-default.k, line: 17
	sys:sequential @ execute-default.k, line: 15
	sys:try @ execute-default.k, line: 14
	sys:if @ execute-default.k, line: 13
	sys:then @ execute-default.k, line: 12
	sys:if @ execute-default.k, line: 11
	vdl:execute @ blast.kml, line: 109
	blastall @ blast.kml, line: 296
	sys:sequential @ blast.kml, line: 295
	sys:parallelfor @ blast.kml, line: 287
	sys:sequential @ blast.kml, line: 286
	sys:parallel @ blast.kml, line: 224
	vdl:mainp @ blast.kml, line: 223
	mainp @ vdl.k, line: 165
	vdl:mains @ blast.kml, line: 221
	vdl:mains @ blast.kml, line: 221
	rlog:restartlog @ blast.kml, line: 219
	kernel:project @ blast.kml, line: 2
	blast-20090201-0030-k9cb65gc
Caused by: org.globus.cog.abstraction.impl.file.FileNotFoundException:
File not found:
/disks/tp-gpfs/scratch/aespinosa/blast-20090201-0030-k9cb65gc/info/2/blastall-2qgpuz5j-info
2009-02-01 00:31:40,139-0600 DEBUG WeightedHostScoreScheduler
Releasing contact 6
2009-02-01 00:31:40,139-0600 DEBUG WeightedHostScoreScheduler
commitDelayedScore(TERAPORT:-10.000(0.039):0/1 overload: -99533, 0.1
2009-02-01 00:30:22,617-0600 DEBUG Loader Loader started