[Swift-user] gsiftp filesystem mapper removes leading slash
Allan Espinosa
aespinosa at cs.uchicago.edu
Tue Feb 3 15:43:24 CST 2009
Hi,
I am trying to stage input data from a remote site to itself using
this workflow:
type database;
type query;
type output;
type error;
(output out, error err) blastall(query i, string pref, database db[]) {
app {
blastall "-p" "blastp" "-F" "F" "-d" pref "-i" @filename(i) "-v"
"300" "-b" "300" "-m8" "-o" @filename(out) stderr=@filename(err);
}
}
string pirpref = "/work/01035/tg802895/pir/UNIPROT_for_blast_14.0.seq";
database pir[] <filesys_mapper;location="gsiftp://gridftp.ranger.tacc.teragrid.org/work/01035/tg802895/pir",
pattern="UNIPROT_for_blast_14.0.seq*">;
output out[] <ext;exec="mapper-out.sh">;
error err[] <ext;exec="mapper-err.sh">;
query input[] <ext;exec="mapper-in.sh">;
foreach data ,i in input {
(out[i],err[i]) = blastall(data, pirpref, pir);
}
But gridftp internals in swift reports that it cannot get a directory
listing of "work/01035/tg802895/pir". I was thinking that maybe the
leading slashes were removed. Below is the program output:
~/swift/vdsk/bin/swift -config swift.properties -sites.file sites.xml
-tc.file tc.data blast.swift
Swift svn swift-r2490 cog-r2271
RunID: 20090203-1540-f00ydqsf
Progress:
Execution failed:
java.lang.RuntimeException:
org.globus.cog.abstraction.impl.file.FileResourceException: Could not
get list of files in work/01035/tg802895/pir from server
Caused by:
Server refused performing the request. Custom message: (error
code 1) [Nested exception message: Custom message: Unexpected reply:
500-Command failed. : System error in stat: No such file or directory
500-A system call failed: No such file or directory
500-
500 End.]
make: *** [remote] Error 2
but i was able to make a regular gridftp session:
uberftp gridftp.ranger.tacc.teragrid.org
220 gridftp2.ranger.tacc.utexas.edu GridFTP Server 2.8 (gcc64,
1217607445-63) [Globus Toolkit 4.0.8] ready.
230 User tg802895 logged in.
uberftp> cd /work/01035/tg802895/pir
uberftp> ls
-rw------- 1 tg802895 G-81621 204106872 Nov 12 21:44
UNIPROT_for_blast_14.0.seq.00.phr
-rw------- 1 tg802895 G-81621 23001752 Nov 12 21:45
UNIPROT_for_blast_14.0.seq.00.pin
-rw------- 1 tg802895 G-81621 999999669 Nov 12 21:45
UNIPROT_for_blast_14.0.seq.00.psq
...
logfile: http://www.ci.uchicago.edu/~aespinosa/swift/blast-20090203-1540-f00ydqsf.log
sites.xml:
<config>
<pool handle="RANGER">
<profile namespace="karajan" key="initialScore">2</profile>
<profile namespace="karajan" key="jobThrottle">1</profile>
<filesystem provider="coaster"
url="gt2://gatekeeper.ranger.tacc.teragrid.org"/>
<profile namespace="globus" key="coastersPerNode">16</profile>
<execution provider="coaster"
url="gatekeeper.ranger.tacc.teragrid.org" jobManager="gt2:gt2:SGE"/>
<workdirectory>/work/01035/tg802895</workdirectory>
</pool>
</config>
More information about the Swift-user
mailing list