[Swift-devel] error in reading in files over gridftp

[Allan Espinosa]

weird.  i guess two gridftp servers has its own personality :(

it worked when having the file from ci!

type messagefile;

(messagefile o) write(messagefile i) {
    app {
        echo @filename(i) stdout=@filename(o);
    }
}

messagefile infile
    <"gsiftp://tp-grid.ci.uchicago.edu//home/aespinosa/workflows/testing/071-singlefilemapper-input.in">;

outfile = write(infile);

wow it worked!
swift-r3264 cog-r2728

RunID: test
Progress:
Final status:  Finished successfully:1


time to email the site administrators. thanks for you time Mihael!

-Allan


2010/3/24 Mihael Hategan <hategan at mcs.anl.gov>:
> May be the gridftp client-server interaction then. Can you test on a
> gridftp server where I can reproduce it (e.g. pads, tp, tguc - if it
> still exists -, surveyor)?
>
> On Wed, 2010-03-24 at 17:48 -0500, Allan Espinosa wrote:
>> Just created the said file in the home directory.  I tried using both
>> single slash and two slashes.   Both gave the same errors
>>
>> still no good :(
>>
>> swift-r3264 cog-r2728
>>
>> RunID: test
>> Progress:
>> Progress: Failed but can retry:1
>> Failed to transfer wrapper log from
>> 071-singlefilemapper-input-test/info/4 on localhost
>> Execution failed:
>>         Exception in echo:
>> Arguments: [panfs/panasas/CMS/data/engage/swift/071-singlefilemapper-input.in]
>> Host: localhost
>> Directory: 071-singlefilemapper-input-test/jobs/4/echo-44t4bkpj
>> stderr.txt:
>>
>> stdout.txt:
>>
>> ----
>>
>> Caused by:
>>         Exception in getFile
>> Caused by:
>>         Server refused performing the request. Custom message:  (error
>> code 1) [Nested exception message:  Custom message: Unexpected reply:
>> 500 Command failed]
>>
>>
>>
>> 2010/3/24 Mihael Hategan <hategan at mcs.anl.gov>:
>> > No good.
>> >
>> > So, maybe there's one more thing to try, for completeness.
>> >
>> > If you put the file in
>> > ~/panfs/panasas/CMS/data/engage/swift/071-singlefilemapper-input.in and
>> > revert to the first form (i.e. 2 slashes), does that work?
>> >
>> > On Wed, 2010-03-24 at 17:27 -0500, Allan Espinosa wrote:
>> >> the argument passed to the app gets prefixed another slash (both in
>> >> the session output and logfile)
>> >> swift-r3264 cog-r2728
>> >>
>> >> RunID: test
>> >> Progress:
>> >> Progress: Failed but can retry:1
>> >> Failed to transfer wrapper log from
>> >> 071-singlefilemapper-input-test/info/n on localhost
>> >> Execution failed:
>> >>         Exception in echo:
>> >> Arguments: [/panfs/panasas/CMS/data/engage/swift/071-singlefilemapper-input.in]
>> >> Host: localhost
>> >> Directory: 071-singlefilemapper-input-test/jobs/n/echo-nvkbakpj
>> >> stderr.txt:
>> >>
>> >> stdout.txt:
>> >>
>> >> ----
>> >>
>> >> Caused by:
>> >>         Exception in getFile
>> >> Caused by:
>> >>         Server refused performing the request. Custom message:  (error
>> >> code 1) [Nested exception message:  Custom message: Unexpected reply:
>> >> 500 Command failed]
>> >>
>> >>
>> >> 2010/3/24 Mihael Hategan <hategan at mcs.anl.gov>:
>> >> > What happens if you add another forward slash after ".edu"?
>> >> >
>> >> > On Wed, 2010-03-24 at 16:31 -0500, Allan Espinosa wrote:
>> >> >> The file gets created in the work directory (probably via touch) but
>> >> >> has 0 bytes for size.
>> >> >>
>> >> >> type messagefile;
>> >> >>
>> >> >> (messagefile o) write(messagefile i) {
>> >> >>     app {
>> >> >>         echo @filename(i) stdout=@filename(o);
>> >> >>     }
>> >> >> }
>> >> >>
>> >> >> messagefile infile
>> >> >> <"gsiftp://ff-grid.unl.edu//panfs/panasas/CMS/data/engage/swift/071-singlefilemapper-input.in">;
>> >> >> messagefile outfile <"071-singlefilemapper-input.out">;
>> >> >>
>> >> >> outfile = write(infile);
>> >> >>
>> >> >> session (with vanilla sites.xml):
>> >> >> swift-r3264 cog-r2728
>> >> >>
>> >> >> RunID: test
>> >> >> Progress:
>> >> >> Progress: Failed but can retry:1
>> >> >> Failed to transfer wrapper log from
>> >> >> 071-singlefilemapper-input-test/info/e on localhost
>> >> >> Progress: Failed but can retry:1
>> >> >> Failed to transfer wrapper log from
>> >> >> 071-singlefilemapper-input-test/info/g on localhost
>> >> >> Progress:  Stage in:1
>> >> >> Progress: Failed but can retry:1
>> >> >> Failed to transfer wrapper log from
>> >> >> 071-singlefilemapper-input-test/info/i on localhost
>> >> >> Execution failed:
>> >> >>         Exception in echo:
>> >> >> Arguments: [panfs/panasas/CMS/data/engage/swift/071-singlefilemapper-input.in]
>> >> >> Host: localhost
>> >> >> Directory: 071-singlefilemapper-input-test/jobs/i/echo-ic8o7kpj
>> >> >> stderr.txt:
>> >> >>
>> >> >> stdout.txt:
>> >> >>
>> >> >> ----
>> >> >>
>> >> >> Caused by:
>> >> >>         Exception in getFile
>> >> >> Caused by:
>> >> >>         Server refused performing the request. Custom message:  (error
>> >> >> code 1) [Nested exception message:  Custom message: Unexpected reply:
>> >> >> 500 Command failed]
>> >> >>
>> >> >> What command does getFile issue?  I can download the file manually via
>> >> >> globus-url-copy or uberftp
>> >> >>
>> >> >> the logfile is also attached in this email.
>> >> >>
>> >> >> thanks!
>> >> >> -Allan