[Swift-devel] gridftp issue in running oops swift script on queenbee

[Wenjun Wu]

I wrote a simple script doing the cat on Queenbeen and it worked fine.
type MFile;

(MFile outfile) runcat(MFile infile){
  app {
   rcat @infile stdout=@filename(outfile);
  }
}


MFile infile <single_file_mapper;file="test-input">;
MFile outfile <single_file_mapper;file="test-output">;

outfile=runcat(infile);

What I really want to try as a next step is to run the ItFixInit as a 
local task instead of a remote one. It could avoid the weird issue.

Wenjun
> Wenjun, can you try to run a simple script consisting of a single cat 
> command, to make it easy to see what Swift is doing on Queenbee?
>
> It looks to me like something is acting strange in the interaction 
> between Swift and Queenbee's gridftp server.
>
> Mihael: looking at the original logs I was perplexed to see that Swift 
> could create the remote directories but not remove them. Almost as if 
> the remove command was using a pathname that the grodftp server 
> couldnt see.
>
> Wenjun tried a manual globus-url-copy to what we thought was a very 
> similar path, and from the command line (with Swift's globus-url-copy) 
> it was able to fetch individual files. So it seems that his workdir is 
> visible to Queenbee's gridftp by what *seemed* like the expected path.
>
> It would be interesting to try uberftp and see if dirs and files can 
> be removed. You'd need a host that has it; not sure if its in the 
> teragrid toolkit or not. Its in the OSG client stack. Maybe can 
> download it separately.
>
> - Mike
>
>
>
> On 12/3/09 11:25 PM, Mihael Hategan wrote:
>> Doesn't look like there are any files there created by the compute
>> nodes. Are you sure that filesystem is visible from the compute node?
>>
>> On Thu, 2009-12-03 at 23:03 -0600, Wenjun Wu wrote:
>>> .
>>>    |-info
>>>    |-kickstart
>>>    |-shared
>>>    |---dev
>>>    |---output
>>>    |-----T1af7
>>>    |-------R00
>>>    |---sandbox
>>>    |-----wwj
>>>    |-------oops
>>>    |---------input
>>>    |-----------fasta
>>>    |-----------native
>>>    |-----------rama
>>>    |-----------secseq
>>>    |-status
>>>    |---f
>>>    |---h
>>>    |---j
>>>
>>>> On Thu, 2009-12-03 at 16:31 -0600, Wenjun Wu wrote:
>>>>  
>>>>> Under the info directory, there is no file left.
>>>>>
>>>>> ls -lt oops-20091202-1700-vmh5dnd3/info
>>>>> total 0
>>>>>
>>>>> And actually the j/ItFixInit-jjpe3bk was created at the same level 
>>>>> as oops-20091202-1700-vmh5dnd3.
>>>>>     
>>>> Can you do a "tree" in oops-20091202-1700-vmh5dnd3 and paste that?
>>>>
>>>>   
>>
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel