[Swift-devel] persistent coasters gridftp provider fails with error 500

[Mihael Hategan]

Is your workdir on a shared filesystem?

On Thu, 2011-09-22 at 21:10 -0500, Ketan Maheshwari wrote:
> 
> On Thu, Sep 22, 2011 at 6:03 PM, Mihael Hategan <hategan at mcs.anl.gov>
> wrote:
>         Does that machine have /bin/bash?
> 
> 
> yes.
> 
> 
> [bridled:catsn-condor]$ globus-job-run
> cit-gatekeeper.ultralight.org /bin/bash -c '/bin/hostname'
> cithep231.ultralight.org
> 
> 
>  
>         
>         The failure to transfer the wrapper log is normal, since the
>         wrapper
>         didn't actually run, but it is not the source of the problem.
>         
>         
>         On Thu, 2011-09-22 at 15:56 -0500, Ketan Maheshwari wrote:
>         > Hi Mihael,
>         >
>         >
>         > I was trying to use persistent coasters on OSG with gridFTP
>         as
>         > provider. The script catsn is intended to transfer one small
>         file
>         > (<1MB) to an OSG site
>         (gsiftp://cit-gatekeeper.ultralight.org).
>         >
>         >
>         > However, I see that the script fails. The stdout message is:
>         >
>         >
>         > Failed to transfer wrapper log for job cat-tyxj0agk
>         > Progress:  time: Thu, 22 Sep 2011 15:44:35 -0500  Failed:1
>         > Exception in cat:
>         > Arguments: [gpfs/pads/swift/ketan/indir1file/data0000.txt]
>         > Host: CIT_CMS_T2__cit-gatekeeper.ultralight.org
>         > Directory:
>         catsngridftp-20110922-1544-brgdcf5d/jobs/t/cat-tyxj0agk
>         > stderr.txt:
>         >
>         >
>         > stdout.txt:
>         >
>         >
>         > ----
>         >
>         >
>         > Caused by: null
>         > Caused by:
>         >
>         org.globus.cog.abstraction.impl.common.execution.JobException:
>         Job
>         > failed with an exit code of 127
>         > Final status:  time: Thu, 22 Sep 2011 15:44:35 -0500
>          Failed:1
>         > The following errors have occurred:
>         > 1. Job failed with an exit code of 127
>         >
>         >
>         > Looking at the log it says the following error:
>         >
>         >
>         > 2011-09-22 15:44:35,716-0500 DEBUG vdl:transferwrapperlog
>         Exception
>         > for wrapper log failure from
>         > catsngridftp-20110922-1544-brgdcf5d/info/t on
>         CIT_CMS_T2__cit-gateke
>         > eper.ultralight.org: null
>         > Caused by:
>         >
>         org.globus.cog.abstraction.impl.file.IrrecoverableResourceException:
>         > Exception in getFile
>         > Caused by:
>         org.globus.cog.abstraction.impl.file.FileResourceException:
>         > Failed to retrieve file information
>         > about /raid2/osg-data/engage/scec/swift_scratch/catsngridf
>         > tp-20110922-1544-brgdcf5d/info/t/cat-tyxj0agk-info
>         > Caused by: org.globus.ftp.exception.ServerException: Server
>         refused
>         > performing the request. Custom message: Server refused MLST
>         command
>         > (error code 1) [Nested except
>         > ion message:  Custom message: Unexpected reply: 500-Command
>         failed :
>         > globus_gridftp_server_file.c:globus_l_gfs_file_stat:389:
>         > 500-System error in stat: No such file or directory
>         > 500-A system call failed: No such file or directory
>         > 500 End.] [Nested exception is
>         > org.globus.ftp.exception.UnexpectedReplyCodeException:
>          Custom
>         > message: Unexpected reply: 500-Command failed :
>         > globus_gridftp_server_f
>         > ile.c:globus_l_gfs_file_stat:389:
>         > 500-System error in stat: No such file or directory
>         > 500-A system call failed: No such file or directory
>         > 500 End.]
>         > 2011-09-22 15:44:35,719-0500 INFO  vdl:execute END_FAILURE
>         > thread=0-6-0-1 tr=cat
>         > 2011-09-22 15:44:35,720-0500 INFO  vdl:execute Exception in
>         cat:
>         > Arguments: [gpfs/pads/swift/ketan/indir1file/data0000.txt]
>         > Host: CIT_CMS_T2__cit-gatekeeper.ultralight.org
>         > Directory:
>         catsngridftp-20110922-1544-brgdcf5d/jobs/t/cat-tyxj0agk
>         >
>         >
>         >
>         > I manually tried to transfer files of small sizes to and
>         from pads to
>         > the site in question and it worked ok.
>         >
>         >
>         > The complete log for this run is:
>         >
>         http://www.ci.uchicago.edu/~ketan/catsngridftp-20110922-1544-brgdcf5d.log
>         >
>         >
>         > Could you kindly study the log and give any clues as to what
>         is going
>         > on.
>         >
>         >
>         > Regards,
>         > --
>         > Ketan
>         >
>         >
>         >
>         
>         
>         
> 
> 
> 
> 
> -- 
> Ketan
> 
>