[Swift-devel] Fwd: NumberFormatException

[Mihael Hategan]

On Wed, 2011-07-13 at 11:29 -0500, Jonathan Monette wrote:
> I am starting to believe that this maybe a bug.  I have this line in
> the log.
> 
> 
> 2011-07-13 16:17:50,835+0000 DEBUG vdl:dostageinfile
> FILE_STAGE_IN_START file=data.txt
> srchost=gridftp.pads.ci.uchicago.edu:2811
> srcdir=/gpfs/pads/projects/CI-CCR000013/jonmon/Swift/tests/cat_test
> srcname=data.txt desthost=localhost
> destdir=script-20110713-1617-lzk6sxj3/shared/gpfs/pads/projects/CI-CCR000013/jonmon/Swift/tests/cat_test provider=gsiftp policy=DEFAULT
> 
> 
> The desthost is localhost.  That is correct.  But why does the destdir
> have /gpfs in it?  My localhost is VM.  It does not have access to
> gpfs.

It makes (some) sense because this is a simple way to ensure that no two
files on a remote filesystem will have the same path inside the job
directory if they have different paths on the source side. This is
mostly true if the source side is on a single filesystem (which is what
the initial version of swift did). With more than one (i.e. cat(a, b)
where a = host1/p/f.txt, b = host2/p/f.txt) it's not quite so (and we
should probably fix that). In any event, it's what it's supposed to be
in the current implementation.