From piccoli at fnal.gov  Wed Jan 23 11:15:07 2008
From: piccoli at fnal.gov (Luciano Piccoli)
Date: Wed, 23 Jan 2008 11:15:07 -0600
Subject: [Swift-user] Mapper API
Message-ID: <4797761B.2090503@fnal.gov>


Yesterday I downloaded the latest version of Swift from SVN and am 
having some problems compiling the mapper that I created before. The 
mapper worked with the version from 04/29/07. There is a minor change in 
the API, more specifically in the method map, whose signature was 
"public String map(Path path)" and is now "public PhysicalFormat 
map(Path path)".

The problem I'm having may be related to that. Now the file names 
returned from the mapper are surrounded by []'s. Is there another change 
in the mapper structure that I might be missing?

Thanks,
Luciano



From wilde at mcs.anl.gov  Wed Jan 23 15:25:03 2008
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Wed, 23 Jan 2008 15:25:03 -0600
Subject: [Swift-user] Re: gridmap file for tg-uc
Message-ID: <4797B0AF.3070709@mcs.anl.gov>

MikeK,

I'm forwarding this to the Swift list, as Ben and I are teaching at Grid 
School this week.

What I'd suggest is:

- verify that you can do a plain globus-url-copy to/from the storage 
directory

- send your swift script, so we can see what form of URI swift is trying 
to access

- send your swift logfiles so we can see the context of the error

Ben and Mihael may have other ideas of want to comment.


- MikeW

-------- Original Message --------
Subject: gridmap file for tg-uc
Date: Wed, 23 Jan 2008 13:15:03 -0800 (PST)
From: Mike Kubal <mikekubal at yahoo.com>
To: joseph insley <insley at mcs.anl.gov>, Mike Wilde <wilde at mcs.anl.gov>

Hi Joe and Mike,

I used the gx-request again to add myself to the
gridmap on UC's teragrid again. It seemed to go
smoothly, just like the time before.

Though I still get the following error message when
running my Swift script:

Execution failed:
         Could not initialize shared directory on
teraport
Caused by:

org.globus.cog.abstraction.impl.file.FileResourceException:
Error communicating with the GridFTP server
Caused by:
         Server refused performing the request. Custom
message: Bad password. (error code 1) [Nested
exception message:  Custom message: Unexpected reply:
530-Login incorrect. :
gridmap.c:globus_gss_assist_map_and_authorize:1910:
530-Error invoking callout
530-globus_callout.c:globus_callout_handle_call_type:727:
530-The callout returned an error
530-prima_module.c:Globus Gridmap Callout:430:
530-Gridmap lookup failure: Could not retrieve mapping
for  /DC=org/DC=doegrids/OU=People/CN=Michael Kubal
486347 from identity mapping server
530-
530 End.]

Before running I also removed the certificates dir in
~mkubal/.globus.

Any suggestions?

Thanks,

Mike


--- joseph insley <insley at mcs.anl.gov> wrote:

> Mike,
> 
> You should be able to do this yourself using the
> gx-request command.
> See more info at:
>
http://www.teragrid.org/userinfo/access/auth_gxmap.php
> 
> 
> joe.
> 
> On Oct 29, 2007, at 2:07 PM, Mike Kubal wrote:
> 
> > Hi Joe,
> >
> > Please add me to gridmap file for tg-uc. My
> subject is
> > /DC=org/DC=doegrids/OU=People/CN=Michael Kubal
> 486347
> >
> > My user name is kubal.
> >
> > Thanks,
> >
> > Mike
> >
> > __________________________________________________
> > Do You Yahoo!?
> > Tired of spam?  Yahoo! Mail has the best spam
> protection around
> > http://mail.yahoo.com
> >
> 
> 



 
____________________________________________________________________________________
Be a better friend, newshound, and
know-it-all with Yahoo! Mobile.  Try it now. 
http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ




From skenny at uchicago.edu  Tue Jan 29 10:31:19 2008
From: skenny at uchicago.edu (skenny at uchicago.edu)
Date: Tue, 29 Jan 2008 10:31:19 -0600 (CST)
Subject: [Swift-user] kickstart error
Message-ID: <20080129103119.AZI25812@m4500-02.uchicago.edu>

hi all, 

i'm getting this error while trying to run freesurfer on
lonestar...looking on the remote site it's true the xml file
referred to is not there; anyway, just wondering if anyone
else came across this? 

Caused by:
org.globus.cog.abstraction.impl.file.FileResourceException:
Exception in getFile
Caused by: org.globus.ftp.exception.ServerException: Server
refused performing the request. Custom message:  (error code
1) [Nested exception message:  Custom message: Unexpected
reply: 50  0-Command failed. : globus_l_gfs_file_open failed.
500-globus_xio: Unable to open file
/import/data2/projects/tg/SIDGrid/sidgrid_out/autorecon2-20080128-1447-yq5ub56e/kickstart/f/reconall-frtu6mni-kickstart.xml
500-globus_xio: System error in open: No such file or directory
500-globus_xio: A system call failed: No such file or directory
500-
500 End.] [Nested exception is
org.globus.ftp.exception.UnexpectedReplyCodeException:  Custom
message: Unexpected reply: 500-Command failed. :
globus_l_gfs_file_open failed.
500-globus_xio: Unable to open file
/import/data2/projects/tg/SIDGrid/sidgrid_out/autorecon2-20080128-1447-yq5ub56e/kickstart/f/reconall-frtu6mni-kickstart.xml
500-globus_xio: System error in open: No such file or directory
500-globus_xio: A system call failed: No such file or directory
500-
500 End.]
reconall failed
Execution failed:
        Exception in reconall:
Arguments: [skenny, -s dude -careg]
Host: LONESTAR
Directory:
autorecon2-20080128-1447-yq5ub56e/jobs/f/reconall-frtu6mni
stderr.txt:
stdout.txt:

----
KickstartRecord: reconall-frtu6mni-kickstart.xml
Caused by:
        No status file was found. Check the shared filesystem
on LONESTAR

i'm trying another run now w/kickstart disabled.

sarah


From quanpt at cs.uchicago.edu  Wed Jan 30 12:43:18 2008
From: quanpt at cs.uchicago.edu (Quan Tran Pham)
Date: Wed, 30 Jan 2008 12:43:18 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5 queue
	polls after the job was reported done
In-Reply-To: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
Message-ID: <4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>

Hi everyone,

Could someone please help me with this swift problem, or can you point me to
where I should get more information?

I encountered this message: "Exitcode file not found 5 queue polls after the
job was reported done" when trying to run a simple Hello World swift script
on PBS.

I have attached the log file from swift.

Thank you very much

Regards

-- 
Quan Tran Pham
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20080130/0008cdf0/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: hello-20080130-0011-iiz77la3.log
Type: application/octet-stream
Size: 21318 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20080130/0008cdf0/attachment.obj>

From hategan at mcs.anl.gov  Wed Jan 30 14:31:09 2008
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Wed, 30 Jan 2008 14:31:09 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
Message-ID: <1201725069.7161.2.camel@blabla.mcs.anl.gov>

So this is specific to the local PBS provider. It may indicate a problem
with the shared filesystem, but I'll need more details of the
environment you're trying this on.

Mihael

On Wed, 2008-01-30 at 12:43 -0600, Quan Tran Pham wrote:
> Hi everyone,
> 
> Could someone please help me with this swift problem, or can you point
> me to where I should get more information?
> 
> I encountered this message: "Exitcode file not found 5 queue polls
> after the job was reported done" when trying to run a simple Hello
> World swift script on PBS.
> 
> I have attached the log file from swift.
> 
> Thank you very much
> 
> Regards
> 
> -- 
> Quan Tran Pham
> 
> 
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user



From benc at hawaga.org.uk  Wed Jan 30 14:34:45 2008
From: benc at hawaga.org.uk (Ben Clifford)
Date: Wed, 30 Jan 2008 20:34:45 +0000 (GMT)
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <1201725069.7161.2.camel@blabla.mcs.anl.gov>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
	<1201725069.7161.2.camel@blabla.mcs.anl.gov>
Message-ID: <Pine.LNX.4.64.0801302033390.6302@dildano.hawaga.org.uk>


The error message seems familiar to me. I think that the one time I played 
with the PBS provider a bit I encountered it, but then didn't see anything 
immediately obvious to fix and then went to work on other stuff.

On Wed, 30 Jan 2008, Mihael Hategan wrote:

> So this is specific to the local PBS provider. It may indicate a problem
> with the shared filesystem, but I'll need more details of the
> environment you're trying this on.
> 
> Mihael
> 
> On Wed, 2008-01-30 at 12:43 -0600, Quan Tran Pham wrote:
> > Hi everyone,
> > 
> > Could someone please help me with this swift problem, or can you point
> > me to where I should get more information?
> > 
> > I encountered this message: "Exitcode file not found 5 queue polls
> > after the job was reported done" when trying to run a simple Hello
> > World swift script on PBS.
> > 
> > I have attached the log file from swift.
> > 
> > Thank you very much
> > 
> > Regards
> > 
> > -- 
> > Quan Tran Pham
> > 
> > 
> > _______________________________________________
> > Swift-user mailing list
> > Swift-user at ci.uchicago.edu
> > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
> 
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
> 
> 


From quanpt at cs.uchicago.edu  Wed Jan 30 15:00:40 2008
From: quanpt at cs.uchicago.edu (Quan Tran Pham)
Date: Wed, 30 Jan 2008 15:00:40 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <1201725069.7161.2.camel@blabla.mcs.anl.gov>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
	<1201725069.7161.2.camel@blabla.mcs.anl.gov>
Message-ID: <4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com>

I use PBS on teraport tp-login machine, I guess I should you the same shared
file system with everyone.

Quan Pham

On Jan 30, 2008 2:31 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> So this is specific to the local PBS provider. It may indicate a problem
> with the shared filesystem, but I'll need more details of the
> environment you're trying this on.
>
> Mihael
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20080130/6dafff5b/attachment.html>

From hategan at mcs.anl.gov  Wed Jan 30 15:10:48 2008
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Wed, 30 Jan 2008 15:10:48 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
	<1201725069.7161.2.camel@blabla.mcs.anl.gov>
	<4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com>
Message-ID: <1201727448.8101.8.camel@blabla.mcs.anl.gov>

Ok. I'll try to test it. What version of swift? And do you get this on
every job, or just occasionally?

On Wed, 2008-01-30 at 15:00 -0600, Quan Tran Pham wrote:
> I use PBS on teraport tp-login machine, I guess I should you the same
> shared file system with everyone. 
> 
> Quan Pham
> 
> On Jan 30, 2008 2:31 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
>         So this is specific to the local PBS provider. It may indicate
>         a problem
>         with the shared filesystem, but I'll need more details of the
>         environment you're trying this on.
>         
>         Mihael
> 



From quanpt at cs.uchicago.edu  Wed Jan 30 17:16:32 2008
From: quanpt at cs.uchicago.edu (Quan Tran Pham)
Date: Wed, 30 Jan 2008 17:16:32 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <1201727448.8101.8.camel@blabla.mcs.anl.gov>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
	<1201725069.7161.2.camel@blabla.mcs.anl.gov>
	<4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com>
	<1201727448.8101.8.camel@blabla.mcs.anl.gov>
Message-ID: <4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>

Mihael, this is my first try using PBS, and I got into that error. I use
swift version 0.3.
Is there any document about using swift with PBS, other than this
http://www.ci.uchicago.edu/swift/guides/userguide.php#providers ?

Thank you

Quan Pham

On Jan 30, 2008 3:10 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> Ok. I'll try to test it. What version of swift? And do you get this on
> every job, or just occasionally?
>
> On Wed, 2008-01-30 at 15:00 -0600, Quan Tran Pham wrote:
> > I use PBS on teraport tp-login machine, I guess I should you the same
> > shared file system with everyone.
> >
> > Quan Pham
> >
> > On Jan 30, 2008 2:31 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
> >         So this is specific to the local PBS provider. It may indicate
> >         a problem
> >         with the shared filesystem, but I'll need more details of the
> >         environment you're trying this on.
> >
> >         Mihael
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20080130/16367279/attachment.html>

From hategan at mcs.anl.gov  Wed Jan 30 19:07:33 2008
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Wed, 30 Jan 2008 19:07:33 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
	<1201725069.7161.2.camel@blabla.mcs.anl.gov>
	<4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com>
	<1201727448.8101.8.camel@blabla.mcs.anl.gov>
	<4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>
Message-ID: <1201741653.8658.4.camel@blabla.mcs.anl.gov>


On Wed, 2008-01-30 at 17:16 -0600, Quan Tran Pham wrote:
> Mihael, this is my first try using PBS, and I got into that error. I
> use swift version 0.3. 
> Is there any document about using swift with PBS, other than this
> http://www.ci.uchicago.edu/swift/guides/userguide.php#providers ?

There's this thing I started cleaning up:
http://wiki.cogkit.org/index.php/V:Head/Java_CoG_Kit_Abstractions_Guide#Available_Providers

But not much more.

Btw, I don't think you're doing anything wrong. I'm leaning towards
believing that there is a bug in the provider and I'm trying to gather
information so that I can reproduce and fix it.

Mihael

> 
> Thank you
> 
> Quan Pham
> 
> On Jan 30, 2008 3:10 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
>         Ok. I'll try to test it. What version of swift? And do you get
>         this on
>         every job, or just occasionally?
>         
>         
>         On Wed, 2008-01-30 at 15:00 -0600, Quan Tran Pham wrote:
>         > I use PBS on teraport tp-login machine, I guess I should you
>         the same
>         > shared file system with everyone.
>         >
>         > Quan Pham
>         >
>         > On Jan 30, 2008 2:31 PM, Mihael Hategan
>         <hategan at mcs.anl.gov> wrote:
>         >         So this is specific to the local PBS provider. It
>         may indicate
>         >         a problem
>         >         with the shared filesystem, but I'll need more
>         details of the
>         >         environment you're trying this on.
>         >
>         >         Mihael
>         >
>         
> 



From wilde at mcs.anl.gov  Thu Jan 31 07:14:48 2008
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Thu, 31 Jan 2008 07:14:48 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <Pine.LNX.4.64.0801302033390.6302@dildano.hawaga.org.uk>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>	<1201725069.7161.2.camel@blabla.mcs.anl.gov>
	<Pine.LNX.4.64.0801302033390.6302@dildano.hawaga.org.uk>
Message-ID: <47A1C9C8.2080603@mcs.anl.gov>

 >> So this is specific to the local PBS provider. It may indicate a problem
 >> with the shared filesystem, but I'll need more details of the
 >> environment you're trying this on.

Mihael, what other details do you need to diagnose this?
sites.xml and tc.data?

- mike

On 1/30/08 2:34 PM, Ben Clifford wrote:
> The error message seems familiar to me. I think that the one time I played 
> with the PBS provider a bit I encountered it, but then didn't see anything 
> immediately obvious to fix and then went to work on other stuff.
> 
> On Wed, 30 Jan 2008, Mihael Hategan wrote:
> 
>> So this is specific to the local PBS provider. It may indicate a problem
>> with the shared filesystem, but I'll need more details of the
>> environment you're trying this on.
>>
>> Mihael
>>
>> On Wed, 2008-01-30 at 12:43 -0600, Quan Tran Pham wrote:
>>> Hi everyone,
>>>
>>> Could someone please help me with this swift problem, or can you point
>>> me to where I should get more information?
>>>
>>> I encountered this message: "Exitcode file not found 5 queue polls
>>> after the job was reported done" when trying to run a simple Hello
>>> World swift script on PBS.
>>>
>>> I have attached the log file from swift.
>>>
>>> Thank you very much
>>>
>>> Regards
>>>
>>> -- 
>>> Quan Tran Pham
>>>
>>>
>>> _______________________________________________
>>> Swift-user mailing list
>>> Swift-user at ci.uchicago.edu
>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>
>>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
> 
> 


From hategan at mcs.anl.gov  Thu Jan 31 16:08:56 2008
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Thu, 31 Jan 2008 16:08:56 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
	<1201725069.7161.2.camel@blabla.mcs.anl.gov>
	<4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com>
	<1201727448.8101.8.camel@blabla.mcs.anl.gov>
	<4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>
Message-ID: <1201817336.16875.1.camel@blabla.mcs.anl.gov>

So I can't reproduce this with the latest Swift. Can you tell me if you
have the ~/.globus/scripts directory on tp-login and what's in it?

Mihael

On Wed, 2008-01-30 at 17:16 -0600, Quan Tran Pham wrote:
> Mihael, this is my first try using PBS, and I got into that error. I
> use swift version 0.3. 
> Is there any document about using swift with PBS, other than this
> http://www.ci.uchicago.edu/swift/guides/userguide.php#providers ?
> 
> Thank you
> 
> Quan Pham
> 
> On Jan 30, 2008 3:10 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
>         Ok. I'll try to test it. What version of swift? And do you get
>         this on
>         every job, or just occasionally?
>         
>         
>         On Wed, 2008-01-30 at 15:00 -0600, Quan Tran Pham wrote:
>         > I use PBS on teraport tp-login machine, I guess I should you
>         the same
>         > shared file system with everyone.
>         >
>         > Quan Pham
>         >
>         > On Jan 30, 2008 2:31 PM, Mihael Hategan
>         <hategan at mcs.anl.gov> wrote:
>         >         So this is specific to the local PBS provider. It
>         may indicate
>         >         a problem
>         >         with the shared filesystem, but I'll need more
>         details of the
>         >         environment you're trying this on.
>         >
>         >         Mihael
>         >
>         
> 



From quanpt at cs.uchicago.edu  Thu Jan 31 16:46:28 2008
From: quanpt at cs.uchicago.edu (Quan Tran Pham)
Date: Thu, 31 Jan 2008 16:46:28 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <1201817336.16875.1.camel@blabla.mcs.anl.gov>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>	
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>	
	<1201725069.7161.2.camel@blabla.mcs.anl.gov>	
	<4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com>	
	<1201727448.8101.8.camel@blabla.mcs.anl.gov>	
	<4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>
	<1201817336.16875.1.camel@blabla.mcs.anl.gov>
Message-ID: <47A24FC4.90009@cs.uchicago.edu>

The directory "~/.globus/scripts" exists, but it is empty.

I try a hello world swift which use echo only, so I use the default 
tc.data. The content of sites.xml is like this:
   <pool handle="localhost" sysinfo="INTEL32::LINUX">
     <gridftp  url="local://localhost" storage="/var/tmp" major="1" 
minor="0" patch="0" />
     <execution provider="pbs" url="none" />
     <workdirectory >/var/tmp</workdirectory>
   </pool>
And that's all about the environment.

Quan Pham

Mihael Hategan wrote:
> So I can't reproduce this with the latest Swift. Can you tell me if you
> have the ~/.globus/scripts directory on tp-login and what's in it?
> 
> Mihael
> 
> On Wed, 2008-01-30 at 17:16 -0600, Quan Tran Pham wrote:
>> Mihael, this is my first try using PBS, and I got into that error. I
>> use swift version 0.3. 
>> Is there any document about using swift with PBS, other than this
>> http://www.ci.uchicago.edu/swift/guides/userguide.php#providers ?
>>
>> Thank you
>>
>> Quan Pham
>>
>> On Jan 30, 2008 3:10 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
>>         Ok. I'll try to test it. What version of swift? And do you get
>>         this on
>>         every job, or just occasionally?
>>         
>>         
>>         On Wed, 2008-01-30 at 15:00 -0600, Quan Tran Pham wrote:
>>         > I use PBS on teraport tp-login machine, I guess I should you
>>         the same
>>         > shared file system with everyone.
>>         >
>>         > Quan Pham
>>         >
>>         > On Jan 30, 2008 2:31 PM, Mihael Hategan
>>         <hategan at mcs.anl.gov> wrote:
>>         >         So this is specific to the local PBS provider. It
>>         may indicate
>>         >         a problem
>>         >         with the shared filesystem, but I'll need more
>>         details of the
>>         >         environment you're trying this on.
>>         >
>>         >         Mihael
>>         >
>>         
>>
> 



From benc at hawaga.org.uk  Thu Jan 31 17:03:41 2008
From: benc at hawaga.org.uk (Ben Clifford)
Date: Thu, 31 Jan 2008 23:03:41 +0000 (GMT)
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <47A24FC4.90009@cs.uchicago.edu>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com> 
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com> 
	<1201725069.7161.2.camel@blabla.mcs.anl.gov> 
	<4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com> 
	<1201727448.8101.8.camel@blabla.mcs.anl.gov> 
	<4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>
	<1201817336.16875.1.camel@blabla.mcs.anl.gov>
	<47A24FC4.90009@cs.uchicago.edu>
Message-ID: <Pine.LNX.4.64.0801312301301.6302@dildano.hawaga.org.uk>


On Thu, 31 Jan 2008, Quan Tran Pham wrote:

>     <workdirectory >/var/tmp</workdirectory>

Please can you:

 mkdir /home/quanpt/swift-run-dir

and edit the above line in your sites.xml to say 

    <workdirectory >/home/quanpt/swift-run-dir/</workdirectory>


-- 


From quanpt at cs.uchicago.edu  Thu Jan 31 17:14:43 2008
From: quanpt at cs.uchicago.edu (Quan Tran Pham)
Date: Thu, 31 Jan 2008 17:14:43 -0600
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <Pine.LNX.4.64.0801312301301.6302@dildano.hawaga.org.uk>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com>
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com>
	<1201725069.7161.2.camel@blabla.mcs.anl.gov>
	<4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com>
	<1201727448.8101.8.camel@blabla.mcs.anl.gov>
	<4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>
	<1201817336.16875.1.camel@blabla.mcs.anl.gov>
	<47A24FC4.90009@cs.uchicago.edu>
	<Pine.LNX.4.64.0801312301301.6302@dildano.hawaga.org.uk>
Message-ID: <47A25663.6000604@cs.uchicago.edu>

It works!

So apparently, I cannot write to the worker node /var/tmp! How come the 
job was reported done?

Thanks a lot, everyone.

Regards

Quan Pham

Ben Clifford wrote:
> On Thu, 31 Jan 2008, Quan Tran Pham wrote:
> 
>>     <workdirectory >/var/tmp</workdirectory>
> 
> Please can you:
> 
>  mkdir /home/quanpt/swift-run-dir
> 
> and edit the above line in your sites.xml to say 
> 
>     <workdirectory >/home/quanpt/swift-run-dir/</workdirectory>
> 



From benc at hawaga.org.uk  Thu Jan 31 17:31:21 2008
From: benc at hawaga.org.uk (Ben Clifford)
Date: Thu, 31 Jan 2008 23:31:21 +0000 (GMT)
Subject: [Swift-user] Help: Error in Swift: Exitcode file not found 5
	queue polls after the job was reported done
In-Reply-To: <47A25663.6000604@cs.uchicago.edu>
References: <4290b6c60801301041p13f2184cj3cdd86fbd6e75b3f@mail.gmail.com> 
	<4290b6c60801301043m2be446e5lede0dc145771558f@mail.gmail.com> 
	<1201725069.7161.2.camel@blabla.mcs.anl.gov> 
	<4290b6c60801301300m140f8411rf008e7b73405f926@mail.gmail.com> 
	<1201727448.8101.8.camel@blabla.mcs.anl.gov> 
	<4290b6c60801301516t5271bc4cw90c5c6a0b0e2cd62@mail.gmail.com>
	<1201817336.16875.1.camel@blabla.mcs.anl.gov>
	<47A24FC4.90009@cs.uchicago.edu>
	<Pine.LNX.4.64.0801312301301.6302@dildano.hawaga.org.uk>
	<47A25663.6000604@cs.uchicago.edu>
Message-ID: <Pine.LNX.4.64.0801312328370.6232@dildano.hawaga.org.uk>



On Thu, 31 Jan 2008, Quan Tran Pham wrote:

> So apparently, I cannot write to the worker node /var/tmp!

That isn't the problem.

The problem is that /var/tmp on a worker node is a different directory to 
/var/tmp on the head node - if I put a file in /var/tmp on machine A, it 
does not appear in /var/tmp on machine B.

Your home directory, on the other hand, is the same directory on every 
node in the cluster - if I put a file in ~quanpt on machine A, I can see 
it in ~quanpt on machine B.

The site working directory needs to be shared between all of the worker 
nodes and the head node.

--