[Swift-user] runnin' on IBI

[Michael Wilde]

Hi Marc,

Sorry for the delayed response.

I was suspicious that perhaps the (fairly) new SGE provider was not correctly handling error return codes. But I tested it (on ibicluster) with both non-zeroreturn codes and with apps that fail and raise a signal (I tried a divide by by 0 fault).

Everything I tested worked - I was unable to cause the error you received.

Then I tried to run your modftdock swift script - that worked as well (see below). This is in ~wilde/marc if you want to examine how I ran it (see run.sh)

Then I tested with the default Java, which caused first.swift to fail. TO my surprise, that worked as well.

So, the next things to do here are:
- you may want to copy my ~marc directory and see if it works for you
- I would like to get the full logs (and ideally the work directory) from the run(s) that failed for you
- If you could, please try to reproduce the error again and point me to a directory with all your files and and all the files that swift produced.
- also send me your $PATH value so I know what Java you used. (We should log this in the Swift log if its not there already).

Thanks,

Mike

My output was:

[wilde at ibicluster ~]$ pwd
/cchome/wilde
[wilde at ibicluster ~]$ cd marc
[wilde at ibicluster marc]$ ./run.sh
Swift svn swift-r3702 (swift modified locally) cog-r2924 (cog modified locally)

RunID: 20101118-0819-01ot1210
Progress:
SwiftScript trace: 1a25
SwiftScript trace: 1a2z
Progress:  Stage in:8
Progress:  Submitting:6  Submitted:2
Progress:  Submitting:3  Submitted:5
Progress:  Submitted:8
Progress:  Submitted:7  Active:1
Progress:  Active:8
Progress:  Active:8
Progress:  Active:8
Progress:  Active:8
Progress:  Active:8
Progress:  Active:7  Checking status:1
Progress:  Active:4  Stage out:1  Finished successfully:3
Progress:  Submitted:1  Active:4  Finished successfully:4
Progress:  Active:5  Finished successfully:4
Progress:  Active:4  Finished successfully:5
Progress:  Active:4  Finished successfully:5
Progress:  Active:3  Checking status:1  Finished successfully:5
Progress:  Active:3  Finished successfully:6
Progress:  Active:2  Checking status:1  Finished successfully:6
Progress:  Active:2  Finished successfully:7
Progress:  Active:1  Checking status:1  Finished successfully:7
Progress:  Submitted:1  Finished successfully:9
Progress:  Submitted:1  Finished successfully:9
Progress:  Active:1  Finished successfully:9
Final status:  Finished successfully:10
[wilde at ibicluster marc]$ 




----- Original Message -----
> Hi Mike,
> 
> 
> > Marc, can you point me to the directory in which you performed this
> > run, andmake sure that I can access it?
> 
> there's awful lots of file here... (see below)
> 
> 
> > I am wondering if you changed swift.properties, either by specifying
> > a -config file on the swift command line or by editng
> > swift.properties in your swift build or $HOME/.swift directory?
> 
> I use a "cf" file, and in it I have:
> 
> wrapperlog.always.transfer=true
> sitedir.keep=true
> execution.retries=0
> lazy.errors=false
> status.mode=provider
> use.provider.staging=false
> provider.staging.pin.swiftfiles=false
> 
> -> I will change the status.mode for "file" tomorrow, and I will let
> you know if it works! If not, then I'll open up my folders and let you
> in :-D
> 
> 
> 
> > As I recall you are using the SGE provider in non-coaster mode,
> > right?
> 
> That's it:
> 
> <config>
> <pool handle="sge">
> <execution provider="sge" url="none"/>
> <filesystem provider="local" url="none"/>
> ...
> 
> 
> PS On Swift's website, perhaps you could put the parameter sets that
> "work" or that are "specific" for each site/cluster...? I hope I'm the
> first one using swift on IBI ;-)
> 
> 
> As for my code in SVN, I have no problem with that, but my main
> program has to be compiled 32 bits (I compiled it on godzilla). I
> tried compiling it on a 64 bits machine but the program crashes when
> executing (most likely because of the FFT lib it uses). I would prefer
> transferring the exec instead of an in-place compilation.
> 
> 
> I'll keep you informed,
> Marc.

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory