[Swift-devel] Clustering / wrapper.sh logging

Mihael Hategan hategan at mcs.anl.gov
Mon Oct 29 12:34:31 CDT 2007


I'd also combine log and logstate, perhaps using a similar logging
format as the swift logs.

On Mon, 2007-10-29 at 17:22 +0000, Ben Clifford wrote:
> actually, there's a bug in my analysis code. please wait. it looks like 
> pretty much everything is hitting 'END' state.
> 
> On Mon, 29 Oct 2007, Ben Clifford wrote:
> 
> > 
> > I just grabbed all the info files that are there at the moment and munged 
> > them: (note these are not final results - the workflow continues to run)
> > 
> > $ cat info.lastsummary 
> >  372 END
> >    1 EXECUTE
> >    1 RM_JOBDIR
> > 1017 TOUCH_SUCCESS
> > 
> > 372 jobs hit the very end of the wrapper script. 1017 of them are a line 
> > before that, at TOUCH_SUCCESS state:
> > 
> > From wrapper.sh:
> > 
> > > logstate "TOUCH_SUCCESS"
> > > touch status/${ID}-success
> > > logstate "END"
> > 
> > So it looks like I should pay attention first to dealing with status 
> > directory scalability.
> > 
> > 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
> 




More information about the Swift-devel mailing list