[Swift-devel] Clustering / wrapper.sh logging
Mihael Hategan
hategan at mcs.anl.gov
Mon Oct 29 12:34:31 CDT 2007
I'd also combine log and logstate, perhaps using a similar logging
format as the swift logs.
On Mon, 2007-10-29 at 17:22 +0000, Ben Clifford wrote:
> actually, there's a bug in my analysis code. please wait. it looks like
> pretty much everything is hitting 'END' state.
>
> On Mon, 29 Oct 2007, Ben Clifford wrote:
>
> >
> > I just grabbed all the info files that are there at the moment and munged
> > them: (note these are not final results - the workflow continues to run)
> >
> > $ cat info.lastsummary
> > 372 END
> > 1 EXECUTE
> > 1 RM_JOBDIR
> > 1017 TOUCH_SUCCESS
> >
> > 372 jobs hit the very end of the wrapper script. 1017 of them are a line
> > before that, at TOUCH_SUCCESS state:
> >
> > From wrapper.sh:
> >
> > > logstate "TOUCH_SUCCESS"
> > > touch status/${ID}-success
> > > logstate "END"
> >
> > So it looks like I should pay attention first to dealing with status
> > directory scalability.
> >
> >
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>
More information about the Swift-devel
mailing list