[Swift-devel] IO for reading restart log?

Mihael Hategan hategan at mcs.anl.gov
Fri Dec 14 18:49:28 CST 2012


It's using a buffered reader which is a pretty fast universal solution
in java. Its default buffer size is 8192, so I don't think that's the
problem.

It writes to the same restart log, but I'm not 100% sure on that one.

Mihael

On Fri, 2012-12-14 at 14:05 -0600, Michael Wilde wrote:
> Mihael,
> 
> What read() sizes are used to read in the restart log?
> 
> I'm watching a restart on beagle now of a restart log in which about 200K apps had completed.
> 
> Its going rather slow, and top says that the swift jvm is only using about 10% of one core.  Im wondering if the read() length is very low, which is possibly slowing down the restart when the filesystem on which the .rlog file resides is very congested?
> 
> If so, would a bigger read() buffer size help?
> 
> We can try looking at whats happening with strace, but the restart process looks to me to be IO bound.
> 
> Does the restart process involve also *writing* to the same *or a new) restart log?
> 
> Thanks,
> 
> - Mike
> 
> 





More information about the Swift-devel mailing list