[Swift-devel] Clustering and Temp Dirs with Swift

[Mihael Hategan]

On Sun, 2007-10-28 at 17:28 -0500, Mihael Hategan wrote:
> On Sun, 2007-10-28 at 22:21 +0000, Ben Clifford wrote:
> > On Sun, 28 Oct 2007, Mihael Hategan wrote:
> > 
> > > > Why are these jobnames differing in the leftmost character of the uuid 
> > > > instead of the rightmost? I never paid attention to this till I started 
> > > > thinking about the dir hashing Ben suggests. I think that most hashes, 
> > > > unless the file names are random, need to be aware of which end of the 
> > > > name is varying fastest.
> > > 
> > > Hmm. Yes. Never occurred to me. It can be changed.
> > 
> > Though leftmost scoring is (very slightly) easier for prefix-hashing.
> 
> Hmm. Yes. Make up your minds!

Actually this is better. We want to avoid locality. In other words
consecutive jobs should be in different directories. This reduces
contention because the first job is more likely to be done by the time
the hundredth job is started than by the time the second one is.

> 
> > 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>