[Swift-user] concurrent_mapper filenames

Allan Espinosa aespinosa at cs.uchicago.edu
Thu Nov 11 14:17:37 CST 2010


Ah.  that makes sense.

Thanks Ben!

-Allan

2010/11/11 Ben Clifford <benc at hawaga.org.uk>:
>> I was expecting something like blowup/blowup-XXXX.dat .  But it
>> doesn't matter since i'm only after the output.
>
> Roughly, the XXXXX number gets covnerted into a digit sequence in some
> base, and then each digit is used to make a new directory level with the
> last digit being the actual file name.
>
> The aim is to reduce the number of GPFS nodes accessing the same
> directory, which is/was a fairly serious scalability problem.
>



More information about the Swift-user mailing list