[Swift-user] concurrent_mapper filenames
Allan Espinosa
aespinosa at cs.uchicago.edu
Thu Nov 11 14:17:37 CST 2010
Ah. that makes sense.
Thanks Ben!
-Allan
2010/11/11 Ben Clifford <benc at hawaga.org.uk>:
>> I was expecting something like blowup/blowup-XXXX.dat . But it
>> doesn't matter since i'm only after the output.
>
> Roughly, the XXXXX number gets covnerted into a digit sequence in some
> base, and then each digit is used to make a new directory level with the
> last digit being the actual file name.
>
> The aim is to reduce the number of GPFS nodes accessing the same
> directory, which is/was a fairly serious scalability problem.
>
More information about the Swift-user
mailing list