[Swift-user] concurrent_mapper filenames
Ben Clifford
benc at hawaga.org.uk
Thu Nov 11 14:05:32 CST 2010
> I was expecting something like blowup/blowup-XXXX.dat . But it
> doesn't matter since i'm only after the output.
Roughly, the XXXXX number gets covnerted into a digit sequence in some
base, and then each digit is used to make a new directory level with the
last digit being the actual file name.
The aim is to reduce the number of GPFS nodes accessing the same
directory, which is/was a fairly serious scalability problem.
--
More information about the Swift-user
mailing list