[Swift-user] concurrent_mapper filenames

Ben Clifford benc at hawaga.org.uk
Thu Nov 11 14:05:32 CST 2010


> I was expecting something like blowup/blowup-XXXX.dat .  But it
> doesn't matter since i'm only after the output.

Roughly, the XXXXX number gets covnerted into a digit sequence in some 
base, and then each digit is used to make a new directory level with the 
last digit being the actual file name.

The aim is to reduce the number of GPFS nodes accessing the same 
directory, which is/was a fairly serious scalability problem.

-- 




More information about the Swift-user mailing list