[Swift-devel] placement of large amounts of client side kickstart records

Michael Wilde wilde at mcs.anl.gov
Fri Feb 15 16:53:48 CST 2008


This sounds very good to me. I had to hack around this in the work I did 
on angle in November.

On 2/15/08 4:41 PM, Ben Clifford wrote:
> At present, kickstart records go to $PWD.
> 
> That's lame - 10000 jobs give 10000 files that are i) in $PWD and ii) all 
> in the same directory.
> 
> I'd like to do something about that.
> 
> i) is most important - perhaps put them first in a subdirectory named by 
> workflow run ID, eg fmri-20080215-1828-2d433ro1.d/
> 
> ii) matters a bit less; however, kickstart records could be staged back 
> into a hierarchy split up by job ID, in the same way that they are split 
> up on the execute side.
> 



More information about the Swift-devel mailing list