[Swift-devel] placement of large amounts of client side kickstart records
Michael Wilde
wilde at mcs.anl.gov
Fri Feb 15 16:53:48 CST 2008
This sounds very good to me. I had to hack around this in the work I did
on angle in November.
On 2/15/08 4:41 PM, Ben Clifford wrote:
> At present, kickstart records go to $PWD.
>
> That's lame - 10000 jobs give 10000 files that are i) in $PWD and ii) all
> in the same directory.
>
> I'd like to do something about that.
>
> i) is most important - perhaps put them first in a subdirectory named by
> workflow run ID, eg fmri-20080215-1828-2d433ro1.d/
>
> ii) matters a bit less; however, kickstart records could be staged back
> into a hierarchy split up by job ID, in the same way that they are split
> up on the execute side.
>
More information about the Swift-devel
mailing list