[Swift-devel] Clustering and Temp Dirs with Swift

[Mihael Hategan]

> > Question: do people feel that a move to local disk could be done 
> > *entirely* in wrapper.sh, or is it known that other parts of swift would 
> > have to change as well?
> 
> I think that there won't be a trivial solution to this problem. At 
> present, the model is quite strongly tied to a site-shared filesystem (as 
> VDS was before).

Quickly before I leave the house:
Perhaps we could try copying to local FS instead of linking from shared
dir and hence running the jobs on the local FS.

Also minimize concurrent access to files (i.e. right now all seq.sh
instances write to one global log file on the sfs - silly).

> 
> In the past, we've discussed informally different ways of moving data 
> round between submit-side storage locations, site-wide storage locations 
> and worker-local storage. I think this is another use case for that; but I 
> think the general conclusion that that's a non-trivial thing to do is 
> still valid.
>