[Fwd: Re: [Swift-devel] Re: swift-falkon problem... plots to explain plateaus...]

Ben Clifford benc at hawaga.org.uk
Tue Apr 1 23:11:23 CDT 2008


On Tue, 1 Apr 2008, Mihael Hategan wrote:

> Having optimized wrappers for different architectures is a perfectly
> valid option.

it might also be possible to replace the entire execute2 layer of 
stagein-execute-stageout if falkon wants to do its own worker-node data 
placement - Swift would be the same down to calling execute2 but the 
execute2-replacement would be falkon specific rather than using the 
present model which assumes a shared filesystem for stageins.

I think that might fit in better with what Falkon is trying to do, letting 
it know which files are required by which job, rather than assuming a 
cluster-wide shared filesystem to fetch data from.

(The same might apply for using condor with no shared filesystem, which 
isthe situation in many campus workstation labs that I've seen - an 
execute2 layer that submits a bundled up stagein/stageout/execute as a 
single condor submission - I have been mulling over that for a few months 
and maybe will get someone to play with that in google summer of code)

-- 




More information about the Swift-devel mailing list