[Swift-devel] simple executable staging

Michael Wilde wilde at mcs.anl.gov
Mon Apr 13 08:50:37 CDT 2009


I like the idea of executable staging. I feel that while it can start 
small and simple, it should eventually encompass these things in a clean 
elegant model:

- versioning of apps and connecting that back to provenance
- some way to specify app version from app() to tc.data
- some notion of "package" for namespace management
   (we should re-examine the old VDL concept of namespace::name:version 
as a general name specification for app and proc names.
- some way to manage the set of app() declarations that specify the 
"entry points" into an application
- management of app PATHs and install dirs
- retaining of installed apps (vs copy every time) - both should be possible
- some connection to / generalization of ADEM, including both binary and 
src/build installs

On 4/13/09 8:00 AM, Ben Clifford wrote:
> You can do it now without too much hassle but its not as beautiful as it 
> could be. I thought I had added an example to the userguide but turns out 
> I haven't.
> 
> To do it now, make the analysis script an input data file and launch it 
> using /bin/sh (so /bin/sh is what does into the tc.data file, not your 
> actual application).
> 
> Some (?skenny) does similar stuff with a script Rinvoke (that is mapped in 
> tc.data) that launches R on an input script.
> 
> But I'd like that to look more elegant.
> 
> On Mon, 13 Apr 2009, Glen Hocky wrote:
> 
>> This could be potentially very useful for data analysis esp. if the analysis
>> were performed with standard tools (e.g. perl, python, awk and gnuplot). If
>> you could make simple changes to your analysis script and then push the data
>> and analysis tools out for number crunching that would be great.
>>
>> Ben Clifford wrote:
>>> I've seen enough simple (conceptually, not in run size) uses of Swift (2)
>>> and heard enough from OSG Engage people about it being useful that I think
>>> Swift should have an option to stage an executable instead of finding it
>>> remotely.
>>>
>>> This seems more useful in some fields and less so in others (for example,
>>> where people are writing numeric code in C and so have few library
>>> dependencies).
>>>
>>> It can be done in Swift in a round-about way at the moment, but I think it
>>> should be better supported.
>>>
>>>   
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>
>>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel



More information about the Swift-devel mailing list