[Swift-devel] Re: Provenance use case

[Michael Wilde]

cool, thanks.

so instead of echo monkey foo, this profile entry should go on the 
tc.data entry, and do something like:

getAppVersion.sh appName appPath

which can either specify the version info directly in the tc.data entry 
(for one style of usage) or dynamically hunt it down in the app's 
directory, symlink, etc.

Sounds like a reasonable and flexible experiment to start out with.

It begs for a bit of automation in the generation of tc.data, which we 
can experiment with at the same time.

Next we need to work on collection and summarization of the info from 
wrapper.sh.  Are you doing any of that in your current provenance work?



On 3/27/09 4:16 PM, Ben Clifford wrote:
> On Thu, 26 Mar 2009, Ben Clifford wrote:
> 
>> Another way is to gather the information during each run, by allowing 
>> users to specify something like "run this command at the start of each 
>> job, and store its text output somewhere".
> 
> Swift r2748 adds a SWIFT_EXTRA_INFO environment setting, that you can use 
> like this:
> 
>   <pool handle="localhost">
>     <gridftp  url="local://localhost" />
>     <execution provider="local" />
>     <workdirectory >/var/tmp</workdirectory>
>     <profile namespace="karajan" key="jobThrottle">0</profile>
> <profile namespace="env" key="SWIFT_EXTRA_INFO">echo monkey foo</profile>
>   </pool>
> 
> to get a line like this in your wrapper log:
> 
> EXTRAINFO=monkey foo
> 
> See if you can get the version information you want passed back through 
> that mechanism.
>