[Swift-user] Re: resume log on output files in a struct

[Allan Espinosa]

In response to this, I think these are the corresponding log entries
for the behavior:

2010-10-25 15:29:11,047-0500 INFO  AbstractDataNode Found data
org.griphyn.vdl.mapping.RootDataNode identifier tag:ben
c at ci.uchicago.edu,2008:swift:dataset:20101025-1529-eyis7k05:720000000064
type Sgt with no value at dataset=sgt_var (not closed)..y
2010-10-25 15:29:11,047-0500 INFO  AbstractDataNode Found data
org.griphyn.vdl.mapping.RootDataNode identifier
tag:benc at ci.uchicago.edu,2008:swift:dataset:20101025-1529-eyis7k05:720000000064
type Sgt with no value at dataset=sgt_var (not closed)..x

But the workflow does stagein and stageout the mapped files properly.


2010/10/21 Allan Espinosa <aespinosa at cs.uchicago.edu>:
> I get these entries in my resume log:
>
> 11-2940:sub..x!null
> 11-1812:sub..y!null
> 11-1812:sub..x!null
> 11-5367:sub..y!null
> 11-5367:sub..x!null
> 11-3291:sub..x!null
> 11-5378:sub..y!null
> 11-5378:sub..x!null
> 11-3292:sub..y!null
> 11-3292:sub..x!null
> 11-3298:sub..y!null
> 11-3298:sub..x!null
> 11-6:sub..y!null
> 11-6:sub..x!null
> 11-5371:sub..y!null
> 11-5371:sub..x!null
> 11-2941:sub..y!null
> 11-2941:sub..x!null
> 11-539:sub..y!null
> 11-539:sub..x!null
>
> Here's that object in the workflow:
>  Sgt sub <ext; exec="getsub.rb", l=loc_sub, n=site.name, s=rup.source,
>      r=rup.index>;
>  string var_str[] = get_variations( site, rup,
>      "/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations" );
>  Variation vars[] <array_mapper; files=var_str>;
>
>  sub = extract(sgt_var,  site, vars[rup.size-1]);
>
> here's the definition in the datatype:
> type SgtDim;
> type Variation;
>
> type Sgt {
>  SgtDim x;
>  SgtDim y;
> }
>
> type Rupture {
>  int source;
>  int index;
>  int size;
> }
>
>
> app (Sgt _ext) extract(Sgt _sgt, Station _stat, Variation _var) {
>  extract @strcat("stat=", _stat.name) "extract_sgt=1"
>      @strcat("slon=", _stat.lon) @strcat("slat=", _stat.lat)
>
>      @strcat("rupmodfile=", @filename(_var))
>      @strcat("sgt_xfile=", @filename(_sgt.x))
>      @strcat("sgt_yfile=", @filename(_sgt.y))
>      @strcat("extract_sgt_xfile=", @filename(_ext.x))
>      @strcat("extract_sgt_yfile=", @filename(_ext.y));
> }
>
>
> So just to confirm, the resume log is made from unique jobids of each
> task that persists across swift session and does not look for the
> output files / filenames itelf derived in the workflow?
>
> Thanks,
> -Allan
>
>
> --
> Allan M. Espinosa <http://amespinosa.wordpress.com>
> PhD student, Computer Science
> University of Chicago <http://people.cs.uchicago.edu/~aespinosa>
>



-- 
Allan M. Espinosa <http://amespinosa.wordpress.com>
PhD student, Computer Science
University of Chicago <http://people.cs.uchicago.edu/~aespinosa>