[Swift-user] Resuming jobs when script has changed

[Michael Wilde]

Hi Greg,

The Swift resume mechanism can't do this, as its driven by internal 
variables name within a Swift run, not by external file existence.

The best way to do what you describe below is to write an external input 
file mapper (e.g. a simple shell or py script) that returns only the 
files that still need to be produced or processed.  (This is the "ext" 
mapper: 
http://swift-lang.org/guides/release-0.94/userguide/userguide.html#_external_mapper 
)

You can also call a local app to determine what files need to be 
produced, then use readData() to read those file names into an array, 
and array_mapper to map an array of remaining work to do.

Would one of these approaches meet your needs?

- Mike


On 5/16/14, 12:35 PM, Bronevetsky, Greg wrote:
> I have Swift scripts that scan some portion of a design space and after I have scanned a sub-space of all the possibilities I modify the script to target a different, overlapping portion of the design space. However, it seems that when I do this Swift ignores the fact that I've already computed many of the tasks in the new run when I performed the prior run, and re-executes them redundantly. Is there a way for me to avoid such redundant executions? Can the -resume flag be used in this case?
>
> Greg Bronevetsky
> Lawrence Livermore National Lab
> (925) 424-5756
> bronevetsky at llnl.gov<mailto:bronevetsky at llnl.gov>
> http://greg.bronevetsky.com
>
>
>
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user

-- 
Michael Wilde
Mathematics and Computer Science          Computation Institute
Argonne National Laboratory               The University of Chicago

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140516/21928fe7/attachment.html>