[Swift-user] Workflow handling a large parallelism ?

[Tiberiu Stef-Praun]

This worked, thank you !
The simple_mapper is a bit unintuitive, I would call it
sequential_file_mapper or something like that, and remove the
limitation that file names get only 4 digits generated automatically
(and zero-padded).

Tibi

On Tue, May 6, 2008 at 9:48 AM, Ben Clifford <benc at hawaga.org.uk> wrote:
>
>  > (file simMerged)merge_sim(file simFiles[]){
>  >     app{ cat @filenames(simFiles) ; }
>  > }
>
>  send stdout into simMerged probably.
>
>
>  > (file simFiles[]) batch_sim (){
>  >
>  >     int simRange = [1:1000];
>  >     forach i in simRange {
>  >         simFiles[i]=run_sim(i);
>  >     }
>  > }
>  >
>  > //I am concerned about this, I would like to be able to generate the
>  > filenames in swift,
>  > //not to be forced to list all the names
>  >
>  > string filenames[] = [ "sim_000",'sim_001", ...  "sim_999" ];
>  > file simOutputs[] <array_mapper; files=filenames>;
>
>  Use simple_mapper perhaps like this:
>
>  file simOutputs[] <simple_mapper;prefix="sim_">;
>
>  I think you'll get 4 digit numbers that way, but perhaps you can cope with
>  that.
>
>  --
>
>



-- 
Tiberiu (Tibi) Stef-Praun, PhD
Research Staff, Computation Institute
5640 S. Ellis Ave, #405
University of Chicago
http://www-unix.mcs.anl.gov/~tiberius/