[Swift-user] Performance of Swift

[Mihael Hategan]

The swift engine itself should be about equally fast (or equally slow,
depending on perspective) whether you have N jobs that are sequential or
N jobs that are parallel.

However, there may be scheduling constraints (such as "don't run more
than 2 parallel jobs on this site right now") that may interfere with
that.

You can measure a large portion of the Swift overhead by using something
like -dryrun on the command line. Some of it is constant overhead (i.e.
the jvm + engine startup), and some of it is nearly linear in the number
of jobs (whether parallel or sequential).

In terms of comparisons with other systems, I am not aware of any such
recent comparisons. Others may know different.

Mihael

On Mon, 2008-06-02 at 19:20 -0400, J A wrote:
> Hi All:
>  
> Based on my reading, the performance from execution a swift workflow
> depends on the parallelism that a workflow has.
> 
>  
> 
> If I have a workflow that contains several processors where each
> processor (procedure) depends on the previous one (output of a
> processor "A" is the input for processors "B" and so on.)
> 
>  
> 
> How the performance of using swift in this case compare to other
> systems that execute workflows where there isn't any parallelism in
> the workflow?
> 
>  
> 
> -- 
> Thanks,
> 
> Jamal 
> 
> 
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user