[Swift-user] Performance of Swift

[Michael Wilde]

We dont have any recent data that I know of comparing Swift performance 
to other workflow systems.

When executing a serial workflow, performance will depend a lot on what 
job and data provider you are using.

What kind of application are you considering, and what kind of latency 
between jobs are you looking for?

What execution environment are you interested in? (GRAM, PBS, local, or 
something different?)

Whats the profile of your jobs in terms of input data size, job 
duration, output data size?

All of these will affect the performance of a serial job pipeline of the 
kind you describe.

If your procedures behave in a streaming manner (in that they start 
writing output while still reading input) then perhaps you want to run 
them as a UNIX pipeline instead of separate procedures under Swift.

- Mike


On 6/2/08 6:20 PM, J A wrote:
> Hi All:
>  
> 
> Based on my reading, the performance from execution a swift workflow 
> depends on the parallelism that a workflow has.
> 
>  
> 
> If I have a workflow that contains several processors where each 
> processor (procedure) depends on the previous one (output of a processor 
> "A" is the input for processors "B" and so on.)
> 
>  
> 
> How the performance of using swift in this case compare to other systems 
> that execute workflows where there isn't any parallelism in the workflow?
> 
>  
> 
> -- 
> Thanks,
> 
> Jamal
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
-- 
Michael Wilde
Computation Institute
University of Chicago and Argonne National Laboratory