[Swift-user] Chesnoknov workflow

Ian Foster foster at anl.gov
Mon Oct 26 17:24:08 CDT 2009


Hi Wei:

I can't recall the details, but there are nice tools for generating a  
Web page with plots.

Ian/


On Oct 26, 2009, at 5:18 PM, Wei Tan wrote:

> Hi Ian,
>
>   I am not sure which log plots you are talking about. But my  
> working directory is
> crush.mcs.anl.gov/tmp/wtan, I guess you can find all the logs you  
> want to see there?
>
> To be more specific:
> /workingdir: the directory from which I issue the command line  
> swift ...:there are some error logs since there are 23/1141 failure  
> jobs.
> /ecg3... directory generated when running swift workflow
> /swift-workflows the directory containing the workflow
> /app: the directory containing the executable and the input files
> /swift-0.9 the swift installation directory
>
>
>  Best regards,
>
> Wei
>
>
> Ian Foster wrote:
>> that's great. Do you have the Swift log plots?
>>
>> On Oct 26, 2009, at 4:56 PM, Wei Tan wrote:
>>
>>> Hi Mike and others,
>>>
>>>  A recapture of the story:
>>>  We have a chesnokov workflow which contains a forEach and the  
>>> input file array has 1171 files.
>>> Running it at a desktop and in a 32-core server have different  
>>> performance indexes, in terms of execution time
>>> See http://spreadsheets.google.com/ccc?key=0AriiWNEG__VUdEM0ampSaWRqcGROTW1TNE00X29GVHc&hl=en
>>>
>>> --------------------the data Mike wants to  
>>> see---------------------------------------------
>>> In the same 32-core machine (crush), using a local file system  
>>> instead of the share file system, will reduce the execution time,  
>>> from *2min20sec~2min50sec*, to *1min40sec~1min50sec*.
>>> --------------------end of the the data Mike wants to  
>>> see---------------------------------------------
>>>
>>> Best regards,
>>>
>>> Wei
>>>
>>> -- 
>>> Wei Tan, Ph.D.
>>> Computation Institute
>>> the University of Chicago|Argonne National Laboratory
>>> http://www.mcs.anl.gov/~wtan
>>>
>>> _______________________________________________
>>> Swift-user mailing list
>>> Swift-user at ci.uchicago.edu
>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>
>
> -- 
> Wei Tan, Ph.D.
> Computation Institute
> the University of Chicago|Argonne National Laboratory
> http://www.mcs.anl.gov/~wtan
>




More information about the Swift-user mailing list