[Swift-user] Chesnoknov workflow

[Michael Wilde]

More documentation on the log processing tools is at:

   http://www.ci.uchicago.edu/swift/guides/log-processing.php

- Mike

On 10/26/09 5:28 PM, Michael Wilde wrote:
> Wei, its the swift-plot-log command, in the Swift user guide at:
> 
> http://www.ci.uchicago.edu/swift/guides/userguide.php#id2711073
> 
> - Mike
> 
> On 10/26/09 5:24 PM, Ian Foster wrote:
>> Hi Wei:
>>
>> I can't recall the details, but there are nice tools for generating a  
>> Web page with plots.
>>
>> Ian/
>>
>>
>> On Oct 26, 2009, at 5:18 PM, Wei Tan wrote:
>>
>>> Hi Ian,
>>>
>>>   I am not sure which log plots you are talking about. But my  
>>> working directory is
>>> crush.mcs.anl.gov/tmp/wtan, I guess you can find all the logs you  
>>> want to see there?
>>>
>>> To be more specific:
>>> /workingdir: the directory from which I issue the command line  
>>> swift ...:there are some error logs since there are 23/1141 failure  
>>> jobs.
>>> /ecg3... directory generated when running swift workflow
>>> /swift-workflows the directory containing the workflow
>>> /app: the directory containing the executable and the input files
>>> /swift-0.9 the swift installation directory
>>>
>>>
>>>  Best regards,
>>>
>>> Wei
>>>
>>>
>>> Ian Foster wrote:
>>>> that's great. Do you have the Swift log plots?
>>>>
>>>> On Oct 26, 2009, at 4:56 PM, Wei Tan wrote:
>>>>
>>>>> Hi Mike and others,
>>>>>
>>>>>  A recapture of the story:
>>>>>  We have a chesnokov workflow which contains a forEach and the  
>>>>> input file array has 1171 files.
>>>>> Running it at a desktop and in a 32-core server have different  
>>>>> performance indexes, in terms of execution time
>>>>> See http://spreadsheets.google.com/ccc?key=0AriiWNEG__VUdEM0ampSaWRqcGROTW1TNE00X29GVHc&hl=en
>>>>>
>>>>> --------------------the data Mike wants to  
>>>>> see---------------------------------------------
>>>>> In the same 32-core machine (crush), using a local file system  
>>>>> instead of the share file system, will reduce the execution time,  
>>>>> from *2min20sec~2min50sec*, to *1min40sec~1min50sec*.
>>>>> --------------------end of the the data Mike wants to  
>>>>> see---------------------------------------------
>>>>>
>>>>> Best regards,
>>>>>
>>>>> Wei
>>>>>
>>>>> -- 
>>>>> Wei Tan, Ph.D.
>>>>> Computation Institute
>>>>> the University of Chicago|Argonne National Laboratory
>>>>> http://www.mcs.anl.gov/~wtan
>>>>>
>>>>> _______________________________________________
>>>>> Swift-user mailing list
>>>>> Swift-user at ci.uchicago.edu
>>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>> -- 
>>> Wei Tan, Ph.D.
>>> Computation Institute
>>> the University of Chicago|Argonne National Laboratory
>>> http://www.mcs.anl.gov/~wtan
>>>
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>