[Swift-user] Chesnoknov workflow

Michael Wilde wilde at mcs.anl.gov
Mon Oct 26 17:28:03 CDT 2009


Wei, its the swift-plot-log command, in the Swift user guide at:

http://www.ci.uchicago.edu/swift/guides/userguide.php#id2711073

- Mike

On 10/26/09 5:24 PM, Ian Foster wrote:
> Hi Wei:
> 
> I can't recall the details, but there are nice tools for generating a  
> Web page with plots.
> 
> Ian/
> 
> 
> On Oct 26, 2009, at 5:18 PM, Wei Tan wrote:
> 
>> Hi Ian,
>>
>>   I am not sure which log plots you are talking about. But my  
>> working directory is
>> crush.mcs.anl.gov/tmp/wtan, I guess you can find all the logs you  
>> want to see there?
>>
>> To be more specific:
>> /workingdir: the directory from which I issue the command line  
>> swift ...:there are some error logs since there are 23/1141 failure  
>> jobs.
>> /ecg3... directory generated when running swift workflow
>> /swift-workflows the directory containing the workflow
>> /app: the directory containing the executable and the input files
>> /swift-0.9 the swift installation directory
>>
>>
>>  Best regards,
>>
>> Wei
>>
>>
>> Ian Foster wrote:
>>> that's great. Do you have the Swift log plots?
>>>
>>> On Oct 26, 2009, at 4:56 PM, Wei Tan wrote:
>>>
>>>> Hi Mike and others,
>>>>
>>>>  A recapture of the story:
>>>>  We have a chesnokov workflow which contains a forEach and the  
>>>> input file array has 1171 files.
>>>> Running it at a desktop and in a 32-core server have different  
>>>> performance indexes, in terms of execution time
>>>> See http://spreadsheets.google.com/ccc?key=0AriiWNEG__VUdEM0ampSaWRqcGROTW1TNE00X29GVHc&hl=en
>>>>
>>>> --------------------the data Mike wants to  
>>>> see---------------------------------------------
>>>> In the same 32-core machine (crush), using a local file system  
>>>> instead of the share file system, will reduce the execution time,  
>>>> from *2min20sec~2min50sec*, to *1min40sec~1min50sec*.
>>>> --------------------end of the the data Mike wants to  
>>>> see---------------------------------------------
>>>>
>>>> Best regards,
>>>>
>>>> Wei
>>>>
>>>> -- 
>>>> Wei Tan, Ph.D.
>>>> Computation Institute
>>>> the University of Chicago|Argonne National Laboratory
>>>> http://www.mcs.anl.gov/~wtan
>>>>
>>>> _______________________________________________
>>>> Swift-user mailing list
>>>> Swift-user at ci.uchicago.edu
>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>> -- 
>> Wei Tan, Ph.D.
>> Computation Institute
>> the University of Chicago|Argonne National Laboratory
>> http://www.mcs.anl.gov/~wtan
>>
> 
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user



More information about the Swift-user mailing list