[Swift-user] Chesnoknov workflow

[Wei Tan]

I got this result when running swift-plot-log

Log file path is /tmp/wtan/workingdir/ecg3-20091026-1332-fkizh09c.log
Log is in directory /tmp/wtan/workingdir
Log basename is ecg3-20091026-1332-fkizh09c
Now in directory /tmp/swift-plot-log-btGjiRNxbiel5334
make: ../swift-0.9/bin/../libexec/log-processing//makefile: No such file 
or directory
make: *** No rule to make target 
`../swift-0.9/bin/../libexec/log-processing//makefile'.  Stop.

 From the webpage, it seems that I need to install gnuplot 4.0, gnu m4, 
gnu textutils, perl first?
I am working on it and will post the result here.

Thanks,

Wei

Michael Wilde wrote:
> More documentation on the log processing tools is at:
>
>   http://www.ci.uchicago.edu/swift/guides/log-processing.php
>
> - Mike
>
> On 10/26/09 5:28 PM, Michael Wilde wrote:
>> Wei, its the swift-plot-log command, in the Swift user guide at:
>>
>> http://www.ci.uchicago.edu/swift/guides/userguide.php#id2711073
>>
>> - Mike
>>
>> On 10/26/09 5:24 PM, Ian Foster wrote:
>>> Hi Wei:
>>>
>>> I can't recall the details, but there are nice tools for generating 
>>> a  Web page with plots.
>>>
>>> Ian/
>>>
>>>
>>> On Oct 26, 2009, at 5:18 PM, Wei Tan wrote:
>>>
>>>> Hi Ian,
>>>>
>>>>   I am not sure which log plots you are talking about. But my  
>>>> working directory is
>>>> crush.mcs.anl.gov/tmp/wtan, I guess you can find all the logs you  
>>>> want to see there?
>>>>
>>>> To be more specific:
>>>> /workingdir: the directory from which I issue the command line  
>>>> swift ...:there are some error logs since there are 23/1141 
>>>> failure  jobs.
>>>> /ecg3... directory generated when running swift workflow
>>>> /swift-workflows the directory containing the workflow
>>>> /app: the directory containing the executable and the input files
>>>> /swift-0.9 the swift installation directory
>>>>
>>>>
>>>>  Best regards,
>>>>
>>>> Wei
>>>>
>>>>
>>>> Ian Foster wrote:
>>>>> that's great. Do you have the Swift log plots?
>>>>>
>>>>> On Oct 26, 2009, at 4:56 PM, Wei Tan wrote:
>>>>>
>>>>>> Hi Mike and others,
>>>>>>
>>>>>>  A recapture of the story:
>>>>>>  We have a chesnokov workflow which contains a forEach and the  
>>>>>> input file array has 1171 files.
>>>>>> Running it at a desktop and in a 32-core server have different  
>>>>>> performance indexes, in terms of execution time
>>>>>> See 
>>>>>> http://spreadsheets.google.com/ccc?key=0AriiWNEG__VUdEM0ampSaWRqcGROTW1TNE00X29GVHc&hl=en 
>>>>>>
>>>>>>
>>>>>> --------------------the data Mike wants to  
>>>>>> see---------------------------------------------
>>>>>> In the same 32-core machine (crush), using a local file system  
>>>>>> instead of the share file system, will reduce the execution 
>>>>>> time,  from *2min20sec~2min50sec*, to *1min40sec~1min50sec*.
>>>>>> --------------------end of the the data Mike wants to  
>>>>>> see---------------------------------------------
>>>>>>
>>>>>> Best regards,
>>>>>>
>>>>>> Wei
>>>>>>
>>>>>> -- 
>>>>>> Wei Tan, Ph.D.
>>>>>> Computation Institute
>>>>>> the University of Chicago|Argonne National Laboratory
>>>>>> http://www.mcs.anl.gov/~wtan
>>>>>>
>>>>>> _______________________________________________
>>>>>> Swift-user mailing list
>>>>>> Swift-user at ci.uchicago.edu
>>>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>>> -- 
>>>> Wei Tan, Ph.D.
>>>> Computation Institute
>>>> the University of Chicago|Argonne National Laboratory
>>>> http://www.mcs.anl.gov/~wtan
>>>>
>>> _______________________________________________
>>> Swift-user mailing list
>>> Swift-user at ci.uchicago.edu
>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>

-- 
Wei Tan, Ph.D.
Computation Institute
the University of Chicago|Argonne National Laboratory
http://www.mcs.anl.gov/~wtan