[Swift-user] Chesnoknov workflow
Michael Wilde
wilde at mcs.anl.gov
Mon Oct 26 17:28:03 CDT 2009
Wei, its the swift-plot-log command, in the Swift user guide at:
http://www.ci.uchicago.edu/swift/guides/userguide.php#id2711073
- Mike
On 10/26/09 5:24 PM, Ian Foster wrote:
> Hi Wei:
>
> I can't recall the details, but there are nice tools for generating a
> Web page with plots.
>
> Ian/
>
>
> On Oct 26, 2009, at 5:18 PM, Wei Tan wrote:
>
>> Hi Ian,
>>
>> I am not sure which log plots you are talking about. But my
>> working directory is
>> crush.mcs.anl.gov/tmp/wtan, I guess you can find all the logs you
>> want to see there?
>>
>> To be more specific:
>> /workingdir: the directory from which I issue the command line
>> swift ...:there are some error logs since there are 23/1141 failure
>> jobs.
>> /ecg3... directory generated when running swift workflow
>> /swift-workflows the directory containing the workflow
>> /app: the directory containing the executable and the input files
>> /swift-0.9 the swift installation directory
>>
>>
>> Best regards,
>>
>> Wei
>>
>>
>> Ian Foster wrote:
>>> that's great. Do you have the Swift log plots?
>>>
>>> On Oct 26, 2009, at 4:56 PM, Wei Tan wrote:
>>>
>>>> Hi Mike and others,
>>>>
>>>> A recapture of the story:
>>>> We have a chesnokov workflow which contains a forEach and the
>>>> input file array has 1171 files.
>>>> Running it at a desktop and in a 32-core server have different
>>>> performance indexes, in terms of execution time
>>>> See http://spreadsheets.google.com/ccc?key=0AriiWNEG__VUdEM0ampSaWRqcGROTW1TNE00X29GVHc&hl=en
>>>>
>>>> --------------------the data Mike wants to
>>>> see---------------------------------------------
>>>> In the same 32-core machine (crush), using a local file system
>>>> instead of the share file system, will reduce the execution time,
>>>> from *2min20sec~2min50sec*, to *1min40sec~1min50sec*.
>>>> --------------------end of the the data Mike wants to
>>>> see---------------------------------------------
>>>>
>>>> Best regards,
>>>>
>>>> Wei
>>>>
>>>> --
>>>> Wei Tan, Ph.D.
>>>> Computation Institute
>>>> the University of Chicago|Argonne National Laboratory
>>>> http://www.mcs.anl.gov/~wtan
>>>>
>>>> _______________________________________________
>>>> Swift-user mailing list
>>>> Swift-user at ci.uchicago.edu
>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>> --
>> Wei Tan, Ph.D.
>> Computation Institute
>> the University of Chicago|Argonne National Laboratory
>> http://www.mcs.anl.gov/~wtan
>>
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
More information about the Swift-user
mailing list