[Swift-user] Chesnoknov workflow
Wei Tan
wtan at mcs.anl.gov
Mon Oct 26 17:18:46 CDT 2009
Hi Ian,
I am not sure which log plots you are talking about. But my working
directory is
crush.mcs.anl.gov/tmp/wtan, I guess you can find all the logs you want
to see there?
To be more specific:
/workingdir: the directory from which I issue the command line swift
...:there are some error logs since there are 23/1141 failure jobs.
/ecg3... directory generated when running swift workflow
/swift-workflows the directory containing the workflow
/app: the directory containing the executable and the input files
/swift-0.9 the swift installation directory
Best regards,
Wei
Ian Foster wrote:
> that's great. Do you have the Swift log plots?
>
> On Oct 26, 2009, at 4:56 PM, Wei Tan wrote:
>
>> Hi Mike and others,
>>
>> A recapture of the story:
>> We have a chesnokov workflow which contains a forEach and the input
>> file array has 1171 files.
>> Running it at a desktop and in a 32-core server have different
>> performance indexes, in terms of execution time
>> See
>> http://spreadsheets.google.com/ccc?key=0AriiWNEG__VUdEM0ampSaWRqcGROTW1TNE00X29GVHc&hl=en
>>
>>
>> --------------------the data Mike wants to
>> see---------------------------------------------
>> In the same 32-core machine (crush), using a local file system
>> instead of the share file system, will reduce the execution time,
>> from *2min20sec~2min50sec*, to *1min40sec~1min50sec*.
>> --------------------end of the the data Mike wants to
>> see---------------------------------------------
>>
>> Best regards,
>>
>> Wei
>>
>> --
>> Wei Tan, Ph.D.
>> Computation Institute
>> the University of Chicago|Argonne National Laboratory
>> http://www.mcs.anl.gov/~wtan
>>
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>
--
Wei Tan, Ph.D.
Computation Institute
the University of Chicago|Argonne National Laboratory
http://www.mcs.anl.gov/~wtan
More information about the Swift-user
mailing list