[Swift-devel] hprof profiling of coaster services

Allan Espinosa aespinosa at cs.uchicago.edu
Fri Jun 19 14:52:14 CDT 2009


it has 200 jobs using the vanilla 066-many.swift workflow.

yes.  cpu usage indicates 100-200 % utilization in the duration of the
workflow.  I made a script(1) recording of the top session and
attached it in this email.

-Allan

2009/6/19 Mihael Hategan <hategan at mcs.anl.gov>:
> How many jobs did this run have?
>
> Did you observe a high cpu load on the head node while it was running?
>
> On Fri, 2009-06-19 at 13:42 -0500, Mihael Hategan wrote:
>> I'm looking for a complete trace (make sure you use cpu=times) in binary
>> format (format=b) that I can load and analyze in some profiler.
>>
>> The think below says that waiting takes time. Which is not interesting
>> because at the same time waiting doesn't eat CPU.
>>
>> On Fri, 2009-06-19 at 13:27 -0500, Allan Espinosa wrote:
>> > profile trace is in run02/java.hprof.txt
>> >
>> > summary:
>> > CPU SAMPLES BEGIN (total = 19493) Fri Jun 19 13:22:27 2009
>> > rank   self  accum   count trace method
>> >    1 48.99% 48.99%    9550 300225 java.net.PlainSocketImpl.socketAccept
>> >    2 25.08% 74.07%    4888 300411 java.lang.UNIXProcess.waitForProcessExit
>> >    3 25.07% 99.14%    4887 300487
>> > org.globus.cog.abstraction.coaster.service.job.manager.BlockTaskSubmitter.run
>> >    4  0.18% 99.32%      36 300465 java.net.SocketInputStream.socketRead0
>> >    5  0.09% 99.42%      18 300472 java.net.SocketInputStream.socketRead0
>> >    6  0.05% 99.46%       9 300051 java.lang.ClassLoader.defineClass1
>> >    7  0.02% 99.48%       4 300498 java.lang.Shutdown.halt0
>> >    8  0.02% 99.50%       3 300101 java.lang.ClassLoader.findBootstrapClass
>> >    9  0.02% 99.51%       3 300123 java.util.zip.ZipFile.getEntry
>> >   10  0.02% 99.53%       3 300492 java.io.FileInputStream.available
>> >   11  0.01% 99.54%       2 300433 COM.claymoresystems.cert.CertContext.<clinit>
>> >   12  0.01% 99.55%       2 300435 java.io.FileInputStream.open
>> >   13  0.01% 99.56%       2 300447 java.lang.Throwable.fillInStackTrace
>> >   14  0.01% 99.57%       2 300460 java.util.zip.Inflater.inflateBytes
>> >   15  0.01% 99.58%       2 300491 java.lang.Throwable.fillInStackTrace
>> > CPU SAMPLES END
>> >
>> > -Allan
-------------- next part --------------
A non-text attachment was scrubbed...
Name: top.gz
Type: application/x-gzip
Size: 8912 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20090619/7fb45393/attachment.bin>


More information about the Swift-devel mailing list