[Swift-devel] hprof profiling of coaster services

[Allan Espinosa]

here's a script recording without profiling of top:

http://www.ci.uchicago.edu/~aespinosa/top_vanilla.gz

it still consumes some cpu. but does not spike to 200% utilization.

Thanks
-Allan

2009/6/19 Mihael Hategan <hategan at mcs.anl.gov>:
> When profiling it's bound to consume a lot of cpu. Can you verify the
> same without the profiler enabled?
>
> On Fri, 2009-06-19 at 14:52 -0500, Allan Espinosa wrote:
>> it has 200 jobs using the vanilla 066-many.swift workflow.
>>
>> yes.  cpu usage indicates 100-200 % utilization in the duration of the
>> workflow.  I made a script(1) recording of the top session and
>> attached it in this email.
>>
>> -Allan
>>
>> 2009/6/19 Mihael Hategan <hategan at mcs.anl.gov>:
>> > How many jobs did this run have?
>> >
>> > Did you observe a high cpu load on the head node while it was running?
>> >
>> > On Fri, 2009-06-19 at 13:42 -0500, Mihael Hategan wrote:
>> >> I'm looking for a complete trace (make sure you use cpu=times) in binary
>> >> format (format=b) that I can load and analyze in some profiler.
>> >>
>> >> The think below says that waiting takes time. Which is not interesting
>> >> because at the same time waiting doesn't eat CPU.
>> >>
>> >> On Fri, 2009-06-19 at 13:27 -0500, Allan Espinosa wrote:
>> >> > profile trace is in run02/java.hprof.txt
>> >> >
>> >> > summary:
>> >> > CPU SAMPLES BEGIN (total = 19493) Fri Jun 19 13:22:27 2009
>> >> > rank   self  accum   count trace method
>> >> >    1 48.99% 48.99%    9550 300225 java.net.PlainSocketImpl.socketAccept
>> >> >    2 25.08% 74.07%    4888 300411 java.lang.UNIXProcess.waitForProcessExit
>> >> >    3 25.07% 99.14%    4887 300487
>> >> > org.globus.cog.abstraction.coaster.service.job.manager.BlockTaskSubmitter.run
>> >> >    4  0.18% 99.32%      36 300465 java.net.SocketInputStream.socketRead0
>> >> >    5  0.09% 99.42%      18 300472 java.net.SocketInputStream.socketRead0
>> >> >    6  0.05% 99.46%       9 300051 java.lang.ClassLoader.defineClass1
>> >> >    7  0.02% 99.48%       4 300498 java.lang.Shutdown.halt0
>> >> >    8  0.02% 99.50%       3 300101 java.lang.ClassLoader.findBootstrapClass
>> >> >    9  0.02% 99.51%       3 300123 java.util.zip.ZipFile.getEntry
>> >> >   10  0.02% 99.53%       3 300492 java.io.FileInputStream.available
>> >> >   11  0.01% 99.54%       2 300433 COM.claymoresystems.cert.CertContext.<clinit>
>> >> >   12  0.01% 99.55%       2 300435 java.io.FileInputStream.open
>> >> >   13  0.01% 99.56%       2 300447 java.lang.Throwable.fillInStackTrace
>> >> >   14  0.01% 99.57%       2 300460 java.util.zip.Inflater.inflateBytes
>> >> >   15  0.01% 99.58%       2 300491 java.lang.Throwable.fillInStackTrace
>> >> > CPU SAMPLES END
>> >> >
>> >> > -Allan