[Swift-devel] hprof profiling of coaster services

Mihael Hategan hategan at mcs.anl.gov
Fri Jun 19 15:23:39 CDT 2009


When profiling it's bound to consume a lot of cpu. Can you verify the
same without the profiler enabled?

On Fri, 2009-06-19 at 14:52 -0500, Allan Espinosa wrote:
> it has 200 jobs using the vanilla 066-many.swift workflow.
> 
> yes.  cpu usage indicates 100-200 % utilization in the duration of the
> workflow.  I made a script(1) recording of the top session and
> attached it in this email.
> 
> -Allan
> 
> 2009/6/19 Mihael Hategan <hategan at mcs.anl.gov>:
> > How many jobs did this run have?
> >
> > Did you observe a high cpu load on the head node while it was running?
> >
> > On Fri, 2009-06-19 at 13:42 -0500, Mihael Hategan wrote:
> >> I'm looking for a complete trace (make sure you use cpu=times) in binary
> >> format (format=b) that I can load and analyze in some profiler.
> >>
> >> The think below says that waiting takes time. Which is not interesting
> >> because at the same time waiting doesn't eat CPU.
> >>
> >> On Fri, 2009-06-19 at 13:27 -0500, Allan Espinosa wrote:
> >> > profile trace is in run02/java.hprof.txt
> >> >
> >> > summary:
> >> > CPU SAMPLES BEGIN (total = 19493) Fri Jun 19 13:22:27 2009
> >> > rank   self  accum   count trace method
> >> >    1 48.99% 48.99%    9550 300225 java.net.PlainSocketImpl.socketAccept
> >> >    2 25.08% 74.07%    4888 300411 java.lang.UNIXProcess.waitForProcessExit
> >> >    3 25.07% 99.14%    4887 300487
> >> > org.globus.cog.abstraction.coaster.service.job.manager.BlockTaskSubmitter.run
> >> >    4  0.18% 99.32%      36 300465 java.net.SocketInputStream.socketRead0
> >> >    5  0.09% 99.42%      18 300472 java.net.SocketInputStream.socketRead0
> >> >    6  0.05% 99.46%       9 300051 java.lang.ClassLoader.defineClass1
> >> >    7  0.02% 99.48%       4 300498 java.lang.Shutdown.halt0
> >> >    8  0.02% 99.50%       3 300101 java.lang.ClassLoader.findBootstrapClass
> >> >    9  0.02% 99.51%       3 300123 java.util.zip.ZipFile.getEntry
> >> >   10  0.02% 99.53%       3 300492 java.io.FileInputStream.available
> >> >   11  0.01% 99.54%       2 300433 COM.claymoresystems.cert.CertContext.<clinit>
> >> >   12  0.01% 99.55%       2 300435 java.io.FileInputStream.open
> >> >   13  0.01% 99.56%       2 300447 java.lang.Throwable.fillInStackTrace
> >> >   14  0.01% 99.57%       2 300460 java.util.zip.Inflater.inflateBytes
> >> >   15  0.01% 99.58%       2 300491 java.lang.Throwable.fillInStackTrace
> >> > CPU SAMPLES END
> >> >
> >> > -Allan




More information about the Swift-devel mailing list