<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hello again,</p>
<p>here are the updated log_view files for 125 and 1000 processors.
I ran both problems twice, the first time with all processors per
node allocated ("-1.txt"), the second with only half on twice the
number of nodes ("-2.txt").<br>
</p>
<br>
<blockquote type="cite"
cite="mid:079D8B4D-C57B-4054-B9BD-05644E52C3A4@anl.gov">
<blockquote type="cite">
<pre wrap="">On May 24, 2018, at 12:24 AM, Michael Becker <a class="moz-txt-link-rfc2396E" href="mailto:Michael.Becker@physik.uni-giessen.de"><Michael.Becker@physik.uni-giessen.de></a> wrote:
I noticed that for every individual KSP iteration, six vector objects are created and destroyed (with CG, more with e.g. GMRES).
</pre>
</blockquote>
<pre wrap=""> Hmm, it is certainly not intended at vectors be created and destroyed within each KSPSolve() could you please point us to the code that makes you think they are being created and destroyed? We create all the work vectors at KSPSetUp() and destroy them in KSPReset() not during the solve. Not that this would be a measurable distance.
</pre>
</blockquote>
<br>
I mean this, right in the log_view output:<br>
<br>
<blockquote type="cite"><font size="-1">Memory usage is given in
bytes:<br>
</font>
<font size="-1"><br>
Object Type Creations Destructions Memory Descendants' Mem.<br>
Reports information only for process 0.<br>
</font>
<font size="-1"><br>
--- Event Stage 0: Main Stage<br>
</font>
<font size="-1"><br>
...<br>
</font>
<font size="-1"><br>
--- Event Stage 1: First Solve<br>
</font>
<font size="-1"><br>
...<br>
</font>
<font size="-1"><br>
--- Event Stage 2: Remaining Solves<br>
</font>
<font size="-1"><br>
Vector 23904 23904 1295501184 0.
</font></blockquote>
I logged the exact number of KSP iterations over the 999 timesteps
and its exactly 23904/6 = 3984.
<p>Michael<br>
</p>
<p><br>
</p>
<br>
<div class="moz-cite-prefix">Am 24.05.2018 um 19:50 schrieb Smith,
Barry F.:<br>
</div>
<blockquote type="cite"
cite="mid:079D8B4D-C57B-4054-B9BD-05644E52C3A4@anl.gov">
<pre wrap="">
Please send the log file for 1000 with cg as the solver.
You should make a bar chart of each event for the two cases to see which ones are taking more time and which are taking less (we cannot tell with the two logs you sent us since they are for different solvers.)
</pre>
<blockquote type="cite">
<pre wrap="">On May 24, 2018, at 12:24 AM, Michael Becker <a class="moz-txt-link-rfc2396E" href="mailto:Michael.Becker@physik.uni-giessen.de"><Michael.Becker@physik.uni-giessen.de></a> wrote:
I noticed that for every individual KSP iteration, six vector objects are created and destroyed (with CG, more with e.g. GMRES).
</pre>
</blockquote>
<pre wrap="">
Hmm, it is certainly not intended at vectors be created and destroyed within each KSPSolve() could you please point us to the code that makes you think they are being created and destroyed? We create all the work vectors at KSPSetUp() and destroy them in KSPReset() not during the solve. Not that this would be a measurable distance.
</pre>
<blockquote type="cite">
<pre wrap="">This seems kind of wasteful, is this supposed to be like this? Is this even the reason for my problems? Apart from that, everything seems quite normal to me (but I'm not the expert here).
Thanks in advance.
Michael
<log_view_125procs.txt><log_view_1000procs.txt>
</pre>
</blockquote>
<pre wrap="">
</pre>
</blockquote>
<br>
</body>
</html>