<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><br class=""></div><div class=""> I cleaned up Mark's last run and put it in a fixed-width font. I realize this may be too difficult but it would be great to have identical runs to compare with on Summit.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""> As Jed noted Scatter takes a long time but the pack and unpack take no time? Is this not timed if using Kokkos?</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">--- Event Stage 2: KSP Solve only</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class=""><br class=""></span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">MatMult 400 1.0 8.8003e+00 1.1 1.06e+11 1.0 2.2e+04 8.5e+04 0.0e+00 2 55 61 54 0 70 91100100 95,058 132,242 0 0.00e+00 0 0.00e+00 100</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">VecScatterBegin 400 1.0 1.3391e+00 2.6 0.00e+00 0.0 2.2e+04 8.5e+04 0.0e+00 0 0 61 54 0 7 0100100 0 0 0 0.00e+00 0 0.00e+00 0</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">VecScatterEnd 400 1.0 1.3240e+00 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">SFPack 400 1.0 1.8276e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">SFUnpack 400 1.0 6.2653e-05 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class=""><br class=""></span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">KSPSolve 2 1.0 1.2540e+01 1.0 1.17e+11 1.0 2.2e+04 8.5e+04 1.2e+03 3 60 61 54 60 100100100 73,592 116,796 0 0.00e+00 0 0.00e+00 100</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">VecTDot 802 1.0 1.3551e+00 1.2 3.36e+09 1.0 0.0e+00 0.0e+00 8.0e+02 0 2 0 0 40 10 3 0 19,627 52,599 0 0.00e+00 0 0.00e+00 100</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">VecNorm 402 1.0 9.0151e-01 2.2 1.69e+09 1.0 0.0e+00 0.0e+00 4.0e+02 0 1 0 0 20 5 1 0 0 14,788 125,477 0 0.00e+00 0 0.00e+00 100</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">VecAXPY 800 1.0 8.2617e-01 1.0 3.36e+09 1.0 0.0e+00 0.0e+00 0.0e+00 0 2 0 0 0 7 3 0 0 32,112 61,644 0 0.00e+00 0 0.00e+00 100</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">VecAYPX 398 1.0 8.1525e-01 1.6 1.67e+09 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 5 1 0 0 16,190 20,689 0 0.00e+00 0 0.00e+00 100</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class="">VecPointwiseMult 402 1.0 3.5694e-01 1.0 8.43e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 1 0 0 18,675 38,633 0 0.00e+00 0 0.00e+00 100</span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class=""><br class=""></span></font></div><div class=""><font face="Courier New" class=""><span style="font-style: normal; font-size: 12px;" class=""><br class=""></span></font></div><div><br class=""><blockquote type="cite" class=""><div class="">On Jan 22, 2022, at 12:40 PM, Mark Adams <<a href="mailto:mfadams@lbl.gov" class="">mfadams@lbl.gov</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">And I have a new MR with if you want to see what I've done so far.</div>
</div></blockquote></div><br class=""></body></html>