0 KSP Residual norm 1.347196482358e+03 1 KSP Residual norm 3.277800209368e+02 2 KSP Residual norm 1.771984593863e+02 3 KSP Residual norm 1.176842849717e+02 4 KSP Residual norm 9.175761953075e+01 5 KSP Residual norm 7.528952002913e+01 6 KSP Residual norm 6.263620486396e+01 7 KSP Residual norm 5.414356433743e+01 8 KSP Residual norm 4.825441470818e+01 9 KSP Residual norm 4.326089900465e+01 10 KSP Residual norm 3.900095789072e+01 11 KSP Residual norm 3.584279000661e+01 12 KSP Residual norm 3.301266906671e+01 13 KSP Residual norm 3.030112486745e+01 14 KSP Residual norm 2.836951244928e+01 15 KSP Residual norm 2.670686908693e+01 16 KSP Residual norm 2.494907595062e+01 17 KSP Residual norm 2.369070006145e+01 18 KSP Residual norm 2.247887236087e+01 19 KSP Residual norm 2.115782875765e+01 20 KSP Residual norm 2.029280684107e+01 21 KSP Residual norm 1.938631090893e+01 22 KSP Residual norm 1.843512927871e+01 23 KSP Residual norm 1.783303695268e+01 24 KSP Residual norm 1.704985506253e+01 25 KSP Residual norm 1.632347713750e+01 26 KSP Residual norm 1.588765648504e+01 27 KSP Residual norm 1.519934895521e+01 28 KSP Residual norm 1.469657304697e+01 29 KSP Residual norm 1.433239134213e+01 30 KSP Residual norm 1.371877132498e+01 31 KSP Residual norm 1.338718607752e+01 32 KSP Residual norm 1.303213613114e+01 33 KSP Residual norm 1.251807886428e+01 34 KSP Residual norm 1.229478743361e+01 35 KSP Residual norm 1.192996710000e+01 36 KSP Residual norm 1.155457786541e+01 37 KSP Residual norm 1.136434175977e+01 38 KSP Residual norm 1.098576423402e+01 39 KSP Residual norm 1.075755948589e+01 40 KSP Residual norm 1.052718368039e+01 41 KSP Residual norm 1.020823464191e+01 42 KSP Residual norm 1.006460071666e+01 43 KSP Residual norm 9.779389624175e+00 44 KSP Residual norm 9.576955235302e+00 45 KSP Residual norm 9.428099791477e+00 46 KSP Residual norm 9.139839268861e+00 47 KSP Residual norm 9.036555529782e+00 48 KSP Residual norm 8.830194171973e+00 49 KSP Residual norm 8.624788857076e+00 50 KSP Residual norm 8.524288577650e+00 51 KSP Residual norm 8.295426657989e+00 52 KSP Residual norm 8.197817692025e+00 53 KSP Residual norm 8.022358571827e+00 54 KSP Residual norm 7.865353540466e+00 55 KSP Residual norm 7.786175834694e+00 56 KSP Residual norm 7.575746527127e+00 57 KSP Residual norm 7.504914987654e+00 58 KSP Residual norm 7.360870286779e+00 59 KSP Residual norm 7.223257606062e+00 60 KSP Residual norm 7.146770223761e+00 61 KSP Residual norm 6.982398300782e+00 62 KSP Residual norm 6.929382373985e+00 63 KSP Residual norm 6.780362013044e+00 64 KSP Residual norm 6.687779248068e+00 65 KSP Residual norm 6.614486719075e+00 66 KSP Residual norm 6.464959992533e+00 67 KSP Residual norm 6.424804045044e+00 68 KSP Residual norm 6.290551525045e+00 69 KSP Residual norm 6.228139397741e+00 70 KSP Residual norm 6.133877432039e+00 71 KSP Residual norm 6.031620635793e+00 72 KSP Residual norm 5.991098237792e+00 73 KSP Residual norm 5.855973297185e+00 74 KSP Residual norm 5.824313715673e+00 75 KSP Residual norm 5.720830580074e+00 76 KSP Residual norm 5.653237628677e+00 77 KSP Residual norm 5.589141579837e+00 78 KSP Residual norm 5.493669671986e+00 79 KSP Residual norm 5.463796928755e+00 80 KSP Residual norm 5.348340837928e+00 81 KSP Residual norm 5.323098340635e+00 82 KSP Residual norm 5.233810421387e+00 83 KSP Residual norm 5.175493392894e+00 84 KSP Residual norm 5.122750863528e+00 85 KSP Residual norm 5.037564041863e+00 86 KSP Residual norm 5.013461575460e+00 87 KSP Residual norm 4.914338748437e+00 88 KSP Residual norm 4.894569782311e+00 89 KSP Residual norm 4.812634043100e+00 90 KSP Residual norm 4.772808739615e+00 91 KSP Residual norm 4.717005939444e+00 92 KSP Residual norm 4.651693922599e+00 93 KSP Residual norm 4.627097734164e+00 94 KSP Residual norm 4.541040821105e+00 95 KSP Residual norm 4.526006381692e+00 96 KSP Residual norm 4.447721010068e+00 97 KSP Residual norm 4.424629343966e+00 98 KSP Residual norm 4.359322445357e+00 99 KSP Residual norm 4.321583787085e+00 100 KSP Residual norm 4.281821469024e+00 101 KSP Residual norm 4.219810078436e+00 102 KSP Residual norm 4.200554626676e+00 103 KSP Residual norm 4.128672174582e+00 104 KSP Residual norm 4.117971323391e+00 105 KSP Residual norm 4.045681811366e+00 106 KSP Residual norm 4.029254346495e+00 107 KSP Residual norm 3.973086642559e+00 108 KSP Residual norm 3.942152281161e+00 109 KSP Residual norm 3.900698356335e+00 110 KSP Residual norm 3.856606697008e+00 111 KSP Residual norm 3.834946342358e+00 112 KSP Residual norm 3.773884240419e+00 113 KSP Residual norm 3.763820243109e+00 114 KSP Residual norm 3.700906770761e+00 115 KSP Residual norm 3.691447372708e+00 116 KSP Residual norm 3.631870299665e+00 117 KSP Residual norm 3.616630264154e+00 118 KSP Residual norm 3.569721625404e+00 119 KSP Residual norm 3.544191654293e+00 120 KSP Residual norm 3.507693653834e+00 121 KSP Residual norm 3.472065661856e+00 122 KSP Residual norm 3.451273397377e+00 123 KSP Residual norm 3.401398140743e+00 124 KSP Residual norm 3.390787502104e+00 125 KSP Residual norm 3.337621985363e+00 126 KSP Residual norm 3.330682197491e+00 127 KSP Residual norm 3.276774111621e+00 128 KSP Residual norm 3.268349672596e+00 129 KSP Residual norm 3.220843557776e+00 130 KSP Residual norm 3.207919104836e+00 131 KSP Residual norm 3.165063179723e+00 132 KSP Residual norm 3.146476315234e+00 133 KSP Residual norm 3.115161459660e+00 134 KSP Residual norm 3.085497541441e+00 135 KSP Residual norm 3.063711229215e+00 136 KSP Residual norm 3.027319791559e+00 137 KSP Residual norm 3.013924494656e+00 138 KSP Residual norm 2.971518276973e+00 139 KSP Residual norm 2.961770370372e+00 140 KSP Residual norm 2.919024286609e+00 141 KSP Residual norm 2.912583738415e+00 142 KSP Residual norm 2.866702558690e+00 143 KSP Residual norm 2.862095002670e+00 144 KSP Residual norm 2.818643885402e+00 145 KSP Residual norm 2.811898213981e+00 146 KSP Residual norm 2.771313557350e+00 147 KSP Residual norm 2.760541629072e+00 148 KSP Residual norm 2.727428011375e+00 149 KSP Residual norm 2.711008686124e+00 150 KSP Residual norm 2.682075718883e+00 151 KSP Residual norm 2.662817719699e+00 152 KSP Residual norm 2.639502806948e+00 153 KSP Residual norm 2.615318366448e+00 154 KSP Residual norm 2.596221635022e+00 155 KSP Residual norm 2.568675600634e+00 156 KSP Residual norm 2.555543107605e+00 157 KSP Residual norm 2.522851020123e+00 158 KSP Residual norm 2.513312466254e+00 159 KSP Residual norm 2.479901702523e+00 160 KSP Residual norm 2.473234608194e+00 161 KSP Residual norm 2.439344230243e+00 162 KSP Residual norm 2.436052888769e+00 163 KSP Residual norm 2.407986269818e+00 164 KSP Residual norm 2.415075307710e+00 165 KSP Residual norm 2.400906535509e+00 166 KSP Residual norm 2.435776835871e+00 167 KSP Residual norm 2.463530608005e+00 168 KSP Residual norm 2.560826481229e+00 169 KSP Residual norm 2.674648516521e+00 170 KSP Residual norm 2.887342098115e+00 171 KSP Residual norm 3.141138734610e+00 172 KSP Residual norm 3.496420673406e+00 173 KSP Residual norm 3.842477324075e+00 174 KSP Residual norm 4.167589679184e+00 175 KSP Residual norm 4.254333608388e+00 176 KSP Residual norm 4.081387683843e+00 177 KSP Residual norm 3.592976111626e+00 178 KSP Residual norm 3.024927258756e+00 179 KSP Residual norm 2.480825443334e+00 180 KSP Residual norm 2.121070599683e+00 181 KSP Residual norm 1.930380523787e+00 182 KSP Residual norm 1.924612360170e+00 183 KSP Residual norm 2.019480510568e+00 184 KSP Residual norm 2.126907408808e+00 185 KSP Residual norm 2.095721019444e+00 186 KSP Residual norm 1.930604755317e+00 187 KSP Residual norm 1.722230709623e+00 188 KSP Residual norm 1.606955308897e+00 189 KSP Residual norm 1.599237716124e+00 190 KSP Residual norm 1.669350537550e+00 191 KSP Residual norm 1.688758097887e+00 192 KSP Residual norm 1.597649719875e+00 193 KSP Residual norm 1.443278779937e+00 194 KSP Residual norm 1.357671534738e+00 195 KSP Residual norm 1.369715932756e+00 196 KSP Residual norm 1.440136661734e+00 197 KSP Residual norm 1.441221848034e+00 198 KSP Residual norm 1.334865868986e+00 199 KSP Residual norm 1.209540305427e+00 200 KSP Residual norm 1.175509441061e+00 201 KSP Residual norm 1.221361048626e+00 202 KSP Residual norm 1.265858538443e+00 203 KSP Residual norm 1.197032746014e+00 204 KSP Residual norm 1.086161241141e+00 205 KSP Residual norm 1.029505249200e+00 206 KSP Residual norm 1.062738559585e+00 207 KSP Residual norm 1.098840331946e+00 208 KSP Residual norm 1.057084754978e+00 209 KSP Residual norm 9.635364456303e-01 210 KSP Residual norm 9.280434498255e-01 211 KSP Residual norm 9.482601902889e-01 212 KSP Residual norm 9.662205863004e-01 213 KSP Residual norm 9.093135146486e-01 214 KSP Residual norm 8.534084765257e-01 215 KSP Residual norm 8.400252891425e-01 216 KSP Residual norm 8.619593728708e-01 217 KSP Residual norm 8.339229605466e-01 218 KSP Residual norm 7.833294921617e-01 219 KSP Residual norm 7.556239733262e-01 220 KSP Residual norm 7.736051568843e-01 221 KSP Residual norm 7.616096424032e-01 222 KSP Residual norm 7.157250741994e-01 223 KSP Residual norm 6.779966612517e-01 224 KSP Residual norm 6.900056714636e-01 225 KSP Residual norm 6.908985239890e-01 226 KSP Residual norm 6.551938736914e-01 227 KSP Residual norm 6.119489954210e-01 228 KSP Residual norm 6.137938065014e-01 229 KSP Residual norm 6.176774535763e-01 230 KSP Residual norm 5.931689632230e-01 231 KSP Residual norm 5.541340906576e-01 232 KSP Residual norm 5.496642260383e-01 233 KSP Residual norm 5.495169465255e-01 234 KSP Residual norm 5.280277149730e-01 235 KSP Residual norm 4.974090821277e-01 236 KSP Residual norm 4.926426789167e-01 237 KSP Residual norm 4.891045449212e-01 238 KSP Residual norm 4.651969946327e-01 239 KSP Residual norm 4.414817820351e-01 240 KSP Residual norm 4.382124155743e-01 241 KSP Residual norm 4.326646410921e-01 242 KSP Residual norm 4.067327775531e-01 243 KSP Residual norm 3.885589919090e-01 244 KSP Residual norm 3.858218178550e-01 245 KSP Residual norm 3.780631304366e-01 246 KSP Residual norm 3.528247662109e-01 247 KSP Residual norm 3.399333589183e-01 248 KSP Residual norm 3.362676761754e-01 249 KSP Residual norm 3.260863480042e-01 250 KSP Residual norm 3.047721250501e-01 251 KSP Residual norm 2.974761110447e-01 252 KSP Residual norm 2.925958592852e-01 253 KSP Residual norm 2.817907029402e-01 254 KSP Residual norm 2.674312668637e-01 255 KSP Residual norm 2.650645119289e-01 256 KSP Residual norm 2.590271428851e-01 257 KSP Residual norm 2.490915356995e-01 258 KSP Residual norm 2.416520172930e-01 259 KSP Residual norm 2.406008961935e-01 260 KSP Residual norm 2.322899447394e-01 261 KSP Residual norm 2.230364267433e-01 262 KSP Residual norm 2.195332122583e-01 263 KSP Residual norm 2.156706097489e-01 264 KSP Residual norm 2.067137456374e-01 265 KSP Residual norm 1.996730924891e-01 266 KSP Residual norm 1.976866164991e-01 267 KSP Residual norm 1.906952559312e-01 268 KSP Residual norm 1.839755469333e-01 269 KSP Residual norm 1.793290030340e-01 270 KSP Residual norm 1.764692553873e-01 271 KSP Residual norm 1.688173139517e-01 272 KSP Residual norm 1.651517671203e-01 273 KSP Residual norm 1.609326239769e-01 274 KSP Residual norm 1.557449927586e-01 275 KSP Residual norm 1.499229801423e-01 276 KSP Residual norm 1.478332798500e-01 277 KSP Residual norm 1.429868115397e-01 278 KSP Residual norm 1.374540585849e-01 279 KSP Residual norm 1.345289602487e-01 280 KSP Residual norm 1.313818084725e-01 281 KSP Residual norm 1.261275529030e-01 282 KSP Residual norm 1.218669258440e-01 283 KSP Residual norm 1.202772533684e-01 284 KSP Residual norm 1.154861204987e-01 285 KSP Residual norm 1.115743724649e-01 286 KSP Residual norm 1.085959636347e-01 287 KSP Residual norm 1.061746680500e-01 288 KSP Residual norm 1.014230426377e-01 289 KSP Residual norm 9.908580362251e-02 290 KSP Residual norm 9.613908686833e-02 291 KSP Residual norm 9.273776964853e-02 292 KSP Residual norm 8.977427005889e-02 293 KSP Residual norm 8.757757340599e-02 294 KSP Residual norm 8.427615946218e-02 295 KSP Residual norm 8.121059024885e-02 296 KSP Residual norm 7.956848685938e-02 297 KSP Residual norm 7.637620086164e-02 298 KSP Residual norm 7.372843668070e-02 299 KSP Residual norm 7.151618418685e-02 300 KSP Residual norm 6.969556204349e-02 301 KSP Residual norm 6.642280972112e-02 302 KSP Residual norm 6.471874503667e-02 303 KSP Residual norm 6.260050521571e-02 304 KSP Residual norm 6.027281008688e-02 305 KSP Residual norm 5.815746401210e-02 306 KSP Residual norm 5.646636061294e-02 307 KSP Residual norm 5.426879075420e-02 308 KSP Residual norm 5.220277431557e-02 309 KSP Residual norm 5.085312044780e-02 310 KSP Residual norm 4.861437389737e-02 311 KSP Residual norm 4.697969518897e-02 312 KSP Residual norm 4.533187538243e-02 313 KSP Residual norm 4.380179585611e-02 314 KSP Residual norm 4.176898774406e-02 315 KSP Residual norm 4.062120334615e-02 316 KSP Residual norm 3.900588729823e-02 317 KSP Residual norm 3.735249557202e-02 318 KSP Residual norm 3.605178828982e-02 319 KSP Residual norm 3.468377969989e-02 320 KSP Residual norm 3.324361198656e-02 321 KSP Residual norm 3.187773213517e-02 322 KSP Residual norm 3.083175894367e-02 323 KSP Residual norm 2.929106442542e-02 324 KSP Residual norm 2.827416972723e-02 325 KSP Residual norm 2.706742670776e-02 326 KSP Residual norm 2.590898729759e-02 327 KSP Residual norm 2.476653158078e-02 328 KSP Residual norm 2.381601338069e-02 329 KSP Residual norm 2.269184156786e-02 330 KSP Residual norm 2.164214931001e-02 331 KSP Residual norm 2.082804772604e-02 332 KSP Residual norm 1.971665836098e-02 333 KSP Residual norm 1.886441535627e-02 334 KSP Residual norm 1.797411562366e-02 335 KSP Residual norm 1.714637256466e-02 336 KSP Residual norm 1.621858903678e-02 337 KSP Residual norm 1.551550755487e-02 338 KSP Residual norm 1.470465031011e-02 339 KSP Residual norm 1.391339285789e-02 340 KSP Residual norm 1.326708390883e-02 KSP Object: 2 MPI processes type: cg maximum iterations=10000, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using PRECONDITIONED norm type for convergence test PC Object: 2 MPI processes type: bjacobi number of blocks = 2 Local solver information for first block is in the following KSP and PC objects on rank 0: Use -ksp_view ::ascii_info_detail to display information for all blocks KSP Object: (sub_) 1 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (sub_) 1 MPI processes type: ilu out-of-place factorization 0 levels of fill tolerance for zero pivot 2.22045e-14 matrix ordering: natural factor fill ratio given 1., needed 1. Factored matrix follows: Mat Object: 1 MPI processes type: seqaijcusparse rows=66846976, cols=66846976 package used to perform factorization: cusparse total: nonzeros=466883326, allocated nonzeros=466883326 not using I-node routines linear system matrix = precond matrix: Mat Object: (sub_) 1 MPI processes type: seqaijcusparse rows=66846976, cols=66846976 total: nonzeros=466883326, allocated nonzeros=466883326 total number of mallocs used during MatSetValues calls=0 not using I-node routines linear system matrix = precond matrix: Mat Object: 2 MPI processes type: mpiaijcusparse rows=133432831, cols=133432831 total: nonzeros=932463091, allocated nonzeros=932463091 total number of mallocs used during MatSetValues calls=0 Residual norm 6.1486e-05 WARNING: -log_summary is being deprecated; switch to -log_view ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ########################################################## # # # WARNING!!! # # # # This code was compiled with a debugging option. # # To get timing results run ./configure # # using --with-debugging=no, the performance will # # be generally two or three times faster. # # # ########################################################## ./ex45 on a named glados.dl.ac.uk with 2 processors, by kchockalingam Fri Oct 1 13:04:01 2021 Using Petsc Release Version 3.15.3, Aug 06, 2021 Max Max/Min Avg Total Time (sec): 2.151e+02 1.000 2.151e+02 Objects: 3.900e+01 1.000 3.900e+01 Flop: 8.659e+11 1.004 8.642e+11 1.728e+12 Flop/sec: 4.026e+09 1.004 4.018e+09 8.035e+09 Memory: 1.764e+10 1.004 1.760e+10 3.521e+10 MPI Messages: 3.440e+02 1.000 3.440e+02 6.880e+02 MPI Message Lengths: 7.134e+08 1.000 2.074e+06 1.427e+09 MPI Reductions: 4.643e+03 1.000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 2.1509e+02 100.0% 1.7284e+12 100.0% 6.880e+02 100.0% 2.074e+06 100.0% 4.624e+03 99.6% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ ########################################################## # # # WARNING!!! # # # # This code was compiled with a debugging option. # # To get timing results run ./configure # # using --with-debugging=no, the performance will # # be generally two or three times faster. # # # ########################################################## Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage BuildTwoSided 3 1.0 5.4121e-05 1.1 0.00e+00 0.0 2.0e+00 4.0e+00 6.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 2 1.0 4.4286e-05 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 341 1.0 6.4534e+00 1.0 2.96e+11 1.0 6.9e+02 2.1e+06 2.0e+00 3 34100100 0 3 34100100 0 91492 109574 2 5.86e+03 0 0.00e+00 100 MatSolve 341 1.0 7.9049e+01 1.0 2.96e+11 1.0 0.0e+00 0.0e+00 0.0e+00 36 34 0 0 0 36 34 0 0 0 7465 7470 1 5.34e+02 0 0.00e+00 100 MatLUFactorNum 1 1.0 3.5714e+01 1.2 1.45e+09 1.0 0.0e+00 0.0e+00 0.0e+00 15 0 0 0 0 15 0 0 0 0 81 0 2 6.93e+03 0 0.00e+00 0 MatILUFactorSym 1 1.0 2.5003e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyBegin 2 1.0 1.3000e-01868.7 0.00e+00 0.0 0.0e+00 0.0e+00 8.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 2 1.0 2.2618e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 1.9e+01 1 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetRowIJ 1 1.0 5.1409e-07 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 1.0 6.0305e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatView 3 3.0 1.3213e-04 5.1 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 9.8122e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 5.86e+03 0 0.00e+00 0 MatCUSPARSSolAnl 2 1.0 2.1944e+01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 9 0 0 0 0 9 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSetUp 2 1.0 5.2192e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 9.5679e+01 1.1 8.63e+11 1.0 6.8e+02 2.1e+06 4.4e+03 43100 99100 95 43100 99100 96 18010 19285 1022 6.40e+03 1021 8.17e-03 100 DMCreateMat 1 1.0 6.2860e+01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.5e+01 29 0 0 0 1 29 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 SFSetGraph 2 1.0 9.1980e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 6.4612e-03 1.0 0.00e+00 0.0 4.0e+00 5.2e+05 2.0e+00 0 0 1 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFPack 341 1.0 1.4713e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFUnpack 341 1.0 1.0099e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecTDot 680 1.0 1.1366e+00 1.0 9.09e+10 1.0 0.0e+00 0.0e+00 1.4e+03 1 10 0 0 29 1 10 0 0 29 159656 160630 0 0.00e+00 680 5.44e-03 100 VecNorm 342 1.0 8.7432e+0028.2 4.57e+10 1.0 0.0e+00 0.0e+00 6.8e+02 2 5 0 0 15 2 5 0 0 15 10439 298551 0 0.00e+00 342 2.74e-03 100 VecCopy 2 1.0 6.1861e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSet 351 1.0 2.9913e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 681 1.0 1.8702e+00 1.0 9.10e+10 1.0 0.0e+00 0.0e+00 0.0e+00 1 11 0 0 0 1 11 0 0 0 97172 101954 682 5.34e+02 0 0.00e+00 100 VecAYPX 339 1.0 1.5000e+00 1.0 4.53e+10 1.0 0.0e+00 0.0e+00 0.0e+00 1 5 0 0 0 1 5 0 0 0 60312 60335 339 2.71e-03 0 0.00e+00 100 VecScatterBegin 341 1.0 6.3073e-02 1.0 0.00e+00 0.0 6.9e+02 2.1e+06 2.0e+00 0 0100100 0 0 0100100 0 0 0 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 341 1.0 2.3984e-0114.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 2 1.0 1.3800e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 1.07e+03 0 0.00e+00 0 PCSetUp 2 1.0 3.9149e+01 1.1 1.45e+09 1.0 0.0e+00 0.0e+00 0.0e+00 17 0 0 0 0 17 0 0 0 0 74 0 2 6.93e+03 0 0.00e+00 0 PCSetUpOnBlocks 1 1.0 3.8817e+01 1.1 1.45e+09 1.0 0.0e+00 0.0e+00 0.0e+00 17 0 0 0 0 17 0 0 0 0 75 0 2 6.93e+03 0 0.00e+00 0 PCApply 341 1.0 7.9437e+01 1.0 2.96e+11 1.0 0.0e+00 0.0e+00 0.0e+00 36 34 0 0 0 36 34 0 0 0 7428 7444 1 5.34e+02 0 0.00e+00 100 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Krylov Solver 2 2 3272 0. DMKSP interface 1 1 664 0. Matrix 4 4 14952821148 0. Distributed Mesh 1 1 5560 0. Index Set 7 7 1071646904 0. IS L to G Mapping 1 1 268433068 0. Star Forest Graph 4 4 4896 0. Discrete System 1 1 904 0. Weak Form 1 1 824 0. Vector 12 12 4280316376 0. Preconditioner 2 2 1936 0. Viewer 3 2 1696 0. ======================================================================================================================== Average time to get PetscTime(): 2.30968e-08 Average time for MPI_Barrier(): 6.57141e-07 Average time for zero size MPI_Send(): 1.24425e-06 #PETSc Option Table entries: -da_grid_x 511 -da_grid_y 511 -da_grid_z 511 -dm_mat_type mpiaijcusparse -dm_vec_type mpicuda -ksp_monitor -ksp_type cg -ksp_view -log_summary -pc_type bjacobi #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --package-prefix-hash=/home/kchockalingam/petsc-hash-pkgs --with-make-test-np=2 COPTFLAGS="-g -O" FOPTFLAGS="-g -O" CXXOPTFLAGS="-g -O" --with-blaslapack=1 --download-hypre=1 --with-cuda-dir=/apps/packages/cuda/10.1/ --with-mpi-dir=/apps/packages/gcc/7.3.0/openmpi/3.1.2 PETSC_ARCH=arch-ci-linux-cuda11-double ----------------------------------------- Libraries compiled on 2021-09-28 13:53:19 on glados.dl.ac.uk Machine characteristics: Linux-4.18.0-193.6.3.el8_2.x86_64-x86_64-with-centos-8.2.2004-Core Using PETSc directory: /home/kchockalingam/tools/petsc-3.15.3 Using PETSc arch: ----------------------------------------- Using C compiler: /apps/packages/gcc/7.3.0/openmpi/3.1.2/bin/mpicc -fPIC -Wall -Wwrite-strings -Wno-strict-aliasing -Wno-unknown-pragmas -fstack-protector -fvisibility=hidden -g -O Using Fortran compiler: /apps/packages/gcc/7.3.0/openmpi/3.1.2/bin/mpif90 -fPIC -Wall -ffree-line-length-0 -Wno-unused-dummy-argument -g -O ----------------------------------------- Using include paths: -I/home/kchockalingam/tools/petsc-3.15.3/include -I/home/kchockalingam/tools/petsc-3.15.3/arch-ci-linux-cuda11-double/include -I/home/kchockalingam/petsc-hash-pkgs/d71384/include -I/apps/packages/gcc/7.3.0/openmpi/3.1.2/include -I/apps/packages/cuda/10.1/include ----------------------------------------- Using C linker: /apps/packages/gcc/7.3.0/openmpi/3.1.2/bin/mpicc Using Fortran linker: /apps/packages/gcc/7.3.0/openmpi/3.1.2/bin/mpif90 Using libraries: -Wl,-rpath,/home/kchockalingam/tools/petsc-3.15.3/lib -L/home/kchockalingam/tools/petsc-3.15.3/lib -lpetsc -Wl,-rpath,/home/kchockalingam/petsc-hash-pkgs/d71384/lib -L/home/kchockalingam/petsc-hash-pkgs/d71384/lib -Wl,-rpath,/apps/packages/cuda/10.1/lib64 -L/apps/packages/cuda/10.1/lib64 -Wl,-rpath,/apps/packages/gcc/7.3.0/openmpi/3.1.2/lib -L/apps/packages/gcc/7.3.0/openmpi/3.1.2/lib -Wl,-rpath,/apps/packages/compilers/gcc/7.3.0/lib/gcc/x86_64-pc-linux-gnu/7.3.0 -L/apps/packages/compilers/gcc/7.3.0/lib/gcc/x86_64-pc-linux-gnu/7.3.0 -Wl,-rpath,/apps/packages/compilers/gcc/7.3.0/lib64 -L/apps/packages/compilers/gcc/7.3.0/lib64 -Wl,-rpath,/apps/packages/compilers/gcc/7.3.0/lib -L/apps/packages/compilers/gcc/7.3.0/lib -lHYPRE -llapack -lblas -lcufft -lcublas -lcudart -lcusparse -lcusolver -lcurand -lX11 -lstdc++ -ldl -lmpi_usempi_ignore_tkr -lmpi_mpifh -lmpi -lgfortran -lm -lutil -lrt -lz -lgfortran -lm -lgfortran -lgcc_s -lquadmath -lpthread -lquadmath -lstdc++ -ldl ----------------------------------------- ########################################################## # # # WARNING!!! # # # # This code was compiled with a debugging option. # # To get timing results run ./configure # # using --with-debugging=no, the performance will # # be generally two or three times faster. # # # ##########################################################