########### PETSC solver and runtime options Runtime options : -ksp_converged_reason -ksp_view -ksp_type groppcg -pc_type gamg -ksp_monitor -ksp_max_it 40000 -ksp_rtol 1.e-6 -ksp_divtol 1.e6 -mat_type aijcusparse -vec_type cuda -log_view -options_left -device_view PetscDevice Object: 4 MPI processes type: host id: 0 PetscDevice Object: 4 MPI processes type: host id: 0 PetscDevice Object: 4 MPI processes type: host id: 0 PetscDevice Object: 4 MPI processes type: host id: 0 PetscDevice Object: 4 MPI processes type: cuda id: 0 [0] name: NVIDIA A100-SXM4-80GB Compute capability: 8.0 Multiprocessor Count: 108 Maximum Grid Dimensions: 2147483647 x 65535 x 65535 Maximum Block Dimensions: 1024 x 1024 x 64 Maximum Threads Per Block: 1024 Warp Size: 32 Total Global Memory (bytes): 84990623744 Total Constant Memory (bytes): 65536 Shared Memory Per Block (bytes): 49152 Multiprocessor Clock Rate (KHz): 1410000 Memory Clock Rate (KHz): 1593000 Memory Bus Width (bits): 5120 Peak Memory Bandwidth (GB/s): 2039.040000 Can map host memory: PETSC_TRUE Can execute multiple kernels concurrently: PETSC_TRUE PetscDevice Object: 4 MPI processes type: cuda id: 1 [0] name: NVIDIA A100-SXM4-80GB Compute capability: 8.0 Multiprocessor Count: 108 Maximum Grid Dimensions: 2147483647 x 65535 x 65535 Maximum Block Dimensions: 1024 x 1024 x 64 Maximum Threads Per Block: 1024 Warp Size: 32 Total Global Memory (bytes): 84990623744 Total Constant Memory (bytes): 65536 Shared Memory Per Block (bytes): 49152 Multiprocessor Clock Rate (KHz): 1410000 Memory Clock Rate (KHz): 1593000 Memory Bus Width (bits): 5120 Peak Memory Bandwidth (GB/s): 2039.040000 Can map host memory: PETSC_TRUE Can execute multiple kernels concurrently: PETSC_TRUE PetscDevice Object: 4 MPI processes type: cuda id: 2 [0] name: NVIDIA A100-SXM4-80GB Compute capability: 8.0 Multiprocessor Count: 108 Maximum Grid Dimensions: 2147483647 x 65535 x 65535 Maximum Block Dimensions: 1024 x 1024 x 64 Maximum Threads Per Block: 1024 Warp Size: 32 Total Global Memory (bytes): 84990623744 Total Constant Memory (bytes): 65536 Shared Memory Per Block (bytes): 49152 Multiprocessor Clock Rate (KHz): 1410000 Memory Clock Rate (KHz): 1593000 Memory Bus Width (bits): 5120 Peak Memory Bandwidth (GB/s): 2039.040000 Can map host memory: PETSC_TRUE Can execute multiple kernels concurrently: PETSC_TRUE PetscDevice Object: 4 MPI processes type: cuda id: 3 [0] name: NVIDIA A100-SXM4-80GB Compute capability: 8.0 Multiprocessor Count: 108 Maximum Grid Dimensions: 2147483647 x 65535 x 65535 Maximum Block Dimensions: 1024 x 1024 x 64 Maximum Threads Per Block: 1024 Warp Size: 32 Total Global Memory (bytes): 84990623744 Total Constant Memory (bytes): 65536 Shared Memory Per Block (bytes): 49152 Multiprocessor Clock Rate (KHz): 1410000 Memory Clock Rate (KHz): 1593000 Memory Bus Width (bits): 5120 Peak Memory Bandwidth (GB/s): 2039.040000 Can map host memory: PETSC_TRUE Can execute multiple kernels concurrently: PETSC_TRUE Building the matrix... Size of A = (808996,808996) In petsc::solve(), before solution of Ax = b 0 KSP Residual norm 2.216034320869e+00 1 KSP Residual norm 1.760530007184e+00 2 KSP Residual norm 1.822570903862e+00 3 KSP Residual norm 1.852037166972e+00 4 KSP Residual norm 1.924881643981e+00 5 KSP Residual norm 1.946187583865e+00 6 KSP Residual norm 2.049055905201e+00 7 KSP Residual norm 2.078302294855e+00 8 KSP Residual norm 2.156539364259e+00 9 KSP Residual norm 2.169186338304e+00 10 KSP Residual norm 2.271791502754e+00 11 KSP Residual norm 2.318498915302e+00 12 KSP Residual norm 2.379353642615e+00 13 KSP Residual norm 2.484011395505e+00 14 KSP Residual norm 2.679555731914e+00 15 KSP Residual norm 2.865946897041e+00 16 KSP Residual norm 3.012364451071e+00 17 KSP Residual norm 3.144199931438e+00 18 KSP Residual norm 3.629024075287e+00 19 KSP Residual norm 3.827608854079e+00 20 KSP Residual norm 4.335598700245e+00 21 KSP Residual norm 4.842120682584e+00 22 KSP Residual norm 5.470950442047e+00 23 KSP Residual norm 6.431877384517e+00 24 KSP Residual norm 8.098749326027e+00 25 KSP Residual norm 1.021880530753e+01 26 KSP Residual norm 1.580136634351e+01 27 KSP Residual norm 2.792213845203e+01 28 KSP Residual norm 1.593376353248e+02 29 KSP Residual norm 4.439617681808e+01 30 KSP Residual norm 2.002949859066e+01 31 KSP Residual norm 1.293593365955e+01 32 KSP Residual norm 9.749295088426e+00 33 KSP Residual norm 8.133717390623e+00 34 KSP Residual norm 6.729508818661e+00 35 KSP Residual norm 5.856298465366e+00 36 KSP Residual norm 5.511544340630e+00 37 KSP Residual norm 5.118324683919e+00 38 KSP Residual norm 5.064072807491e+00 39 KSP Residual norm 4.980589316801e+00 40 KSP Residual norm 4.980284705617e+00 41 KSP Residual norm 4.876334011171e+00 42 KSP Residual norm 4.712318183733e+00 43 KSP Residual norm 4.526638657028e+00 44 KSP Residual norm 4.482059149505e+00 45 KSP Residual norm 4.509209811968e+00 46 KSP Residual norm 4.207904541441e+00 47 KSP Residual norm 4.437378631503e+00 48 KSP Residual norm 4.591973930839e+00 49 KSP Residual norm 5.247469272559e+00 50 KSP Residual norm 5.632824654027e+00 51 KSP Residual norm 5.929573964262e+00 52 KSP Residual norm 6.572394348023e+00 53 KSP Residual norm 8.195399245315e+00 54 KSP Residual norm 9.799857011484e+00 55 KSP Residual norm 1.248757085443e+01 56 KSP Residual norm 1.780859645970e+01 57 KSP Residual norm 3.010197154411e+01 58 KSP Residual norm 9.346196992521e+01 59 KSP Residual norm 8.521641231188e+01 60 KSP Residual norm 3.021368976601e+01 61 KSP Residual norm 1.821353023960e+01 62 KSP Residual norm 1.359901745363e+01 63 KSP Residual norm 1.091162604778e+01 64 KSP Residual norm 9.445595972993e+00 65 KSP Residual norm 8.125907690953e+00 66 KSP Residual norm 7.334688607461e+00 67 KSP Residual norm 6.682666916572e+00 68 KSP Residual norm 6.575674444590e+00 69 KSP Residual norm 6.015464351299e+00 70 KSP Residual norm 5.456220043153e+00 71 KSP Residual norm 5.469870355191e+00 72 KSP Residual norm 5.225784146355e+00 73 KSP Residual norm 5.187715986174e+00 74 KSP Residual norm 5.047287540546e+00 75 KSP Residual norm 5.103958879071e+00 76 KSP Residual norm 4.919543699166e+00 77 KSP Residual norm 4.796129679422e+00 78 KSP Residual norm 4.761713899913e+00 79 KSP Residual norm 5.027639774670e+00 80 KSP Residual norm 5.315073214737e+00 81 KSP Residual norm 6.414046831163e+00 82 KSP Residual norm 9.219455272971e+00 83 KSP Residual norm 1.387654989313e+01 84 KSP Residual norm 2.613975902496e+01 85 KSP Residual norm 7.746562409301e+01 86 KSP Residual norm 9.043593889771e+01 87 KSP Residual norm 2.909853233241e+01 88 KSP Residual norm 1.777080196533e+01 89 KSP Residual norm 1.400130515245e+01 90 KSP Residual norm 1.271748361108e+01 91 KSP Residual norm 1.138196885142e+01 92 KSP Residual norm 9.680039197446e+00 93 KSP Residual norm 9.141083067454e+00 94 KSP Residual norm 8.509852863138e+00 95 KSP Residual norm 8.677171064118e+00 96 KSP Residual norm 7.804269264951e+00 97 KSP Residual norm 7.058058698205e+00 98 KSP Residual norm 6.039228900755e+00 99 KSP Residual norm 5.485250216796e+00 100 KSP Residual norm 5.060561924611e+00 101 KSP Residual norm 5.084702333143e+00 102 KSP Residual norm 4.891786122413e+00 103 KSP Residual norm 4.629421438034e+00 104 KSP Residual norm 4.644025085636e+00 105 KSP Residual norm 4.624197380114e+00 106 KSP Residual norm 4.828470062107e+00 107 KSP Residual norm 5.302740988031e+00 108 KSP Residual norm 6.790838388929e+00 109 KSP Residual norm 8.373918470069e+00 110 KSP Residual norm 1.108809586186e+01 111 KSP Residual norm 1.468079220635e+01 112 KSP Residual norm 2.199986019799e+01 113 KSP Residual norm 4.098491590305e+01 114 KSP Residual norm 3.950306036401e+02 115 KSP Residual norm 5.223526486533e+01 116 KSP Residual norm 2.441867775501e+01 117 KSP Residual norm 1.668488227850e+01 118 KSP Residual norm 1.205939869767e+01 119 KSP Residual norm 9.680092766577e+00 120 KSP Residual norm 8.530094771085e+00 121 KSP Residual norm 7.969380005663e+00 122 KSP Residual norm 7.870621205815e+00 123 KSP Residual norm 8.127873137834e+00 124 KSP Residual norm 8.399482528302e+00 125 KSP Residual norm 8.361828684513e+00 126 KSP Residual norm 8.405156962087e+00 127 KSP Residual norm 7.419236843615e+00 128 KSP Residual norm 7.057723601694e+00 129 KSP Residual norm 6.285131980779e+00 130 KSP Residual norm 5.768204277175e+00 131 KSP Residual norm 5.180606238580e+00 132 KSP Residual norm 4.845366221017e+00 133 KSP Residual norm 4.373780470307e+00 134 KSP Residual norm 4.055716860398e+00 135 KSP Residual norm 3.951545611716e+00 136 KSP Residual norm 4.152722850238e+00 137 KSP Residual norm 4.623866028876e+00 138 KSP Residual norm 5.399029047074e+00 139 KSP Residual norm 7.111123941906e+00 140 KSP Residual norm 9.690863534958e+00 141 KSP Residual norm 1.449191714970e+01 142 KSP Residual norm 2.540916806470e+01 143 KSP Residual norm 1.216453179581e+02 144 KSP Residual norm 4.593662863004e+01 145 KSP Residual norm 1.905540503796e+01 146 KSP Residual norm 1.182977163819e+01 147 KSP Residual norm 8.750096261862e+00 148 KSP Residual norm 6.866668770246e+00 149 KSP Residual norm 5.498501359034e+00 150 KSP Residual norm 4.662824382255e+00 151 KSP Residual norm 4.018273911271e+00 152 KSP Residual norm 3.597792656140e+00 153 KSP Residual norm 3.374403604203e+00 154 KSP Residual norm 3.277774834040e+00 155 KSP Residual norm 3.319482984149e+00 156 KSP Residual norm 3.365571903572e+00 157 KSP Residual norm 3.511804527899e+00 158 KSP Residual norm 3.627214283235e+00 159 KSP Residual norm 3.945637328115e+00 160 KSP Residual norm 4.237794035541e+00 161 KSP Residual norm 4.795385531516e+00 162 KSP Residual norm 5.498777731848e+00 163 KSP Residual norm 6.470517396875e+00 164 KSP Residual norm 8.088774095837e+00 165 KSP Residual norm 1.127551608158e+01 166 KSP Residual norm 1.977539810937e+01 167 KSP Residual norm 5.931963694885e+01 168 KSP Residual norm 5.670828213558e+01 169 KSP Residual norm 1.930541434035e+01 170 KSP Residual norm 1.141840200337e+01 171 KSP Residual norm 8.030086055757e+00 172 KSP Residual norm 6.126879467132e+00 173 KSP Residual norm 4.911388474879e+00 174 KSP Residual norm 4.352504523129e+00 175 KSP Residual norm 3.923788581001e+00 176 KSP Residual norm 3.678641024989e+00 177 KSP Residual norm 3.347747326572e+00 178 KSP Residual norm 3.284593224201e+00 179 KSP Residual norm 3.455160584666e+00 180 KSP Residual norm 3.586365311927e+00 181 KSP Residual norm 3.672646157861e+00 182 KSP Residual norm 3.950244935421e+00 183 KSP Residual norm 4.052887946591e+00 184 KSP Residual norm 4.394872289182e+00 185 KSP Residual norm 4.476978020476e+00 186 KSP Residual norm 4.593933624553e+00 187 KSP Residual norm 4.611985272892e+00 188 KSP Residual norm 4.606459720409e+00 189 KSP Residual norm 5.269647116561e+00 190 KSP Residual norm 6.083893100946e+00 191 KSP Residual norm 7.773739984400e+00 192 KSP Residual norm 9.989928413155e+00 193 KSP Residual norm 1.537749526767e+01 194 KSP Residual norm 2.890414972381e+01 195 KSP Residual norm 2.974799428826e+02 196 KSP Residual norm 3.635966828764e+01 197 KSP Residual norm 1.762731221605e+01 198 KSP Residual norm 1.164273769733e+01 199 KSP Residual norm 9.019469345259e+00 200 KSP Residual norm 6.913109117347e+00 201 KSP Residual norm 5.588270083137e+00 202 KSP Residual norm 4.576519825955e+00 203 KSP Residual norm 3.884400811610e+00 204 KSP Residual norm 3.249209365032e+00 205 KSP Residual norm 2.673978005193e+00 206 KSP Residual norm 2.369977340966e+00 207 KSP Residual norm 2.118247668766e+00 208 KSP Residual norm 1.937607527910e+00 209 KSP Residual norm 1.980074485261e+00 210 KSP Residual norm 1.921212751183e+00 211 KSP Residual norm 2.062339105246e+00 212 KSP Residual norm 2.136142986266e+00 213 KSP Residual norm 2.380284093701e+00 214 KSP Residual norm 2.661293862963e+00 215 KSP Residual norm 3.173066017643e+00 216 KSP Residual norm 3.798998878351e+00 217 KSP Residual norm 4.989097707994e+00 218 KSP Residual norm 6.893692383949e+00 219 KSP Residual norm 1.099311880051e+01 220 KSP Residual norm 2.749385851255e+01 221 KSP Residual norm 6.197742131334e+01 222 KSP Residual norm 1.477649866377e+01 223 KSP Residual norm 8.325304201197e+00 224 KSP Residual norm 6.000585086682e+00 225 KSP Residual norm 4.638571244039e+00 226 KSP Residual norm 3.880549479683e+00 227 KSP Residual norm 3.083803454559e+00 228 KSP Residual norm 2.748970488901e+00 229 KSP Residual norm 2.227017467768e+00 230 KSP Residual norm 1.842506414975e+00 231 KSP Residual norm 1.603234360981e+00 232 KSP Residual norm 1.481553936666e+00 233 KSP Residual norm 1.447592607945e+00 234 KSP Residual norm 1.477787314498e+00 235 KSP Residual norm 1.422645508054e+00 236 KSP Residual norm 1.415635862631e+00 237 KSP Residual norm 1.476213542764e+00 238 KSP Residual norm 1.573573638415e+00 239 KSP Residual norm 1.695972729366e+00 240 KSP Residual norm 1.834108656750e+00 241 KSP Residual norm 1.913845853480e+00 242 KSP Residual norm 2.221452339726e+00 243 KSP Residual norm 2.480841154290e+00 244 KSP Residual norm 3.278209059086e+00 245 KSP Residual norm 4.469775749563e+00 246 KSP Residual norm 7.369025438648e+00 247 KSP Residual norm 2.015825567064e+01 248 KSP Residual norm 2.591394889715e+01 249 KSP Residual norm 7.888573107010e+00 250 KSP Residual norm 4.624724822571e+00 251 KSP Residual norm 3.129249355170e+00 252 KSP Residual norm 2.292125454710e+00 253 KSP Residual norm 1.967153808472e+00 254 KSP Residual norm 1.594704790192e+00 255 KSP Residual norm 1.481902955745e+00 256 KSP Residual norm 1.275643116270e+00 257 KSP Residual norm 1.195798391520e+00 258 KSP Residual norm 1.069002974355e+00 259 KSP Residual norm 1.014876919030e+00 260 KSP Residual norm 9.864926074190e-01 261 KSP Residual norm 9.750733932493e-01 262 KSP Residual norm 9.913301141013e-01 263 KSP Residual norm 1.015726634560e+00 264 KSP Residual norm 1.089056745839e+00 265 KSP Residual norm 1.142285424434e+00 266 KSP Residual norm 1.293847854058e+00 267 KSP Residual norm 1.388741769162e+00 268 KSP Residual norm 1.680696491094e+00 269 KSP Residual norm 2.035382672397e+00 270 KSP Residual norm 2.479563321333e+00 271 KSP Residual norm 3.289736118150e+00 272 KSP Residual norm 4.701582279175e+00 273 KSP Residual norm 9.147919655552e+00 274 KSP Residual norm 3.302975300408e+02 275 KSP Residual norm 9.502454028624e+00 276 KSP Residual norm 4.632783612480e+00 277 KSP Residual norm 3.041753974505e+00 278 KSP Residual norm 2.167645144669e+00 279 KSP Residual norm 1.690398677942e+00 280 KSP Residual norm 1.427372354918e+00 281 KSP Residual norm 1.224546515781e+00 282 KSP Residual norm 1.059030526558e+00 283 KSP Residual norm 9.356192704728e-01 284 KSP Residual norm 8.430824611658e-01 285 KSP Residual norm 7.948466200625e-01 286 KSP Residual norm 7.217834570859e-01 287 KSP Residual norm 6.875572936954e-01 288 KSP Residual norm 6.740394982241e-01 289 KSP Residual norm 6.614785815826e-01 290 KSP Residual norm 6.820296371640e-01 291 KSP Residual norm 7.023521042089e-01 292 KSP Residual norm 7.694504339904e-01 293 KSP Residual norm 8.662285351228e-01 294 KSP Residual norm 1.015446362205e+00 295 KSP Residual norm 1.240325729049e+00 296 KSP Residual norm 1.564298672709e+00 297 KSP Residual norm 2.129687004038e+00 298 KSP Residual norm 3.219523330332e+00 299 KSP Residual norm 6.509688406673e+00 300 KSP Residual norm 1.059514870178e+02 301 KSP Residual norm 7.290282492051e+00 302 KSP Residual norm 3.528445351393e+00 303 KSP Residual norm 2.431039404027e+00 304 KSP Residual norm 1.907514572359e+00 305 KSP Residual norm 1.547788342465e+00 306 KSP Residual norm 1.360785309981e+00 307 KSP Residual norm 1.212628142251e+00 308 KSP Residual norm 1.097947558810e+00 309 KSP Residual norm 1.020367232340e+00 310 KSP Residual norm 9.539088021314e-01 311 KSP Residual norm 8.986707825358e-01 312 KSP Residual norm 8.492324450542e-01 313 KSP Residual norm 8.100938058260e-01 314 KSP Residual norm 7.784309729363e-01 315 KSP Residual norm 7.494544905870e-01 316 KSP Residual norm 7.359232422623e-01 317 KSP Residual norm 7.016597885043e-01 318 KSP Residual norm 7.036384300266e-01 319 KSP Residual norm 6.766699816586e-01 320 KSP Residual norm 6.956040820343e-01 321 KSP Residual norm 6.859171120870e-01 322 KSP Residual norm 7.052212411776e-01 323 KSP Residual norm 7.389596374290e-01 324 KSP Residual norm 7.617632809602e-01 325 KSP Residual norm 8.730317809865e-01 326 KSP Residual norm 9.936596969828e-01 327 KSP Residual norm 1.230689692631e+00 328 KSP Residual norm 1.603265836714e+00 329 KSP Residual norm 2.173606016695e+00 330 KSP Residual norm 3.587099129239e+00 331 KSP Residual norm 1.021468669184e+01 332 KSP Residual norm 1.223105978574e+01 333 KSP Residual norm 3.827533273344e+00 334 KSP Residual norm 2.288092451732e+00 335 KSP Residual norm 1.589154431509e+00 336 KSP Residual norm 1.239830036788e+00 337 KSP Residual norm 1.017560150119e+00 338 KSP Residual norm 8.289995229267e-01 339 KSP Residual norm 7.271152156759e-01 340 KSP Residual norm 6.444416416052e-01 341 KSP Residual norm 5.943866929597e-01 342 KSP Residual norm 5.574518297952e-01 343 KSP Residual norm 5.003301656438e-01 344 KSP Residual norm 4.807888266936e-01 345 KSP Residual norm 4.549831040803e-01 346 KSP Residual norm 4.362223854399e-01 347 KSP Residual norm 4.375462346723e-01 348 KSP Residual norm 4.531839448489e-01 349 KSP Residual norm 4.753334323455e-01 350 KSP Residual norm 5.210095467591e-01 351 KSP Residual norm 5.828102484003e-01 352 KSP Residual norm 6.804829707546e-01 353 KSP Residual norm 8.058411982053e-01 354 KSP Residual norm 9.996119715009e-01 355 KSP Residual norm 1.276702375403e+00 356 KSP Residual norm 1.832040692009e+00 357 KSP Residual norm 3.243768043433e+00 358 KSP Residual norm 1.610804428409e+01 359 KSP Residual norm 5.555557573156e+00 360 KSP Residual norm 2.374276552977e+00 361 KSP Residual norm 1.528052236717e+00 362 KSP Residual norm 1.097013998586e+00 363 KSP Residual norm 8.440981654511e-01 364 KSP Residual norm 6.826972602650e-01 365 KSP Residual norm 5.565012325790e-01 366 KSP Residual norm 4.714467345686e-01 367 KSP Residual norm 3.923019096643e-01 368 KSP Residual norm 3.340982274880e-01 369 KSP Residual norm 2.926528851176e-01 370 KSP Residual norm 2.682531817351e-01 371 KSP Residual norm 2.630378002324e-01 372 KSP Residual norm 2.794560685794e-01 373 KSP Residual norm 3.046474040608e-01 374 KSP Residual norm 3.658621086502e-01 375 KSP Residual norm 4.428184000462e-01 376 KSP Residual norm 5.743731158276e-01 377 KSP Residual norm 7.682059065090e-01 378 KSP Residual norm 1.107953978258e+00 379 KSP Residual norm 1.965364103473e+00 380 KSP Residual norm 6.715845152695e+00 381 KSP Residual norm 4.659637818149e+00 382 KSP Residual norm 1.730355832127e+00 383 KSP Residual norm 1.088478776520e+00 384 KSP Residual norm 7.600445232946e-01 385 KSP Residual norm 5.718374793944e-01 386 KSP Residual norm 4.666536566012e-01 387 KSP Residual norm 3.685096570229e-01 388 KSP Residual norm 3.112598456663e-01 389 KSP Residual norm 2.472979135222e-01 390 KSP Residual norm 2.287255484415e-01 391 KSP Residual norm 2.063313330458e-01 392 KSP Residual norm 2.053210749931e-01 393 KSP Residual norm 2.038452377879e-01 394 KSP Residual norm 2.222349769177e-01 395 KSP Residual norm 2.437508084036e-01 396 KSP Residual norm 2.766463753753e-01 397 KSP Residual norm 3.341173878766e-01 398 KSP Residual norm 4.148236846807e-01 399 KSP Residual norm 5.470888493557e-01 400 KSP Residual norm 7.884009876324e-01 401 KSP Residual norm 1.293009485840e+00 402 KSP Residual norm 3.844905591845e+00 403 KSP Residual norm 4.263345123401e+00 404 KSP Residual norm 1.379186686047e+00 405 KSP Residual norm 8.102229499631e-01 406 KSP Residual norm 5.744245090822e-01 407 KSP Residual norm 4.682449805828e-01 408 KSP Residual norm 3.856702277443e-01 409 KSP Residual norm 3.523873755167e-01 410 KSP Residual norm 3.154841484963e-01 411 KSP Residual norm 2.910006527249e-01 412 KSP Residual norm 2.500460616697e-01 413 KSP Residual norm 2.272606694885e-01 414 KSP Residual norm 1.977420024472e-01 415 KSP Residual norm 1.820172864124e-01 416 KSP Residual norm 1.589990174223e-01 417 KSP Residual norm 1.548915235267e-01 418 KSP Residual norm 1.480784815174e-01 419 KSP Residual norm 1.621114784399e-01 420 KSP Residual norm 1.730555097568e-01 421 KSP Residual norm 2.130743358336e-01 422 KSP Residual norm 2.638014188432e-01 423 KSP Residual norm 3.445803180888e-01 424 KSP Residual norm 4.951723206292e-01 425 KSP Residual norm 8.121992390161e-01 426 KSP Residual norm 2.175594170203e+00 427 KSP Residual norm 3.356372638350e+00 428 KSP Residual norm 9.349224409965e-01 429 KSP Residual norm 5.591134684035e-01 430 KSP Residual norm 3.764736953542e-01 431 KSP Residual norm 3.016374169015e-01 432 KSP Residual norm 2.384482410014e-01 433 KSP Residual norm 2.046501298741e-01 434 KSP Residual norm 1.748661603032e-01 435 KSP Residual norm 1.574580721268e-01 436 KSP Residual norm 1.430530818837e-01 437 KSP Residual norm 1.340186686630e-01 438 KSP Residual norm 1.288906398895e-01 439 KSP Residual norm 1.187147742857e-01 440 KSP Residual norm 1.153639116503e-01 441 KSP Residual norm 1.103840643526e-01 442 KSP Residual norm 1.138852450752e-01 443 KSP Residual norm 1.135259707429e-01 444 KSP Residual norm 1.245765087351e-01 445 KSP Residual norm 1.394570443339e-01 446 KSP Residual norm 1.679655599867e-01 447 KSP Residual norm 2.181801485230e-01 448 KSP Residual norm 3.262173947277e-01 449 KSP Residual norm 5.694450590801e-01 450 KSP Residual norm 2.215193879070e+00 451 KSP Residual norm 1.252690379244e+00 452 KSP Residual norm 4.903551613974e-01 453 KSP Residual norm 2.965823343594e-01 454 KSP Residual norm 2.130915224108e-01 455 KSP Residual norm 1.563221250055e-01 456 KSP Residual norm 1.312058011699e-01 457 KSP Residual norm 9.984002573751e-02 458 KSP Residual norm 8.641024216591e-02 459 KSP Residual norm 7.004186767604e-02 460 KSP Residual norm 6.263999910797e-02 461 KSP Residual norm 5.886471633561e-02 462 KSP Residual norm 6.028145763933e-02 463 KSP Residual norm 6.521091716443e-02 464 KSP Residual norm 7.669906885751e-02 465 KSP Residual norm 9.210762136084e-02 466 KSP Residual norm 1.156735192458e-01 467 KSP Residual norm 1.484023571602e-01 468 KSP Residual norm 2.062407305707e-01 469 KSP Residual norm 3.374084811670e-01 470 KSP Residual norm 8.339092118099e-01 471 KSP Residual norm 1.909240551637e+00 472 KSP Residual norm 4.456439104035e-01 473 KSP Residual norm 2.459519008534e-01 474 KSP Residual norm 1.663126556845e-01 475 KSP Residual norm 1.216357074497e-01 476 KSP Residual norm 9.378717731045e-02 477 KSP Residual norm 7.541224066232e-02 478 KSP Residual norm 6.252004345033e-02 479 KSP Residual norm 5.305245916041e-02 480 KSP Residual norm 4.662177207794e-02 481 KSP Residual norm 4.295841429778e-02 482 KSP Residual norm 4.025100460743e-02 483 KSP Residual norm 4.462514403585e-02 484 KSP Residual norm 4.885217265613e-02 485 KSP Residual norm 5.952497634169e-02 486 KSP Residual norm 7.319478172960e-02 487 KSP Residual norm 9.392837896087e-02 488 KSP Residual norm 1.260906689861e-01 489 KSP Residual norm 1.870579559969e-01 490 KSP Residual norm 3.447108451623e-01 491 KSP Residual norm 1.877131728824e+00 492 KSP Residual norm 5.471433125167e-01 493 KSP Residual norm 2.387241791993e-01 494 KSP Residual norm 1.514990340739e-01 495 KSP Residual norm 1.104165198382e-01 496 KSP Residual norm 8.318419791745e-02 497 KSP Residual norm 6.737340006520e-02 498 KSP Residual norm 5.760777636327e-02 499 KSP Residual norm 4.978474179456e-02 500 KSP Residual norm 4.426479049811e-02 501 KSP Residual norm 3.935295361903e-02 502 KSP Residual norm 3.685240912422e-02 503 KSP Residual norm 3.481672445837e-02 504 KSP Residual norm 3.380269688483e-02 505 KSP Residual norm 3.354991051490e-02 506 KSP Residual norm 3.475090611328e-02 507 KSP Residual norm 3.840717260825e-02 508 KSP Residual norm 4.307486426672e-02 509 KSP Residual norm 5.107369705658e-02 510 KSP Residual norm 6.360866676050e-02 511 KSP Residual norm 8.774844606241e-02 512 KSP Residual norm 1.323506848400e-01 513 KSP Residual norm 2.735223126120e-01 514 KSP Residual norm 6.087575951002e+00 515 KSP Residual norm 3.001903380170e-01 516 KSP Residual norm 1.441412278268e-01 517 KSP Residual norm 9.422479215066e-02 518 KSP Residual norm 6.788299040267e-02 519 KSP Residual norm 5.177347794475e-02 520 KSP Residual norm 4.145906536531e-02 521 KSP Residual norm 3.554733767830e-02 522 KSP Residual norm 3.134566845922e-02 523 KSP Residual norm 2.826993833647e-02 524 KSP Residual norm 2.579444541918e-02 525 KSP Residual norm 2.381649920201e-02 526 KSP Residual norm 2.309651590641e-02 527 KSP Residual norm 2.284516331076e-02 528 KSP Residual norm 2.368659981360e-02 529 KSP Residual norm 2.628716565806e-02 530 KSP Residual norm 2.948858070108e-02 531 KSP Residual norm 3.686188152639e-02 532 KSP Residual norm 4.728281670016e-02 533 KSP Residual norm 6.995096167442e-02 534 KSP Residual norm 1.101993534905e-01 535 KSP Residual norm 2.667290315583e-01 536 KSP Residual norm 8.319073411603e-01 537 KSP Residual norm 1.640827053671e-01 538 KSP Residual norm 8.529184533619e-02 539 KSP Residual norm 5.952649683294e-02 540 KSP Residual norm 4.146251920660e-02 541 KSP Residual norm 3.426629657819e-02 542 KSP Residual norm 2.642187327214e-02 543 KSP Residual norm 2.343372998383e-02 544 KSP Residual norm 1.923076910649e-02 545 KSP Residual norm 1.806137377219e-02 546 KSP Residual norm 1.648518135085e-02 547 KSP Residual norm 1.655747160760e-02 548 KSP Residual norm 1.649969056710e-02 549 KSP Residual norm 1.781969579413e-02 550 KSP Residual norm 1.988062903141e-02 551 KSP Residual norm 2.286031260464e-02 552 KSP Residual norm 2.811476355708e-02 553 KSP Residual norm 3.310290846587e-02 554 KSP Residual norm 4.665554160533e-02 555 KSP Residual norm 6.187277653421e-02 556 KSP Residual norm 1.210315690289e-01 557 KSP Residual norm 4.077942967866e-01 558 KSP Residual norm 2.537546944715e-01 559 KSP Residual norm 9.335240370529e-02 560 KSP Residual norm 6.035886756068e-02 561 KSP Residual norm 4.038934097433e-02 562 KSP Residual norm 3.113611631593e-02 563 KSP Residual norm 2.423079227482e-02 564 KSP Residual norm 2.014267418470e-02 565 KSP Residual norm 1.698066552668e-02 566 KSP Residual norm 1.473548874923e-02 567 KSP Residual norm 1.315154772659e-02 568 KSP Residual norm 1.246997078351e-02 569 KSP Residual norm 1.194438542215e-02 570 KSP Residual norm 1.241915673819e-02 571 KSP Residual norm 1.332235959088e-02 572 KSP Residual norm 1.537658030481e-02 573 KSP Residual norm 1.714525116366e-02 574 KSP Residual norm 2.168390462072e-02 575 KSP Residual norm 2.640689196577e-02 576 KSP Residual norm 3.672812454338e-02 577 KSP Residual norm 5.090478839121e-02 578 KSP Residual norm 9.557742694214e-02 579 KSP Residual norm 4.521681910670e-01 580 KSP Residual norm 1.595150305803e-01 581 KSP Residual norm 6.682251203122e-02 582 KSP Residual norm 4.175752410211e-02 583 KSP Residual norm 3.109232656518e-02 584 KSP Residual norm 2.266357528373e-02 585 KSP Residual norm 1.897921521445e-02 586 KSP Residual norm 1.404268608830e-02 587 KSP Residual norm 1.270794360648e-02 588 KSP Residual norm 9.900479789554e-03 589 KSP Residual norm 9.325675811948e-03 590 KSP Residual norm 7.886291816865e-03 591 KSP Residual norm 7.917405344611e-03 592 KSP Residual norm 7.791702665369e-03 593 KSP Residual norm 8.647029519824e-03 594 KSP Residual norm 1.006015400723e-02 595 KSP Residual norm 1.246962245876e-02 596 KSP Residual norm 1.640668300102e-02 597 KSP Residual norm 2.287801552701e-02 598 KSP Residual norm 3.767474978357e-02 599 KSP Residual norm 8.867233108428e-02 600 KSP Residual norm 3.085206971131e-01 601 KSP Residual norm 5.607965991614e-02 602 KSP Residual norm 2.957122223094e-02 603 KSP Residual norm 2.028724956000e-02 604 KSP Residual norm 1.440911952589e-02 605 KSP Residual norm 1.140146402303e-02 606 KSP Residual norm 9.060167875977e-03 607 KSP Residual norm 7.551115383461e-03 608 KSP Residual norm 6.552981340725e-03 609 KSP Residual norm 5.823724327440e-03 610 KSP Residual norm 5.601881301994e-03 611 KSP Residual norm 5.472350036353e-03 612 KSP Residual norm 6.059565352851e-03 613 KSP Residual norm 6.740847354959e-03 614 KSP Residual norm 8.901714025058e-03 615 KSP Residual norm 1.098398693307e-02 616 KSP Residual norm 1.590542001358e-02 617 KSP Residual norm 2.202152539578e-02 618 KSP Residual norm 4.191333691447e-02 619 KSP Residual norm 1.546359152389e-01 620 KSP Residual norm 8.478636562828e-02 621 KSP Residual norm 3.097581093645e-02 622 KSP Residual norm 2.131289597319e-02 623 KSP Residual norm 1.351541143719e-02 624 KSP Residual norm 1.107551270187e-02 625 KSP Residual norm 7.729871641813e-03 626 KSP Residual norm 6.511983827072e-03 627 KSP Residual norm 5.020631509466e-03 628 KSP Residual norm 4.582790779343e-03 629 KSP Residual norm 4.043940342456e-03 630 KSP Residual norm 4.014366625007e-03 631 KSP Residual norm 4.045982380594e-03 632 KSP Residual norm 4.390469348343e-03 633 KSP Residual norm 5.116701175534e-03 634 KSP Residual norm 6.329415599988e-03 635 KSP Residual norm 8.389356414716e-03 636 KSP Residual norm 1.232231742064e-02 637 KSP Residual norm 1.931781908786e-02 638 KSP Residual norm 4.789009964912e-02 639 KSP Residual norm 1.768039114570e-01 640 KSP Residual norm 3.139083381269e-02 641 KSP Residual norm 1.602820954600e-02 642 KSP Residual norm 1.155528142239e-02 643 KSP Residual norm 7.697747685757e-03 644 KSP Residual norm 6.211640404308e-03 645 KSP Residual norm 4.826637253968e-03 646 KSP Residual norm 4.079766427684e-03 647 KSP Residual norm 3.725741209137e-03 648 KSP Residual norm 3.419824929714e-03 649 KSP Residual norm 3.370874710259e-03 650 KSP Residual norm 3.428718531403e-03 651 KSP Residual norm 3.666273764051e-03 652 KSP Residual norm 3.936516596772e-03 653 KSP Residual norm 4.592260798818e-03 654 KSP Residual norm 5.335860848817e-03 655 KSP Residual norm 6.750669049346e-03 656 KSP Residual norm 9.246263445839e-03 657 KSP Residual norm 1.330264020696e-02 658 KSP Residual norm 2.669573248953e-02 659 KSP Residual norm 2.318627998309e-01 660 KSP Residual norm 3.437356035380e-02 661 KSP Residual norm 1.523632526380e-02 662 KSP Residual norm 1.018108637135e-02 663 KSP Residual norm 6.742372323868e-03 664 KSP Residual norm 5.279834402581e-03 665 KSP Residual norm 3.871718720338e-03 666 KSP Residual norm 3.289766577009e-03 667 KSP Residual norm 2.686874367767e-03 668 KSP Residual norm 2.526590310217e-03 669 KSP Residual norm 2.367642312765e-03 670 KSP Residual norm 2.533924212611e-03 671 KSP Residual norm 2.523507302805e-03 672 KSP Residual norm 2.892660755493e-03 673 KSP Residual norm 3.043426984041e-03 674 KSP Residual norm 4.121459997757e-03 675 KSP Residual norm 4.900694462545e-03 676 KSP Residual norm 8.211248722237e-03 677 KSP Residual norm 1.170545834343e-02 678 KSP Residual norm 3.978764864867e-02 679 KSP Residual norm 4.407994341464e-02 680 KSP Residual norm 1.483814178998e-02 681 KSP Residual norm 7.537736589253e-03 682 KSP Residual norm 5.651162113786e-03 683 KSP Residual norm 3.872300389023e-03 684 KSP Residual norm 3.192237065955e-03 685 KSP Residual norm 2.394078749905e-03 686 KSP Residual norm 2.164956750038e-03 687 KSP Residual norm 1.804022344829e-03 688 KSP Residual norm 1.847346886812e-03 689 KSP Residual norm 1.723467483206e-03 690 KSP Residual norm 1.967757529993e-03 691 KSP Residual norm 2.086597398366e-03 692 KSP Residual norm 2.434111143472e-03 693 KSP Residual norm 2.946185038333e-03 694 KSP Residual norm 3.556428562894e-03 695 KSP Residual norm 4.887317554086e-03 696 KSP Residual norm 6.725934282793e-03 697 KSP Residual norm 1.223686993527e-02 698 KSP Residual norm 4.184113919447e-02 699 KSP Residual norm 2.823972407986e-02 700 KSP Residual norm 9.924825991767e-03 701 KSP Residual norm 6.565592096704e-03 702 KSP Residual norm 4.177035956563e-03 703 KSP Residual norm 3.460710769210e-03 704 KSP Residual norm 2.430658166360e-03 705 KSP Residual norm 2.223155238125e-03 706 KSP Residual norm 1.664265768976e-03 707 KSP Residual norm 1.594059399686e-03 708 KSP Residual norm 1.246033426596e-03 709 KSP Residual norm 1.297588585314e-03 710 KSP Residual norm 1.176777657617e-03 711 KSP Residual norm 1.492093197340e-03 712 KSP Residual norm 1.552410669269e-03 713 KSP Residual norm 2.350621105445e-03 714 KSP Residual norm 2.855719386834e-03 715 KSP Residual norm 5.245561998477e-03 716 KSP Residual norm 9.338415793959e-03 717 KSP Residual norm 1.484364940678e-01 718 KSP Residual norm 1.120839346951e-02 719 KSP Residual norm 5.518874184172e-03 720 KSP Residual norm 3.337383477022e-03 721 KSP Residual norm 2.312990517108e-03 722 KSP Residual norm 1.813966664413e-03 723 KSP Residual norm 1.345086316375e-03 724 KSP Residual norm 1.263146623715e-03 725 KSP Residual norm 9.974203480717e-04 726 KSP Residual norm 1.056680459933e-03 727 KSP Residual norm 9.227541419008e-04 728 KSP Residual norm 1.157005615321e-03 729 KSP Residual norm 1.174166824055e-03 730 KSP Residual norm 1.520696476778e-03 731 KSP Residual norm 1.685644444325e-03 732 KSP Residual norm 2.406482862545e-03 733 KSP Residual norm 3.047471165710e-03 734 KSP Residual norm 5.573797455760e-03 735 KSP Residual norm 1.020875102686e-02 736 KSP Residual norm 8.434702783377e-02 737 KSP Residual norm 8.078107481134e-03 738 KSP Residual norm 5.101015068228e-03 739 KSP Residual norm 2.833175887278e-03 740 KSP Residual norm 2.516525099907e-03 741 KSP Residual norm 1.579117115962e-03 742 KSP Residual norm 1.541594094746e-03 743 KSP Residual norm 1.043868691488e-03 744 KSP Residual norm 1.057520835616e-03 745 KSP Residual norm 8.404231106482e-04 746 KSP Residual norm 8.806791689197e-04 747 KSP Residual norm 8.375929885676e-04 748 KSP Residual norm 8.198164809986e-04 749 KSP Residual norm 9.551250323850e-04 750 KSP Residual norm 9.368798639821e-04 751 KSP Residual norm 1.396469434658e-03 752 KSP Residual norm 1.478883926503e-03 753 KSP Residual norm 2.720240572921e-03 754 KSP Residual norm 3.525254850258e-03 755 KSP Residual norm 1.074608355057e-02 756 KSP Residual norm 3.031622832705e-02 757 KSP Residual norm 6.642557275325e-03 758 KSP Residual norm 2.933235804019e-03 759 KSP Residual norm 2.401203461912e-03 760 KSP Residual norm 1.476537354330e-03 761 KSP Residual norm 1.447630714573e-03 762 KSP Residual norm 1.027446363258e-03 763 KSP Residual norm 1.171510354966e-03 764 KSP Residual norm 9.033878403286e-04 765 KSP Residual norm 1.135380225356e-03 766 KSP Residual norm 9.576268678741e-04 767 KSP Residual norm 1.299543593272e-03 768 KSP Residual norm 1.103584424064e-03 769 KSP Residual norm 1.501398871154e-03 770 KSP Residual norm 1.265113881580e-03 771 KSP Residual norm 1.718795181405e-03 772 KSP Residual norm 1.370845555061e-03 773 KSP Residual norm 1.815250456793e-03 774 KSP Residual norm 1.439484552158e-03 775 KSP Residual norm 1.860609605867e-03 776 KSP Residual norm 1.655281717485e-03 777 KSP Residual norm 2.347248723966e-03 778 KSP Residual norm 2.537929766123e-03 779 KSP Residual norm 4.319832300252e-03 780 KSP Residual norm 6.781814661080e-03 781 KSP Residual norm 3.631729569895e-02 782 KSP Residual norm 1.365403879144e-02 783 KSP Residual norm 6.183531395489e-03 784 KSP Residual norm 3.525154535851e-03 785 KSP Residual norm 2.697803158240e-03 786 KSP Residual norm 1.977964866387e-03 787 KSP Residual norm 1.544106986471e-03 788 KSP Residual norm 1.229943330639e-03 789 KSP Residual norm 9.109005548413e-04 790 KSP Residual norm 8.824128349621e-04 791 KSP Residual norm 6.572084812792e-04 792 KSP Residual norm 7.913633698211e-04 793 KSP Residual norm 6.002824953249e-04 794 KSP Residual norm 8.914286274771e-04 795 KSP Residual norm 7.180216273658e-04 796 KSP Residual norm 1.216730551779e-03 797 KSP Residual norm 1.029358826089e-03 798 KSP Residual norm 1.934995738929e-03 799 KSP Residual norm 2.012102997796e-03 800 KSP Residual norm 4.496947435740e-03 801 KSP Residual norm 9.469446404726e-03 802 KSP Residual norm 2.005672880690e-02 803 KSP Residual norm 4.665545595412e-03 804 KSP Residual norm 3.030111676161e-03 805 KSP Residual norm 1.948198909682e-03 806 KSP Residual norm 1.526739248930e-03 807 KSP Residual norm 1.233330180609e-03 808 KSP Residual norm 9.737385219529e-04 809 KSP Residual norm 9.598659557150e-04 810 KSP Residual norm 7.078932935216e-04 811 KSP Residual norm 9.601779082080e-04 812 KSP Residual norm 6.328540560040e-04 813 KSP Residual norm 1.215486484945e-03 814 KSP Residual norm 6.707993703305e-04 815 KSP Residual norm 1.987022395801e-03 816 KSP Residual norm 8.336531343848e-04 817 KSP Residual norm 4.044704415415e-03 818 KSP Residual norm 1.297453501588e-03 819 KSP Residual norm 1.212136156381e-02 820 KSP Residual norm 4.811509891021e-03 821 KSP Residual norm 1.452451600919e-01 822 KSP Residual norm 8.100444243822e-03 823 KSP Residual norm 1.980105771653e-02 824 KSP Residual norm 8.441489129166e-03 825 KSP Residual norm 2.089261651467e-02 826 KSP Residual norm 6.534304572093e-02 827 KSP Residual norm 7.334828442609e-02 828 KSP Residual norm 6.078011229741e-03 829 KSP Residual norm 7.979157301055e-03 830 KSP Residual norm 3.514225423449e-03 831 KSP Residual norm 4.014742052816e-03 832 KSP Residual norm 2.755064018563e-03 833 KSP Residual norm 2.776912423627e-03 834 KSP Residual norm 2.246580074824e-03 835 KSP Residual norm 1.927773046629e-03 836 KSP Residual norm 1.820462560072e-03 837 KSP Residual norm 1.318584457913e-03 838 KSP Residual norm 1.517396316214e-03 839 KSP Residual norm 9.132950438033e-04 840 KSP Residual norm 1.393977873177e-03 841 KSP Residual norm 7.214193289168e-04 842 KSP Residual norm 1.576466162917e-03 843 KSP Residual norm 8.029975140276e-04 844 KSP Residual norm 2.180512259522e-03 845 KSP Residual norm 1.314169420564e-03 846 KSP Residual norm 4.010114954543e-03 847 KSP Residual norm 4.084461475099e-03 848 KSP Residual norm 6.257813418527e-02 849 KSP Residual norm 5.010510115230e-03 850 KSP Residual norm 3.828863855210e-03 851 KSP Residual norm 1.657536186388e-03 852 KSP Residual norm 1.622815758008e-03 853 KSP Residual norm 1.055930185096e-03 854 KSP Residual norm 9.918829899677e-04 855 KSP Residual norm 8.198982092776e-04 856 KSP Residual norm 7.639149994379e-04 857 KSP Residual norm 7.516781616361e-04 858 KSP Residual norm 7.029234825708e-04 859 KSP Residual norm 7.506147524111e-04 860 KSP Residual norm 6.867762546094e-04 861 KSP Residual norm 8.038333305582e-04 862 KSP Residual norm 7.186063715983e-04 863 KSP Residual norm 8.821507384282e-04 864 KSP Residual norm 7.059280622742e-04 865 KSP Residual norm 8.671683274510e-04 866 KSP Residual norm 6.184264865084e-04 867 KSP Residual norm 8.190375331395e-04 868 KSP Residual norm 5.253287858927e-04 869 KSP Residual norm 8.104164127941e-04 870 KSP Residual norm 5.312465545987e-04 871 KSP Residual norm 9.639131628729e-04 872 KSP Residual norm 7.250264821285e-04 873 KSP Residual norm 1.466142666703e-03 874 KSP Residual norm 1.323805918398e-03 875 KSP Residual norm 3.081777306752e-03 876 KSP Residual norm 4.906224731961e-03 877 KSP Residual norm 3.006561179757e-02 878 KSP Residual norm 3.444499350631e-03 879 KSP Residual norm 2.359087251587e-03 880 KSP Residual norm 1.273503818825e-03 881 KSP Residual norm 1.110953913197e-03 882 KSP Residual norm 7.272013841279e-04 883 KSP Residual norm 6.703201626504e-04 884 KSP Residual norm 4.917410266083e-04 885 KSP Residual norm 4.720213737407e-04 886 KSP Residual norm 4.003801780305e-04 887 KSP Residual norm 4.205853482337e-04 888 KSP Residual norm 4.263583009970e-04 889 KSP Residual norm 4.681723796495e-04 890 KSP Residual norm 5.635657209301e-04 891 KSP Residual norm 6.480456985906e-04 892 KSP Residual norm 8.596412235365e-04 893 KSP Residual norm 1.010076214649e-03 894 KSP Residual norm 1.500001137153e-03 895 KSP Residual norm 2.002283080688e-03 896 KSP Residual norm 3.218382831000e-03 897 KSP Residual norm 4.689333434249e-03 898 KSP Residual norm 8.334898235602e-03 899 KSP Residual norm 1.679902361887e-02 900 KSP Residual norm 4.497865234742e-02 901 KSP Residual norm 4.108356796628e-01 902 KSP Residual norm 1.170789701062e-01 903 KSP Residual norm 3.503790991189e-02 904 KSP Residual norm 3.701607964602e-02 905 KSP Residual norm 5.970583533442e-03 906 KSP Residual norm 9.909135436709e-03 907 KSP Residual norm 2.213119502507e-03 908 KSP Residual norm 5.038558935233e-03 909 KSP Residual norm 9.478899871906e-04 910 KSP Residual norm 2.665621421056e-03 911 KSP Residual norm 5.841037156891e-04 912 KSP Residual norm 1.512985573472e-03 913 KSP Residual norm 5.359749083660e-04 914 KSP Residual norm 9.381970567107e-04 915 KSP Residual norm 6.110801261384e-04 916 KSP Residual norm 7.000640334769e-04 917 KSP Residual norm 8.422389413270e-04 918 KSP Residual norm 7.429832702620e-04 919 KSP Residual norm 1.319578152343e-03 920 KSP Residual norm 1.064470411004e-03 921 KSP Residual norm 1.967165895731e-03 922 KSP Residual norm 1.663340000904e-03 923 KSP Residual norm 2.329916089582e-03 924 KSP Residual norm 2.677748288135e-03 925 KSP Residual norm 2.112798113054e-03 926 KSP Residual norm 4.894335268651e-03 927 KSP Residual norm 1.227126525393e-03 928 KSP Residual norm 1.260637716619e-02 929 KSP Residual norm 1.551102767590e-02 930 KSP Residual norm 4.477341734614e-01 931 KSP Residual norm 6.677673205529e-02 932 KSP Residual norm 1.757009601340e-01 933 KSP Residual norm 1.885805775746e-02 934 KSP Residual norm 3.313584828474e-03 935 KSP Residual norm 6.233331792059e-03 936 KSP Residual norm 6.085535578517e-04 937 KSP Residual norm 2.898197540124e-03 938 KSP Residual norm 6.805365135051e-04 939 KSP Residual norm 1.412588376940e-03 940 KSP Residual norm 8.588522502920e-04 941 KSP Residual norm 8.205635903476e-04 942 KSP Residual norm 1.321478669045e-03 943 KSP Residual norm 6.919155598052e-04 944 KSP Residual norm 3.761946101376e-03 945 KSP Residual norm 6.682614937099e-04 946 KSP Residual norm 1.061154324978e-02 947 KSP Residual norm 1.960106069529e-03 948 KSP Residual norm 3.345947338907e-03 949 KSP Residual norm 3.420353371737e-03 950 KSP Residual norm 2.376950162023e-03 951 KSP Residual norm 6.197653018675e-03 952 KSP Residual norm 3.419620640976e-03 953 KSP Residual norm 1.405165626324e-02 954 KSP Residual norm 4.127672849740e-02 955 KSP Residual norm 2.998882009006e-02 956 KSP Residual norm 1.104737636736e-02 957 KSP Residual norm 6.329231272288e-03 958 KSP Residual norm 9.014104527829e-03 959 KSP Residual norm 5.215772357478e-03 960 KSP Residual norm 1.334274028106e-02 961 KSP Residual norm 1.519074961392e-02 962 KSP Residual norm 2.106784657229e-02 963 KSP Residual norm 2.592056980695e-03 964 KSP Residual norm 3.774817938981e-03 965 KSP Residual norm 1.598374599084e-03 966 KSP Residual norm 1.956506161506e-03 967 KSP Residual norm 1.060876737557e-03 968 KSP Residual norm 1.214448333042e-03 969 KSP Residual norm 6.504023774646e-04 970 KSP Residual norm 7.780261166316e-04 971 KSP Residual norm 4.635550662917e-04 972 KSP Residual norm 6.882236385646e-04 973 KSP Residual norm 4.245856221420e-04 974 KSP Residual norm 8.097177842706e-04 975 KSP Residual norm 5.027027280334e-04 976 KSP Residual norm 1.179096284265e-03 977 KSP Residual norm 8.620182574997e-04 978 KSP Residual norm 2.186773983055e-03 979 KSP Residual norm 2.612395199275e-03 980 KSP Residual norm 3.676220817226e-02 981 KSP Residual norm 3.207185818839e-03 982 KSP Residual norm 2.200205946475e-03 983 KSP Residual norm 1.067698014176e-03 984 KSP Residual norm 1.103071435506e-03 985 KSP Residual norm 6.913324962448e-04 986 KSP Residual norm 7.999640739092e-04 987 KSP Residual norm 5.776304996897e-04 988 KSP Residual norm 6.467625312778e-04 989 KSP Residual norm 4.757252214598e-04 990 KSP Residual norm 4.808170980913e-04 991 KSP Residual norm 3.929260060406e-04 992 KSP Residual norm 3.355423894946e-04 993 KSP Residual norm 3.275473092657e-04 994 KSP Residual norm 2.424928028822e-04 995 KSP Residual norm 3.096061765837e-04 996 KSP Residual norm 2.223302519727e-04 997 KSP Residual norm 3.567778104548e-04 998 KSP Residual norm 2.799300703342e-04 999 KSP Residual norm 4.710805754426e-04 1000 KSP Residual norm 4.352867513777e-04 1001 KSP Residual norm 6.936860310398e-04 1002 KSP Residual norm 8.848875283625e-04 1003 KSP Residual norm 1.482858208881e-03 1004 KSP Residual norm 5.290068545988e-03 1005 KSP Residual norm 3.738374686611e-03 1006 KSP Residual norm 1.608256096336e-03 1007 KSP Residual norm 7.334203041515e-04 1008 KSP Residual norm 6.423727925604e-04 1009 KSP Residual norm 4.288426344499e-04 1010 KSP Residual norm 3.460187183886e-04 1011 KSP Residual norm 3.652484571279e-04 1012 KSP Residual norm 2.163328605363e-04 1013 KSP Residual norm 4.233556534155e-04 1014 KSP Residual norm 1.701334649046e-04 1015 KSP Residual norm 5.589195283650e-04 1016 KSP Residual norm 2.044619177793e-04 1017 KSP Residual norm 7.668463895115e-04 1018 KSP Residual norm 5.178403714401e-04 1019 KSP Residual norm 1.031241535411e-03 1020 KSP Residual norm 1.577547961261e-03 1021 KSP Residual norm 1.360137103260e-03 1022 KSP Residual norm 4.002584556401e-02 1023 KSP Residual norm 4.124208669086e-03 1024 KSP Residual norm 2.362047808531e-03 1025 KSP Residual norm 4.650448714489e-04 1026 KSP Residual norm 2.019859261700e-03 1027 KSP Residual norm 7.581181991370e-04 1028 KSP Residual norm 3.786943462756e-03 1029 KSP Residual norm 9.353097195376e-02 1030 KSP Residual norm 4.013129962668e-03 1031 KSP Residual norm 1.098530437387e-03 1032 KSP Residual norm 8.917700777992e-04 1033 KSP Residual norm 5.989442914146e-04 1034 KSP Residual norm 4.308853006140e-04 1035 KSP Residual norm 4.229686148923e-04 1036 KSP Residual norm 3.232929734243e-04 1037 KSP Residual norm 3.519364920292e-04 1038 KSP Residual norm 3.815210427143e-04 1039 KSP Residual norm 3.849612673188e-04 1040 KSP Residual norm 7.632666296246e-04 1041 KSP Residual norm 6.334674099818e-04 1042 KSP Residual norm 3.754946437575e-03 1043 KSP Residual norm 2.642739541720e-03 1044 KSP Residual norm 3.288579705741e-03 1045 KSP Residual norm 1.013056825541e-03 1046 KSP Residual norm 1.727932867915e-03 1047 KSP Residual norm 6.013357895430e-04 1048 KSP Residual norm 1.584944017943e-03 1049 KSP Residual norm 1.504791960642e-03 1050 KSP Residual norm 2.031520014501e-03 1051 KSP Residual norm 6.079530910515e-03 1052 KSP Residual norm 7.876830090568e-03 1053 KSP Residual norm 2.031483450182e-02 1054 KSP Residual norm 3.849239823581e-03 1055 KSP Residual norm 1.148086003362e-02 1056 KSP Residual norm 4.649960656310e-03 1057 KSP Residual norm 4.809027018652e-02 1058 KSP Residual norm 1.094231761093e-02 1059 KSP Residual norm 2.755745787346e-03 1060 KSP Residual norm 2.501489953403e-03 1061 KSP Residual norm 8.088590896072e-04 1062 KSP Residual norm 1.399431197582e-03 1063 KSP Residual norm 3.580963053298e-04 1064 KSP Residual norm 9.924655875568e-04 1065 KSP Residual norm 2.445653928740e-04 1066 KSP Residual norm 8.329716523308e-04 1067 KSP Residual norm 2.486933711327e-04 1068 KSP Residual norm 8.560077916427e-04 1069 KSP Residual norm 3.093120860489e-04 1070 KSP Residual norm 8.706905129284e-04 1071 KSP Residual norm 3.972629488433e-04 1072 KSP Residual norm 8.450673662456e-04 1073 KSP Residual norm 4.802819781717e-04 1074 KSP Residual norm 6.889188030808e-04 1075 KSP Residual norm 5.250064171254e-04 1076 KSP Residual norm 5.078939959155e-04 1077 KSP Residual norm 6.423025964619e-04 1078 KSP Residual norm 4.299815929982e-04 1079 KSP Residual norm 1.209094426315e-03 1080 KSP Residual norm 5.512410584958e-04 1081 KSP Residual norm 5.075266924291e-03 1082 KSP Residual norm 2.230933440010e-03 1083 KSP Residual norm 1.596073487007e-02 1084 KSP Residual norm 5.707396452492e-03 1085 KSP Residual norm 1.203634016521e-02 1086 KSP Residual norm 6.097164073533e-04 1087 KSP Residual norm 1.373553420062e-03 1088 KSP Residual norm 2.991589633589e-04 1089 KSP Residual norm 4.879277209845e-04 1090 KSP Residual norm 2.079038957452e-04 1091 KSP Residual norm 2.499439121823e-04 1092 KSP Residual norm 1.913452855876e-04 1093 KSP Residual norm 1.764719891185e-04 1094 KSP Residual norm 2.413790426957e-04 1095 KSP Residual norm 1.856380503580e-04 1096 KSP Residual norm 4.198324812320e-04 1097 KSP Residual norm 2.845691302264e-04 1098 KSP Residual norm 8.185086246164e-04 1099 KSP Residual norm 6.215127671701e-04 1100 KSP Residual norm 1.835850384892e-03 1101 KSP Residual norm 5.924569302292e-03 1102 KSP Residual norm 2.934532778884e-01 1103 KSP Residual norm 1.395924178970e-03 1104 KSP Residual norm 2.934487195633e-03 1105 KSP Residual norm 1.442755698879e-03 1106 KSP Residual norm 4.876590230834e-03 1107 KSP Residual norm 5.400972097751e-03 1108 KSP Residual norm 2.131905664961e-03 1109 KSP Residual norm 6.456033323071e-04 1110 KSP Residual norm 5.917168218653e-04 1111 KSP Residual norm 3.523319782977e-04 1112 KSP Residual norm 2.918219981859e-04 1113 KSP Residual norm 2.691198630478e-04 1114 KSP Residual norm 1.758844445952e-04 1115 KSP Residual norm 2.488349897141e-04 1116 KSP Residual norm 1.270404588495e-04 1117 KSP Residual norm 3.193529707966e-04 1118 KSP Residual norm 1.191185441699e-04 1119 KSP Residual norm 6.467634459332e-04 1120 KSP Residual norm 1.472960263069e-04 1121 KSP Residual norm 3.493332482429e-03 1122 KSP Residual norm 2.437293578751e-03 1123 KSP Residual norm 1.910636939834e-03 1124 KSP Residual norm 2.513255430189e-03 1125 KSP Residual norm 6.673140712314e-04 1126 KSP Residual norm 2.293035654688e-03 1127 KSP Residual norm 5.347838025413e-04 1128 KSP Residual norm 3.832091062635e-03 1129 KSP Residual norm 1.839341290407e-02 1130 KSP Residual norm 5.088197337712e-03 1131 KSP Residual norm 2.379299342267e-03 1132 KSP Residual norm 1.148862625266e-03 1133 KSP Residual norm 4.325594777691e-03 1134 KSP Residual norm 5.211668481171e-03 1135 KSP Residual norm 1.725075472189e-03 1136 KSP Residual norm 2.405317170018e-04 1137 KSP Residual norm 3.948225291030e-04 1138 KSP Residual norm 1.104521428150e-04 1139 KSP Residual norm 1.782428183620e-04 1140 KSP Residual norm 1.005679217898e-04 1141 KSP Residual norm 1.207124503275e-04 1142 KSP Residual norm 1.352413607240e-04 1143 KSP Residual norm 1.223728609146e-04 1144 KSP Residual norm 2.625903802537e-04 1145 KSP Residual norm 2.003552343556e-04 1146 KSP Residual norm 7.348252694289e-04 1147 KSP Residual norm 6.506920412215e-04 1148 KSP Residual norm 6.299615566822e-03 1149 KSP Residual norm 1.148275896455e-02 1150 KSP Residual norm 1.000485358445e-02 1151 KSP Residual norm 4.805193965173e-02 1152 KSP Residual norm 1.078544258240e-03 1153 KSP Residual norm 1.132733974842e-03 1154 KSP Residual norm 2.458236305070e-04 1155 KSP Residual norm 4.192267484311e-04 1156 KSP Residual norm 1.706485233805e-04 1157 KSP Residual norm 2.321700800615e-04 1158 KSP Residual norm 1.579392699379e-04 1159 KSP Residual norm 1.765399959141e-04 1160 KSP Residual norm 1.945702203469e-04 1161 KSP Residual norm 1.624117595492e-04 1162 KSP Residual norm 3.349798920727e-04 1163 KSP Residual norm 2.157614141943e-04 1164 KSP Residual norm 7.088447285876e-04 1165 KSP Residual norm 4.386426687362e-04 1166 KSP Residual norm 1.289752026238e-03 1167 KSP Residual norm 7.854759600886e-04 1168 KSP Residual norm 2.227280740358e-03 1169 KSP Residual norm 1.555664886442e-03 1170 KSP Residual norm 1.055811953622e-02 1171 KSP Residual norm 1.187838228966e-02 1172 KSP Residual norm 3.952035319236e-04 1173 KSP Residual norm 1.587418277320e-03 1174 KSP Residual norm 1.792659542907e-04 1175 KSP Residual norm 1.240800778498e-03 1176 KSP Residual norm 7.669275890616e-04 1177 KSP Residual norm 1.489727910347e-03 1178 KSP Residual norm 1.956233205798e-02 1179 KSP Residual norm 4.309083622252e-03 1180 KSP Residual norm 9.260824625698e-03 1181 KSP Residual norm 1.134906344214e-03 1182 KSP Residual norm 1.711145260772e-03 1183 KSP Residual norm 6.759892053803e-04 1184 KSP Residual norm 3.848469654908e-04 1185 KSP Residual norm 5.033528596854e-04 1186 KSP Residual norm 2.867743938215e-04 1187 KSP Residual norm 3.462317976766e-04 1188 KSP Residual norm 2.576772912744e-04 1189 KSP Residual norm 2.218071540996e-04 1190 KSP Residual norm 2.334472541181e-04 1191 KSP Residual norm 1.973435577125e-04 1192 KSP Residual norm 2.293959851188e-04 1193 KSP Residual norm 6.689676710953e-04 1194 KSP Residual norm 5.008547603430e-04 1195 KSP Residual norm 4.923545678710e-04 1196 KSP Residual norm 1.630515878574e-04 1197 KSP Residual norm 2.389975080835e-04 1198 KSP Residual norm 1.438229028859e-04 1199 KSP Residual norm 2.533896812306e-04 1200 KSP Residual norm 4.144641627057e-04 1201 KSP Residual norm 5.178719027910e-04 1202 KSP Residual norm 6.802162284586e-02 1203 KSP Residual norm 8.617033517299e-04 1204 KSP Residual norm 1.180419497687e-03 1205 KSP Residual norm 1.381472393514e-03 1206 KSP Residual norm 3.246762275789e-03 1207 KSP Residual norm 3.514797457212e-04 1208 KSP Residual norm 2.733985447960e-04 1209 KSP Residual norm 1.961671120123e-04 1210 KSP Residual norm 1.240574166690e-04 1211 KSP Residual norm 1.907991792195e-04 1212 KSP Residual norm 1.021903319462e-03 1213 KSP Residual norm 8.542435054879e-04 1214 KSP Residual norm 3.920941951221e-04 1215 KSP Residual norm 1.143148205316e-04 1216 KSP Residual norm 3.048318238089e-04 1217 KSP Residual norm 1.465993695608e-04 1218 KSP Residual norm 4.323740772322e-04 1219 KSP Residual norm 9.129424827574e-04 1220 KSP Residual norm 6.537810961127e-03 1221 KSP Residual norm 1.046055323812e-03 1222 KSP Residual norm 2.149195690467e-04 1223 KSP Residual norm 9.329689806734e-04 1224 KSP Residual norm 5.181555424120e-04 1225 KSP Residual norm 7.108868161021e-04 1226 KSP Residual norm 1.669671009444e-04 1227 KSP Residual norm 1.082362875239e-04 1228 KSP Residual norm 1.119542361768e-04 1229 KSP Residual norm 4.655245211851e-05 1230 KSP Residual norm 8.926566131132e-05 1231 KSP Residual norm 4.896377482991e-05 1232 KSP Residual norm 7.099369299893e-05 1233 KSP Residual norm 6.988574361410e-05 1234 KSP Residual norm 5.701192079092e-05 1235 KSP Residual norm 1.344790652403e-04 1236 KSP Residual norm 4.360567057437e-05 1237 KSP Residual norm 1.262531718030e-03 1238 KSP Residual norm 1.100154661408e-04 1239 KSP Residual norm 2.948688606861e-04 1240 KSP Residual norm 1.284667063323e-04 1241 KSP Residual norm 3.389344983379e-04 1242 KSP Residual norm 8.497921357121e-04 1243 KSP Residual norm 5.662316016489e-04 1244 KSP Residual norm 1.335800340278e-04 1245 KSP Residual norm 9.981341065753e-05 1246 KSP Residual norm 6.368485568476e-05 1247 KSP Residual norm 5.340481805454e-05 1248 KSP Residual norm 4.359541490178e-05 1249 KSP Residual norm 4.516848386203e-05 1250 KSP Residual norm 3.304045107301e-05 1251 KSP Residual norm 6.219436922910e-05 1252 KSP Residual norm 2.617314760080e-05 1253 KSP Residual norm 1.969749943245e-04 1254 KSP Residual norm 1.672238472331e-04 1255 KSP Residual norm 2.621342697243e-04 1256 KSP Residual norm 9.350596003770e-05 1257 KSP Residual norm 1.388246466815e-04 1258 KSP Residual norm 1.637942629147e-04 1259 KSP Residual norm 3.152399751474e-04 1260 KSP Residual norm 6.497177681306e-04 1261 KSP Residual norm 1.072610250175e-04 1262 KSP Residual norm 7.746536082713e-05 1263 KSP Residual norm 4.738654449066e-05 1264 KSP Residual norm 3.459379623308e-05 1265 KSP Residual norm 3.743683909491e-05 1266 KSP Residual norm 2.238425639866e-05 1267 KSP Residual norm 3.519026240652e-05 1268 KSP Residual norm 2.387278034958e-05 1269 KSP Residual norm 3.803825167261e-05 1270 KSP Residual norm 5.079374930957e-05 1271 KSP Residual norm 5.022365981693e-05 1272 KSP Residual norm 3.075487788115e-04 1273 KSP Residual norm 2.068236585156e-04 1274 KSP Residual norm 1.708988274643e-04 1275 KSP Residual norm 2.912308796824e-05 1276 KSP Residual norm 8.666868732317e-05 1277 KSP Residual norm 3.931264073788e-05 1278 KSP Residual norm 8.255943563966e-05 1279 KSP Residual norm 9.977576989067e-05 1280 KSP Residual norm 2.152674575696e-04 1281 KSP Residual norm 4.951718974858e-03 1282 KSP Residual norm 4.698124753702e-04 1283 KSP Residual norm 2.271250919694e-04 1284 KSP Residual norm 2.645421173850e-04 1285 KSP Residual norm 1.748954560804e-04 1286 KSP Residual norm 4.979388148452e-04 1287 KSP Residual norm 3.384483036627e-04 1288 KSP Residual norm 2.912390489668e-04 1289 KSP Residual norm 1.791812088895e-04 1290 KSP Residual norm 6.905027918038e-05 1291 KSP Residual norm 1.657987071310e-04 1292 KSP Residual norm 4.408734994431e-05 1293 KSP Residual norm 5.139368813374e-04 1294 KSP Residual norm 6.167328352396e-05 1295 KSP Residual norm 1.630768480030e-04 1296 KSP Residual norm 1.899905705259e-04 1297 KSP Residual norm 1.361553912644e-04 1298 KSP Residual norm 3.391297922274e-04 1299 KSP Residual norm 2.674246572382e-04 1300 KSP Residual norm 7.349566440544e-04 1301 KSP Residual norm 8.599399581569e-03 1302 KSP Residual norm 1.312191606561e-03 1303 KSP Residual norm 2.914829097402e-03 1304 KSP Residual norm 3.678194325972e-04 1305 KSP Residual norm 2.235758905726e-04 1306 KSP Residual norm 1.860824908042e-04 1307 KSP Residual norm 1.101125082326e-04 1308 KSP Residual norm 1.313030417986e-04 1309 KSP Residual norm 3.766201330694e-04 1310 KSP Residual norm 2.587113642841e-04 1311 KSP Residual norm 2.303382554509e-04 1312 KSP Residual norm 1.321367009503e-04 1313 KSP Residual norm 7.119542077648e-05 1314 KSP Residual norm 1.410342454037e-04 1315 KSP Residual norm 3.477106318288e-04 1316 KSP Residual norm 3.095507248866e-04 1317 KSP Residual norm 2.621621778945e-04 1318 KSP Residual norm 2.479465920753e-04 1319 KSP Residual norm 4.417000341460e-04 1320 KSP Residual norm 3.847517132818e-03 1321 KSP Residual norm 6.041089994423e-04 1322 KSP Residual norm 8.752004277712e-05 1323 KSP Residual norm 9.335436256766e-05 1324 KSP Residual norm 3.555926847863e-05 1325 KSP Residual norm 3.748435634070e-05 1326 KSP Residual norm 2.973990955260e-05 1327 KSP Residual norm 2.778976370104e-05 1328 KSP Residual norm 5.868391054718e-05 1329 KSP Residual norm 1.551212120101e-03 1330 KSP Residual norm 1.850073705648e-04 1331 KSP Residual norm 1.430919649560e-05 1332 KSP Residual norm 4.029177698263e-05 1333 KSP Residual norm 1.137303994831e-05 1334 KSP Residual norm 2.599846002588e-05 1335 KSP Residual norm 1.245711804070e-05 1336 KSP Residual norm 3.021551013421e-05 1337 KSP Residual norm 2.391072111287e-05 1338 KSP Residual norm 2.726064159918e-04 1339 KSP Residual norm 2.723098613074e-04 1340 KSP Residual norm 1.100338628320e-04 1341 KSP Residual norm 1.882380609414e-04 1342 KSP Residual norm 1.795697176633e-03 1343 KSP Residual norm 6.032942149127e-05 1344 KSP Residual norm 3.601950649443e-05 1345 KSP Residual norm 2.299512134135e-05 1346 KSP Residual norm 1.468450108857e-05 1347 KSP Residual norm 1.752259917279e-05 1348 KSP Residual norm 8.826218354785e-06 1349 KSP Residual norm 1.686935389507e-05 1350 KSP Residual norm 6.964849700250e-06 1351 KSP Residual norm 2.093433122842e-05 1352 KSP Residual norm 8.672616864175e-06 1353 KSP Residual norm 3.147314045718e-05 1354 KSP Residual norm 1.275706426401e-05 1355 KSP Residual norm 6.233541510692e-05 1356 KSP Residual norm 4.641174821081e-05 1357 KSP Residual norm 1.556365029499e-04 1358 KSP Residual norm 1.728997187518e-04 1359 KSP Residual norm 4.772721264908e-05 1360 KSP Residual norm 7.018663936086e-05 1361 KSP Residual norm 6.070863406571e-05 1362 KSP Residual norm 2.218522231516e-04 1363 KSP Residual norm 6.684121237350e-04 1364 KSP Residual norm 2.032556456100e-04 1365 KSP Residual norm 3.788263696396e-05 1366 KSP Residual norm 5.330204448513e-05 1367 KSP Residual norm 2.561571059595e-05 1368 KSP Residual norm 1.680726640834e-05 1369 KSP Residual norm 2.836160111265e-05 1370 KSP Residual norm 1.840366338962e-04 1371 KSP Residual norm 1.243623425633e-03 1372 KSP Residual norm 1.008945215411e-05 1373 KSP Residual norm 1.518195445301e-05 1374 KSP Residual norm 8.276406958461e-06 1375 KSP Residual norm 3.710288233468e-05 1376 KSP Residual norm 9.446929068191e-06 1377 KSP Residual norm 4.926122492014e-04 1378 KSP Residual norm 5.044850398207e-05 1379 KSP Residual norm 1.551691339053e-04 1380 KSP Residual norm 5.869159332028e-05 1381 KSP Residual norm 8.555854375748e-05 1382 KSP Residual norm 1.134284180101e-04 1383 KSP Residual norm 8.869196282427e-05 1384 KSP Residual norm 2.445830874972e-03 1385 KSP Residual norm 1.025674350947e-04 1386 KSP Residual norm 8.198264759370e-05 1387 KSP Residual norm 3.806235926412e-05 1388 KSP Residual norm 2.473853000318e-05 1389 KSP Residual norm 2.166737492559e-05 1390 KSP Residual norm 1.076787029848e-05 1391 KSP Residual norm 1.312789100938e-05 1392 KSP Residual norm 8.594701492333e-06 1393 KSP Residual norm 7.185295406700e-06 1394 KSP Residual norm 6.832625173862e-06 1395 KSP Residual norm 4.337877450833e-06 1396 KSP Residual norm 5.298848560618e-06 1397 KSP Residual norm 3.612661267987e-06 1398 KSP Residual norm 4.292882925845e-06 1399 KSP Residual norm 3.655993926203e-06 1400 KSP Residual norm 4.326354262663e-06 1401 KSP Residual norm 4.540441737298e-06 1402 KSP Residual norm 5.925558057254e-06 1403 KSP Residual norm 6.765779207794e-06 1404 KSP Residual norm 8.150647562372e-06 1405 KSP Residual norm 1.165821020272e-05 1406 KSP Residual norm 1.128531503248e-05 1407 KSP Residual norm 2.680088916529e-05 1408 KSP Residual norm 2.370784115377e-05 1409 KSP Residual norm 1.358405609421e-04 1410 KSP Residual norm 2.899700432413e-04 1411 KSP Residual norm 9.330915410609e-05 1412 KSP Residual norm 3.750792504004e-05 1413 KSP Residual norm 3.143947807283e-05 1414 KSP Residual norm 2.531555657038e-05 1415 KSP Residual norm 1.330550838670e-05 1416 KSP Residual norm 2.052063142066e-05 1417 KSP Residual norm 9.502171262124e-06 1418 KSP Residual norm 1.933259127850e-05 1419 KSP Residual norm 1.372516264170e-05 1420 KSP Residual norm 3.006322225759e-05 1421 KSP Residual norm 7.309576494311e-06 1422 KSP Residual norm 4.330733463787e-04 1423 KSP Residual norm 3.443829985398e-05 1424 KSP Residual norm 3.043261473545e-05 1425 KSP Residual norm 1.707114071763e-05 1426 KSP Residual norm 1.300646970361e-05 1427 KSP Residual norm 1.559820936240e-04 1428 KSP Residual norm 1.021548143906e-05 1429 KSP Residual norm 2.693514050414e-05 1430 KSP Residual norm 2.650010661762e-05 1431 KSP Residual norm 2.033277136622e-05 1432 KSP Residual norm 6.101552841600e-04 1433 KSP Residual norm 2.124451519353e-05 1434 KSP Residual norm 1.047746269827e-04 1435 KSP Residual norm 4.477469914619e-05 1436 KSP Residual norm 3.151234448568e-04 1437 KSP Residual norm 7.137493166113e-05 1438 KSP Residual norm 3.539426532010e-05 1439 KSP Residual norm 8.220156615087e-05 1440 KSP Residual norm 2.407550546558e-04 1441 KSP Residual norm 5.003615787218e-05 1442 KSP Residual norm 1.957911756463e-05 1443 KSP Residual norm 9.654354321708e-06 1444 KSP Residual norm 2.234574487467e-05 1445 KSP Residual norm 8.669676529759e-06 1446 KSP Residual norm 7.077126805075e-04 1447 KSP Residual norm 1.077260074667e-04 1448 KSP Residual norm 7.971082641604e-06 1449 KSP Residual norm 8.296922194462e-06 1450 KSP Residual norm 3.351447976935e-06 1451 KSP Residual norm 8.767117984891e-06 1452 KSP Residual norm 4.301745026460e-06 1453 KSP Residual norm 3.236627082604e-05 1454 KSP Residual norm 2.926367508347e-05 1455 KSP Residual norm 3.224420894308e-05 1456 KSP Residual norm 6.418833778931e-05 1457 KSP Residual norm 2.128927580131e-05 1458 KSP Residual norm 1.373383677520e-04 1459 KSP Residual norm 1.115526177506e-04 1460 KSP Residual norm 3.384674495479e-03 1461 KSP Residual norm 7.874692306244e-05 1462 KSP Residual norm 1.577602529828e-05 1463 KSP Residual norm 8.761504487859e-05 1464 KSP Residual norm 8.137917618611e-05 1465 KSP Residual norm 3.114086595093e-05 1466 KSP Residual norm 1.523320540994e-05 1467 KSP Residual norm 1.067970812350e-05 1468 KSP Residual norm 6.252276500415e-06 1469 KSP Residual norm 5.611355665039e-06 1470 KSP Residual norm 5.418789902614e-06 1471 KSP Residual norm 3.934713034219e-06 1472 KSP Residual norm 4.807155385102e-06 1473 KSP Residual norm 2.810881188565e-06 1474 KSP Residual norm 4.318496609123e-06 1475 KSP Residual norm 2.800527246934e-06 1476 KSP Residual norm 4.333148758996e-06 1477 KSP Residual norm 3.781042853028e-06 1478 KSP Residual norm 4.384953117351e-06 1479 KSP Residual norm 5.097088531745e-06 1480 KSP Residual norm 5.030606612807e-06 1481 KSP Residual norm 8.140190026334e-06 1482 KSP Residual norm 6.659374410971e-06 1483 KSP Residual norm 1.657285528711e-05 1484 KSP Residual norm 9.926691991681e-06 1485 KSP Residual norm 5.876870980280e-05 1486 KSP Residual norm 2.325860549298e-04 1487 KSP Residual norm 4.896529007264e-05 1488 KSP Residual norm 9.806614382330e-05 1489 KSP Residual norm 1.049979460872e-05 1490 KSP Residual norm 3.911615332407e-05 1491 KSP Residual norm 5.030530579763e-06 1492 KSP Residual norm 5.804641840176e-06 1493 KSP Residual norm 3.813944913581e-06 1494 KSP Residual norm 4.510461698802e-06 1495 KSP Residual norm 3.567846626902e-06 1496 KSP Residual norm 1.889916745463e-05 1497 KSP Residual norm 1.239760402320e-05 1498 KSP Residual norm 2.177430092705e-05 1499 KSP Residual norm 7.284239035165e-06 1500 KSP Residual norm 3.670721418135e-06 1501 KSP Residual norm 8.137062368963e-06 1502 KSP Residual norm 4.465081982890e-06 1503 KSP Residual norm 7.016229582425e-06 1504 KSP Residual norm 8.158438540982e-06 1505 KSP Residual norm 5.602036146399e-06 1506 KSP Residual norm 1.278730206036e-05 1507 KSP Residual norm 1.157981859337e-05 1508 KSP Residual norm 3.285888248807e-05 1509 KSP Residual norm 1.067426461881e-04 1510 KSP Residual norm 2.620271207368e-05 1511 KSP Residual norm 9.824708049581e-06 1512 KSP Residual norm 1.572625690880e-05 1513 KSP Residual norm 4.230061488487e-06 1514 KSP Residual norm 1.278930355822e-05 1515 KSP Residual norm 4.621169289247e-06 1516 KSP Residual norm 1.156850270833e-05 1517 KSP Residual norm 2.123626175462e-05 1518 KSP Residual norm 1.522273159555e-05 1519 KSP Residual norm 3.132813205480e-05 1520 KSP Residual norm 2.888752553930e-06 1521 KSP Residual norm 1.029068856922e-05 1522 KSP Residual norm 2.719688003559e-06 1523 KSP Residual norm 6.830801797160e-06 1524 KSP Residual norm 4.611886864773e-06 1525 KSP Residual norm 9.814636867439e-06 1526 KSP Residual norm 1.483881928038e-05 1527 KSP Residual norm 3.025871227710e-05 1528 KSP Residual norm 4.026301255277e-05 1529 KSP Residual norm 5.751702157118e-06 1530 KSP Residual norm 2.052149774753e-05 1531 KSP Residual norm 1.913955558606e-05 1532 KSP Residual norm 3.776136014928e-05 1533 KSP Residual norm 4.132196769867e-04 1534 KSP Residual norm 1.820211574422e-04 1535 KSP Residual norm 1.795270499960e-04 1536 KSP Residual norm 3.049059846064e-05 1537 KSP Residual norm 4.722176624447e-05 1538 KSP Residual norm 1.114832542173e-05 1539 KSP Residual norm 1.295442829676e-05 1540 KSP Residual norm 1.071023603169e-05 1541 KSP Residual norm 7.960085943029e-06 1542 KSP Residual norm 1.230502463262e-05 1543 KSP Residual norm 1.267229440827e-05 1544 KSP Residual norm 1.178979326345e-05 1545 KSP Residual norm 3.136895059183e-05 1546 KSP Residual norm 2.771393651962e-06 1547 KSP Residual norm 1.099772034714e-04 1548 KSP Residual norm 1.642396665702e-05 1549 KSP Residual norm 7.660958037203e-06 1550 KSP Residual norm 1.193008818622e-05 1551 KSP Residual norm 4.925944181012e-06 1552 KSP Residual norm 7.637318016312e-06 1553 KSP Residual norm 8.745758220175e-06 1554 KSP Residual norm 2.812925463690e-06 1555 KSP Residual norm 1.000869331598e-05 1556 KSP Residual norm 4.012054354856e-06 1557 KSP Residual norm 9.661660631525e-06 1558 KSP Residual norm 1.196789226737e-05 1559 KSP Residual norm 2.072598581423e-05 1560 KSP Residual norm 6.021479892860e-05 1561 KSP Residual norm 1.359770311105e-05 1562 KSP Residual norm 6.551159287630e-06 1563 KSP Residual norm 5.201234700803e-06 1564 KSP Residual norm 1.885822402154e-06 Linear solve converged due to CONVERGED_RTOL iterations 1564 KSP Object: 4 MPI processes type: groppcg maximum iterations=40000, initial guess is zero tolerances: relative=1e-06, absolute=1e-50, divergence=1e+06 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: 4 MPI processes type: gamg type is MULTIPLICATIVE, levels=4 cycles=v Cycles per PCApply=1 Using externally compute Galerkin coarse grid matrices GAMG specific options Threshold for dropping small values in graph on each level = -1. -1. -1. -1. Threshold scaling factor for each level not specified = 1. AGG specific options Number of levels to square graph 1 Number smoothing steps 1 Complexity: grid = 1.01439 operator = 1.03229 Coarse grid solver -- level 0 ------------------------------- KSP Object: (mg_coarse_) 4 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_coarse_) 4 MPI processes type: bjacobi number of blocks = 4 Local solver information for first block is in the following KSP and PC objects on rank 0: Use -mg_coarse_ksp_view ::ascii_info_detail to display information for all blocks KSP Object: (mg_coarse_sub_) 1 MPI process type: preonly maximum iterations=1, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_coarse_sub_) 1 MPI process type: lu out-of-place factorization tolerance for zero pivot 2.22045e-14 using diagonal shift on blocks to prevent zero pivot [INBLOCKS] matrix ordering: nd factor fill ratio given 5., needed 1. Factored matrix follows: Mat Object: (mg_coarse_sub_) 1 MPI process type: seqaijcusparse rows=19, cols=19 package used to perform factorization: cusparse total: nonzeros=361, allocated nonzeros=361 using I-node routines: found 4 nodes, limit used is 5 linear system matrix = precond matrix: Mat Object: (mg_coarse_sub_) 1 MPI process type: seqaijcusparse rows=19, cols=19 total: nonzeros=361, allocated nonzeros=361 total number of mallocs used during MatSetValues calls=0 not using I-node routines linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=19, cols=19 total: nonzeros=361, allocated nonzeros=361 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Down solver (pre-smoother) on level 1 ------------------------------- KSP Object: (mg_levels_1_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.214884, max 2.36372 eigenvalues provided (min 0.349763, max 2.14884) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_1_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=777, cols=777 total: nonzeros=207255, allocated nonzeros=207255 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 2 ------------------------------- KSP Object: (mg_levels_2_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.136436, max 1.50079 eigenvalues provided (min 0.555598, max 1.36436) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_2_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=10842, cols=10842 total: nonzeros=907022, allocated nonzeros=907022 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 3 ------------------------------- KSP Object: (mg_levels_3_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.523254, max 5.75579 eigenvalues provided (min 0.247422, max 5.23254) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_3_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=808996, cols=808996 total: nonzeros=34524680, allocated nonzeros=147207720 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=808996, cols=808996 total: nonzeros=34524680, allocated nonzeros=147207720 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines In petsc::solve(), after solution of Ax = b KSP Object: 4 MPI processes type: groppcg maximum iterations=40000, initial guess is zero tolerances: relative=1e-06, absolute=1e-50, divergence=1e+06 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: 4 MPI processes type: gamg type is MULTIPLICATIVE, levels=4 cycles=v Cycles per PCApply=1 Using externally compute Galerkin coarse grid matrices GAMG specific options Threshold for dropping small values in graph on each level = -1. -1. -1. -1. Threshold scaling factor for each level not specified = 1. AGG specific options Number of levels to square graph 1 Number smoothing steps 1 Complexity: grid = 1.01439 operator = 1.03229 Coarse grid solver -- level 0 ------------------------------- KSP Object: (mg_coarse_) 4 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_coarse_) 4 MPI processes type: bjacobi number of blocks = 4 Local solver information for first block is in the following KSP and PC objects on rank 0: Use -mg_coarse_ksp_view ::ascii_info_detail to display information for all blocks KSP Object: (mg_coarse_sub_) 1 MPI process type: preonly maximum iterations=1, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_coarse_sub_) 1 MPI process type: lu out-of-place factorization tolerance for zero pivot 2.22045e-14 using diagonal shift on blocks to prevent zero pivot [INBLOCKS] matrix ordering: nd factor fill ratio given 5., needed 1. Factored matrix follows: Mat Object: (mg_coarse_sub_) 1 MPI process type: seqaijcusparse rows=19, cols=19 package used to perform factorization: cusparse total: nonzeros=361, allocated nonzeros=361 using I-node routines: found 4 nodes, limit used is 5 linear system matrix = precond matrix: Mat Object: (mg_coarse_sub_) 1 MPI process type: seqaijcusparse rows=19, cols=19 total: nonzeros=361, allocated nonzeros=361 total number of mallocs used during MatSetValues calls=0 not using I-node routines linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=19, cols=19 total: nonzeros=361, allocated nonzeros=361 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Down solver (pre-smoother) on level 1 ------------------------------- KSP Object: (mg_levels_1_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.214884, max 2.36372 eigenvalues provided (min 0.349763, max 2.14884) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_1_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=777, cols=777 total: nonzeros=207255, allocated nonzeros=207255 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 2 ------------------------------- KSP Object: (mg_levels_2_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.136436, max 1.50079 eigenvalues provided (min 0.555598, max 1.36436) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_2_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=10842, cols=10842 total: nonzeros=907022, allocated nonzeros=907022 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 3 ------------------------------- KSP Object: (mg_levels_3_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.523254, max 5.75579 eigenvalues provided (min 0.247422, max 5.23254) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_3_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=808996, cols=808996 total: nonzeros=34524680, allocated nonzeros=147207720 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=808996, cols=808996 total: nonzeros=34524680, allocated nonzeros=147207720 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines **************************************************************************************************************************************************************** *** WIDEN YOUR WINDOW TO 160 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** **************************************************************************************************************************************************************** ------------------------------------------------------------------ PETSc Performance Summary: ------------------------------------------------------------------ argv0 on a named nid008505 with 4 processors, by cho Fri Apr 12 14:00:24 2024 Using 2 OpenMP threads Using Petsc Release Version 3.19.4, Jul 31, 2023 Max Max/Min Avg Total Time (sec): 7.684e+00 1.000 7.684e+00 Objects: 6.580e+02 1.000 6.580e+02 Flops: 1.673e+11 1.172 1.566e+11 6.262e+11 Flops/sec: 2.177e+10 1.172 2.037e+10 8.150e+10 MPI Msg Count: 8.531e+04 1.039 8.290e+04 3.316e+05 MPI Msg Len (bytes): 1.310e+09 1.163 1.474e+04 4.888e+09 MPI Reductions: 5.520e+02 1.000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 7.6838e+00 100.0% 6.2621e+11 100.0% 3.316e+05 100.0% 1.474e+04 100.0% 5.340e+02 96.7% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage cuBLAS Init 1 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxCreate 14 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxDestroy 12 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxSetUp 14 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxSetDevice 4 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxDuplicate 12 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxWaitForCtx 24 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxFork 27 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxJoin 27 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxSync 106599 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 11 0 0 0 0 11 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxMark 120 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 110 1.0 nan nan 0.00e+00 0.0 7.2e+02 4.0e+00 1.1e+02 1 0 0 0 20 1 0 0 0 21 -nan -nan 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 41 1.0 nan nan 0.00e+00 0.0 1.9e+02 7.2e+04 4.1e+01 1 0 0 0 7 1 0 0 0 8 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatMult 20375 1.0 nan nan 1.47e+11 1.2 2.4e+05 1.9e+04 0.0e+00 24 88 74 97 0 24 88 74 97 0 -nan -nan 2 1.05e+02 0 0.00e+00 100 MatMultAdd 4695 1.0 nan nan 3.24e+09 1.2 4.2e+04 9.0e+02 0.0e+00 7 2 13 1 0 7 2 13 1 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 MatMultTranspose 4695 1.0 nan nan 2.89e+09 1.2 4.2e+04 9.0e+02 0.0e+00 5 2 13 1 0 5 2 13 1 0 -nan -nan 1 2.97e-02 0 0.00e+00 100 MatSolve 1565 0.0 nan nan 1.10e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 MatLUFactorSym 1 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 nan nan 4.41e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 1 3.80e-05 0 0.00e+00 0 MatConvert 12 1.0 nan nan 0.00e+00 0.0 9.6e+01 6.2e+03 4.0e+00 1 0 0 0 1 1 0 0 0 1 -nan -nan 0 0.00e+00 4 2.23e+00 0 MatScale 6 1.0 nan nan 2.07e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 6 7.61e+00 9 9.25e+00 50 MatResidual 4695 1.0 nan nan 3.02e+10 1.2 5.6e+04 1.7e+04 0.0e+00 6 18 17 20 0 6 18 17 20 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 MatAssemblyBegin 44 1.0 nan nan 0.00e+00 0.0 1.9e+02 7.2e+04 3.3e+01 1 0 0 0 6 1 0 0 0 6 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 44 1.0 nan nan 0.00e+00 0.0 5.1e+02 2.3e+03 1.5e+02 2 0 0 0 27 2 0 0 0 28 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatCreateSubMat 2 1.0 nan nan 0.00e+00 0.0 2.1e+01 1.7e+02 3.0e+01 0 0 0 0 5 0 0 0 0 6 -nan -nan 0 0.00e+00 2 7.22e-04 0 MatGetOrdering 1 0.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatCoarsen 3 1.0 nan nan 4.37e+07 1.2 8.4e+02 6.4e+03 1.4e+02 7 0 0 0 26 7 0 0 0 27 -nan -nan 23 1.34e+02 16 1.78e+01 100 MatView 14 1.4 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+01 0 0 0 0 2 0 0 0 0 2 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatAXPY 6 1.0 nan nan 9.74e+06 1.2 7.2e+01 4.3e+03 2.1e+01 4 0 0 0 4 4 0 0 0 4 -nan -nan 0 0.00e+00 6 7.61e+00 0 MatTranspose 6 1.0 nan nan 0.00e+00 0.0 3.8e+02 3.8e+04 5.4e+01 2 0 0 0 10 2 0 0 0 10 -nan -nan 0 0.00e+00 2 1.62e+00 0 MatMatMultSym 4 1.0 nan nan 1.95e+07 1.2 2.1e+02 6.1e+03 3.2e+01 2 0 0 0 6 2 0 0 0 6 -nan -nan 31 2.98e+01 24 1.59e+01 100 MatMatMultNum 4 1.0 nan nan 0.00e+00 0.0 8.4e+01 1.8e+02 2.4e+01 0 0 0 0 4 0 0 0 0 4 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatPtAPSymbolic 4 1.0 nan nan 1.73e+08 1.3 7.9e+02 3.0e+04 4.0e+01 7 0 0 0 7 7 0 0 0 7 -nan -nan 40 1.72e+02 32 3.44e+01 100 MatPtAPNumeric 4 1.0 nan nan 1.69e+08 1.3 1.4e+02 2.4e+04 2.4e+01 0 0 0 0 4 0 0 0 0 4 -nan -nan 15 2.47e+00 0 0.00e+00 100 MatGetLocalMat 4 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 -nan -nan 11 1.25e+01 4 6.24e+00 0 MatGetBrAoCol 8 1.0 nan nan 0.00e+00 0.0 2.7e+02 3.1e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 55 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 -nan -nan 55 2.95e+02 0 0.00e+00 0 MatCUSPARSCopyFr 20 1.1 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 20 1.91e+01 0 MatCUSPARSGenT 8 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatSetPreallCOO 8 1.0 nan nan 0.00e+00 0.0 1.8e+02 4.2e+02 4.0e+01 1 0 0 0 7 1 0 0 0 7 -nan -nan 32 3.81e+01 24 1.08e+01 0 MatSetValuesCOO 8 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecMDot 30 1.0 nan nan 2.38e+07 1.1 0.0e+00 0.0e+00 3.0e+01 0 0 0 0 5 0 0 0 0 6 -nan -nan 0 0.00e+00 27 1.27e-03 100 VecNorm 34 1.0 nan nan 5.19e+06 1.1 0.0e+00 0.0e+00 3.4e+01 0 0 0 0 6 0 0 0 0 6 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecScale 33 1.0 nan nan 2.38e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecCopy 14090 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 2 0 0 0 0 2 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecSet 9420 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecAXPY 4695 1.0 nan nan 2.00e+09 1.1 0.0e+00 0.0e+00 0.0e+00 1 1 0 0 0 1 1 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecAYPX 31296 1.0 nan nan 5.40e+09 1.1 0.0e+00 0.0e+00 0.0e+00 7 3 0 0 0 7 3 0 0 0 -nan -nan 1 1.62e+00 0 0.00e+00 100 VecAXPBYCZ 9390 1.0 nan nan 3.39e+09 1.1 0.0e+00 0.0e+00 0.0e+00 3 2 0 0 0 3 2 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecMAXPY 33 1.0 nan nan 2.81e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 33 1.56e-03 0 0.00e+00 100 VecAssemblyBegin 9 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 8.0e+00 0 0 0 0 1 0 0 0 0 1 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 9 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecPointwiseMult 18813 1.0 nan nan 1.36e+09 1.1 0.0e+00 0.0e+00 0.0e+00 2 1 0 0 0 2 1 0 0 0 -nan -nan 10 6.54e+00 0 0.00e+00 0 VecScatterBegin 29772 1.0 nan nan 0.00e+00 0.0 3.3e+05 1.5e+04 0.0e+00 11 0 99 99 0 11 0 99 99 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 29772 1.0 nan nan 1.37e+06 1.2 0.0e+00 0.0e+00 0.0e+00 20 0 0 0 0 20 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecReduceArith 4693 1.0 nan nan 2.00e+09 1.1 0.0e+00 0.0e+00 0.0e+00 2 1 0 0 0 2 1 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecReduceBegin 3129 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecReduceEnd 3129 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecNormalize 33 1.0 nan nan 7.14e+06 1.1 0.0e+00 0.0e+00 3.3e+01 1 0 0 0 6 1 0 0 0 6 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecCUDACopyTo 20 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 20 1.31e+01 0 0.00e+00 0 VecCUDACopyFrom 10 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 10 6.54e+00 0 SFSetGraph 69 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFSetUp 69 1.0 nan nan 0.00e+00 0.0 1.2e+03 5.9e+03 6.9e+01 0 0 0 0 12 0 0 0 0 13 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFBcastBegin 25 1.0 nan nan 0.00e+00 0.0 2.9e+02 1.1e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFBcastEnd 25 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 26 1.0 nan nan 0.00e+00 0.0 2.6e+02 3.9e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 26 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 4 1.0 nan nan 0.00e+00 0.0 4.2e+01 3.9e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 4 1.0 nan nan 0.00e+00 0.0 4.2e+01 3.9e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFPack 29827 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFUnpack 29831 1.0 nan nan 1.37e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 KSPSetUp 9 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00 0 0 0 0 1 0 0 0 0 1 -nan -nan 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 4.1542e+00 1.0 1.67e+11 1.2 3.3e+05 1.5e+04 7.0e+00 54 100 99 99 1 54 100 99 99 1 150190 -nan 10 6.55e+00 3 1.64e+00 99 KSPGMRESOrthog 30 1.0 nan nan 4.76e+07 1.1 0.0e+00 0.0e+00 3.0e+01 0 0 0 0 5 0 0 0 0 6 -nan -nan 30 1.32e-03 27 1.27e-03 100 PCSetUp_GAMG+ 1 1.0 nan nan 6.24e+08 1.2 2.8e+03 1.9e+04 4.9e+02 23 0 1 1 89 23 0 1 1 93 -nan -nan 139 3.23e+02 108 7.27e+01 98 PCGAMGCreateG 3 1.0 nan nan 9.53e+06 1.2 4.0e+02 3.7e+04 4.8e+01 7 0 0 0 9 7 0 0 0 9 -nan -nan 0 0.00e+00 4 2.23e+00 0 GAMG Coarsen 3 1.0 nan nan 4.37e+07 1.2 8.4e+02 6.4e+03 1.4e+02 7 0 0 0 26 7 0 0 0 27 -nan -nan 23 1.34e+02 16 1.78e+01 100 GAMG MIS/Agg 3 1.0 nan nan 4.37e+07 1.2 8.4e+02 6.4e+03 1.4e+02 7 0 0 0 26 7 0 0 0 27 -nan -nan 23 1.34e+02 16 1.78e+01 100 PCGAMGProl 3 1.0 nan nan 0.00e+00 0.0 1.1e+02 6.8e+03 4.8e+01 2 0 0 0 9 2 0 0 0 9 -nan -nan 0 0.00e+00 0 0.00e+00 0 GAMG Prol-col 3 1.0 nan nan 0.00e+00 0.0 3.6e+01 1.0e+04 1.8e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 0 0.00e+00 0 0.00e+00 0 GAMG Prol-lift 3 1.0 nan nan 0.00e+00 0.0 7.2e+01 5.1e+03 1.8e+01 1 0 0 0 3 1 0 0 0 3 -nan -nan 0 0.00e+00 0 0.00e+00 0 PCGAMGOptProl 3 1.0 nan nan 2.72e+08 1.2 6.1e+02 1.2e+04 1.3e+02 5 0 0 0 24 5 0 0 0 25 -nan -nan 76 1.43e+02 63 2.98e+01 98 GAMG smooth 3 1.0 nan nan 2.16e+07 1.2 2.5e+02 5.0e+03 5.1e+01 2 0 0 0 9 2 0 0 0 10 -nan -nan 32 3.39e+01 33 2.81e+01 93 PCGAMGCreateL 3 1.0 nan nan 2.99e+08 1.3 8.0e+02 3.1e+04 1.0e+02 3 0 0 1 19 3 0 0 1 19 -nan -nan 40 4.61e+01 26 2.30e+01 100 GAMG PtAP 3 1.0 nan nan 2.99e+08 1.3 7.6e+02 3.3e+04 4.8e+01 2 0 0 1 9 2 0 0 1 9 -nan -nan 40 4.61e+01 24 2.30e+01 100 GAMG Reduce 1 1.0 nan nan 0.00e+00 0.0 4.2e+01 9.5e+01 5.5e+01 0 0 0 0 10 0 0 0 0 10 -nan -nan 0 0.00e+00 2 7.22e-04 0 PCGAMG Gal l00 1 1.0 nan nan 2.53e+08 1.3 2.5e+02 4.9e+04 1.6e+01 2 0 0 0 3 2 0 0 0 3 -nan -nan 14 4.13e+01 8 2.07e+01 100 PCGAMG Opt l00 1 1.0 nan nan 1.84e+07 1.2 8.4e+01 1.4e+04 1.4e+01 1 0 0 0 3 1 0 0 0 3 -nan -nan 8 2.35e+01 6 1.08e+01 100 PCGAMG Gal l01 1 1.0 nan nan 4.22e+07 1.8 2.5e+02 4.7e+04 1.6e+01 1 0 0 0 3 1 0 0 0 3 -nan -nan 14 4.61e+00 8 2.19e+00 100 PCGAMG Opt l01 1 1.0 nan nan 5.36e+05 1.4 8.4e+01 9.9e+02 1.4e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 8 1.01e+00 6 4.36e-01 100 PCGAMG Gal l02 1 1.0 nan nan 3.02e+06 1.8 2.5e+02 1.8e+03 1.6e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 12 1.45e-01 8 4.63e-02 100 PCGAMG Opt l02 1 1.0 nan nan 1.31e+05 1.7 8.4e+01 4.0e+02 1.4e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 8 7.68e-02 6 3.46e-02 100 PCSetUp 2 1.0 nan nan 6.24e+08 1.2 2.8e+03 1.9e+04 4.9e+02 24 0 1 1 89 24 0 1 1 93 -nan -nan 140 3.23e+02 108 7.27e+01 98 PCSetUpOnBlocks 1565 1.0 nan nan 4.41e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 1 3.80e-05 0 0.00e+00 0 PCApply 1565 1.0 nan nan 1.33e+11 1.2 3.1e+05 1.3e+04 6.0e+00 48 79 93 81 1 48 79 93 81 1 -nan -nan 10 6.55e+00 3 1.64e+00 99 --- Event Stage 1: Unknown --------------------------------------------------------------------------------------------------------------------------------------------------------------- Object Type Creations Destructions. Reports information only for process 0. --- Event Stage 0: Main Stage PetscDeviceContext 4 12 Viewer 7 6 Container 19 19 Matrix 149 149 Matrix Coarsen 3 3 Vector 176 176 Index Set 98 98 IS L to G Mapping 16 16 Star Forest Graph 77 77 Krylov Solver 9 9 Preconditioner 9 9 PetscRandom 3 3 Distributed Mesh 6 6 Discrete System 6 6 Weak Form 6 6 --- Event Stage 1: Unknown ======================================================================================================================== Average time to get PetscTime(): 3.01e-08 Average time for MPI_Barrier(): 1.4628e-06 Average time for zero size MPI_Send(): 2.23925e-06 #PETSc Option Table entries: -device_view # (source: command line) -ksp_converged_reason # (source: command line) -ksp_divtol 1.e6 # (source: command line) -ksp_max_it 40000 # (source: command line) -ksp_monitor # (source: command line) -ksp_rtol 1.e-6 # (source: command line) -ksp_type groppcg # (source: command line) -ksp_view # (source: command line) -log_view # (source: command line) -mat_type aijcusparse # (source: command line) -options_left # (source: command line) -pc_type gamg # (source: command line) -vec_type cuda # (source: command line) #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --prefix=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 --with-make-exec=make --with-cc=/tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gcc --with-cxx=/tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/g++ --with-fc=/tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gfortran --with-precision=double --with-scalar-type=real --with-shared-libraries=1 --with-debugging=0 --with-openmp=1 --with-64-bit-indices=0 --with-blaslapack-lib=/opt/cray/pe/libsci/default/gnu/12.3/x86_64/lib/libsci_gnu.so --with-x=0 --with-clanguage=C --with-cuda=1 --with-cuda-dir=/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2 --with-hip=0 --with-metis=1 --with-metis-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/include --with-metis-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/lib/libmetis.so --with-hypre=1 --with-hypre-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/include --with-hypre-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/lib/libHYPRE.so --with-parmetis=1 --with-parmetis-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/include --with-parmetis-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/lib/libparmetis.so --with-kokkos=0 --with-kokkos-kernels=0 --with-superlu_dist=1 --with-superlu_dist-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/include --with-superlu_dist-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/lib/libsuperlu_dist.so --with-ptscotch=0 --with-suitesparse=0 --with-hdf5=1 --with-hdf5-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/include --with-hdf5-lib="//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_hl_fortran.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_hl_f90cstub.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_hl.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_fortran.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_f90cstub.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5.so" --with-zlib=1 --with-zlib-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/include --with-zlib-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/lib/libz.so --with-mumps=0 --with-trilinos=0 --with-fftw=0 --with-valgrind=0 --with-gmp=0 --with-libpng=0 --with-giflib=0 --with-mpfr=0 --with-netcdf=0 --with-pnetcdf=0 --with-moab=0 --with-random123=0 --with-exodusii=0 --with-cgns=0 --with-memkind=0 --with-p4est=0 --with-saws=0 --with-yaml=0 --with-hwloc=0 --with-libjpeg=0 --with-scalapack=1 --with-scalapack-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/netlib-scalapack-2.2.0-ayc5v4dec5qhurhpzvrhwduqayhife37/lib/libscalapack.so --with-strumpack=1 --with-strumpack-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/include --with-strumpack-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/lib64/libstrumpack.so --with-mmg=0 --with-parmmg=0 --with-tetgen=0 --with-cuda-arch=80 ----------------------------------------- Libraries compiled on 2024-02-22 17:45:47 on login09 Machine characteristics: Linux-5.14.21-150400.24.81_12.0.87-cray_shasta_c-x86_64-with-glibc2.31 Using PETSc directory: //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr Using PETSc arch: ----------------------------------------- Using C compiler: /tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gcc -fPIC -O -fopenmp Using Fortran compiler: /tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gfortran -fPIC -O -fopenmp -fopenmp ----------------------------------------- Using include paths: -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/include -I/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/include -I/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/math_libs/12.2/include ----------------------------------------- Using C linker: /tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gcc Using Fortran linker: /tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gfortran Using libraries: -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr/lib -lpetsc -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/lib64 -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/lib64 -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/netlib-scalapack-2.2.0-ayc5v4dec5qhurhpzvrhwduqayhife37/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/netlib-scalapack-2.2.0-ayc5v4dec5qhurhpzvrhwduqayhife37/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/lib -Wl,-rpath,/opt/cray/pe/libsci/default/gnu/12.3/x86_64/lib -L/opt/cray/pe/libsci/default/gnu/12.3/x86_64/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/lib -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/lib64/stubs -Wl,-rpath,/opt/cray/pe/mpich/8.1.28/ofi/gnu/12.3/lib -L/opt/cray/pe/mpich/8.1.28/ofi/gnu/12.3/lib -Wl,-rpath,/opt/cray/pe/libsci/23.12.5/GNU/12.3/x86_64/lib -L/opt/cray/pe/libsci/23.12.5/GNU/12.3/x86_64/lib -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/lib64/stubs -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/nvvm/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/nvvm/lib64 -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/extras/CUPTI/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/extras/CUPTI/lib64 -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/extras/Debugger/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/extras/Debugger/lib64 -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/math_libs/12.2/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/math_libs/12.2/lib64 -Wl,-rpath,/opt/cray/pe/dsmml/0.2.2/dsmml/lib -L/opt/cray/pe/dsmml/0.2.2/dsmml/lib -Wl,-rpath,/opt/cray/pe/pmi/6.1.13/lib -L/opt/cray/pe/pmi/6.1.13/lib -Wl,-rpath,/opt/cray/xpmem/2.6.2-2.5_2.38__gd067c3f.shasta/lib64 -L/opt/cray/xpmem/2.6.2-2.5_2.38__gd067c3f.shasta/lib64 -Wl,-rpath,/usr/lib64/gcc/x86_64-suse-linux/12 -L/usr/lib64/gcc/x86_64-suse-linux/12 -Wl,-rpath,/usr/x86_64-suse-linux/lib -L/usr/x86_64-suse-linux/lib -lHYPRE -lstrumpack -lscalapack -lsuperlu_dist -lsci_gnu -lhdf5_hl_fortran -lhdf5_hl_f90cstub -lhdf5_hl -lhdf5_fortran -lhdf5_f90cstub -lhdf5 -lparmetis -lmetis -lz -lcudart -lnvToolsExt -lcufft -lcublas -lcusparse -lcusolver -lcurand -lcuda -ldl -lxpmem -lgfortran -lm -lcupti -lcudart -lsci_gnu_123_mpi -lsci_gnu_123 -lmpifort_gnu_123 -lmpi_gnu_123 -ldsmml -lpmi -lpmi2 -lgfortran -lquadmath -lpthread -lm -lgcc_s -lstdc++ ----------------------------------------- #PETSc Option Table entries: -device_view # (source: command line) -ksp_converged_reason # (source: command line) -ksp_divtol 1.e6 # (source: command line) -ksp_max_it 40000 # (source: command line) -ksp_monitor # (source: command line) -ksp_rtol 1.e-6 # (source: command line) -ksp_type groppcg # (source: command line) -ksp_view # (source: command line) -log_view # (source: command line) -mat_type aijcusparse # (source: command line) -options_left # (source: command line) -pc_type gamg # (source: command line) -vec_type cuda # (source: command line) #End of PETSc Option Table entries There are no unused options. ########### PETSC solver and runtime options KSP : cg PC : jacobi Runtime options : -ksp_converged_reason -ksp_view -ksp_type groppcg -pc_type gamg -ksp_monitor -ksp_max_it 40000 -ksp_rtol 1.e-6 -ksp_divtol 1.e6 -mat_type aijcusparse -vec_type cuda -log_view -options_left -device_view PetscDevice Object: 4 MPI processes type: host id: 0 PetscDevice Object: 4 MPI processes type: host id: 0 PetscDevice Object: 4 MPI processes type: host id: 0 PetscDevice Object: 4 MPI processes type: host id: 0 PetscDevice Object: 4 MPI processes type: cuda id: 0 [0] name: NVIDIA A100-SXM4-80GB Compute capability: 8.0 Multiprocessor Count: 108 Maximum Grid Dimensions: 2147483647 x 65535 x 65535 Maximum Block Dimensions: 1024 x 1024 x 64 Maximum Threads Per Block: 1024 Warp Size: 32 Total Global Memory (bytes): 84990623744 Total Constant Memory (bytes): 65536 Shared Memory Per Block (bytes): 49152 Multiprocessor Clock Rate (KHz): 1410000 Memory Clock Rate (KHz): 1593000 Memory Bus Width (bits): 5120 Peak Memory Bandwidth (GB/s): 2039.040000 Can map host memory: PETSC_TRUE Can execute multiple kernels concurrently: PETSC_TRUE PetscDevice Object: 4 MPI processes type: cuda id: 1 [0] name: NVIDIA A100-SXM4-80GB Compute capability: 8.0 Multiprocessor Count: 108 Maximum Grid Dimensions: 2147483647 x 65535 x 65535 Maximum Block Dimensions: 1024 x 1024 x 64 Maximum Threads Per Block: 1024 Warp Size: 32 Total Global Memory (bytes): 84990623744 Total Constant Memory (bytes): 65536 Shared Memory Per Block (bytes): 49152 Multiprocessor Clock Rate (KHz): 1410000 Memory Clock Rate (KHz): 1593000 Memory Bus Width (bits): 5120 Peak Memory Bandwidth (GB/s): 2039.040000 Can map host memory: PETSC_TRUE Can execute multiple kernels concurrently: PETSC_TRUE PetscDevice Object: 4 MPI processes type: cuda id: 2 [0] name: NVIDIA A100-SXM4-80GB Compute capability: 8.0 Multiprocessor Count: 108 Maximum Grid Dimensions: 2147483647 x 65535 x 65535 Maximum Block Dimensions: 1024 x 1024 x 64 Maximum Threads Per Block: 1024 Warp Size: 32 Total Global Memory (bytes): 84990623744 Total Constant Memory (bytes): 65536 Shared Memory Per Block (bytes): 49152 Multiprocessor Clock Rate (KHz): 1410000 Memory Clock Rate (KHz): 1593000 Memory Bus Width (bits): 5120 Peak Memory Bandwidth (GB/s): 2039.040000 Can map host memory: PETSC_TRUE Can execute multiple kernels concurrently: PETSC_TRUE PetscDevice Object: 4 MPI processes type: cuda id: 3 [0] name: NVIDIA A100-SXM4-80GB Compute capability: 8.0 Multiprocessor Count: 108 Maximum Grid Dimensions: 2147483647 x 65535 x 65535 Maximum Block Dimensions: 1024 x 1024 x 64 Maximum Threads Per Block: 1024 Warp Size: 32 Total Global Memory (bytes): 84990623744 Total Constant Memory (bytes): 65536 Shared Memory Per Block (bytes): 49152 Multiprocessor Clock Rate (KHz): 1410000 Memory Clock Rate (KHz): 1593000 Memory Bus Width (bits): 5120 Peak Memory Bandwidth (GB/s): 2039.040000 Can map host memory: PETSC_TRUE Can execute multiple kernels concurrently: PETSC_TRUE Building the matrix... Size of A = (808996,808996) In petsc::solve(), before solution of Ax = b 0 KSP Residual norm 2.195328077635e+00 1 KSP Residual norm 1.688747419888e+00 2 KSP Residual norm 1.782997316820e+00 3 KSP Residual norm 1.741267406670e+00 4 KSP Residual norm 1.872229507622e+00 5 KSP Residual norm 1.851311134647e+00 6 KSP Residual norm 1.931960199307e+00 7 KSP Residual norm 2.025822365171e+00 8 KSP Residual norm 2.100540372633e+00 9 KSP Residual norm 2.093636368066e+00 10 KSP Residual norm 2.208700982532e+00 11 KSP Residual norm 2.308833012819e+00 12 KSP Residual norm 2.411214292239e+00 13 KSP Residual norm 2.488373861335e+00 14 KSP Residual norm 2.648882963100e+00 15 KSP Residual norm 2.774056107282e+00 16 KSP Residual norm 2.948498230363e+00 17 KSP Residual norm 3.108198055502e+00 18 KSP Residual norm 3.351344985825e+00 19 KSP Residual norm 3.569820460728e+00 20 KSP Residual norm 3.736183368938e+00 21 KSP Residual norm 4.236008051296e+00 22 KSP Residual norm 4.782461923486e+00 23 KSP Residual norm 5.467203482866e+00 24 KSP Residual norm 6.321463211473e+00 25 KSP Residual norm 8.095361700220e+00 26 KSP Residual norm 1.008826367078e+01 27 KSP Residual norm 1.532450538444e+01 28 KSP Residual norm 2.491047570795e+01 29 KSP Residual norm 8.606570178207e+01 30 KSP Residual norm 6.659886207696e+01 31 KSP Residual norm 2.372687759747e+01 32 KSP Residual norm 1.558910184417e+01 33 KSP Residual norm 1.100352051402e+01 34 KSP Residual norm 8.990195710590e+00 35 KSP Residual norm 7.236834281254e+00 36 KSP Residual norm 6.441033371659e+00 37 KSP Residual norm 5.716524019098e+00 38 KSP Residual norm 5.722115560725e+00 39 KSP Residual norm 5.632187661505e+00 40 KSP Residual norm 5.398954546867e+00 41 KSP Residual norm 5.203925276999e+00 42 KSP Residual norm 4.945957947639e+00 43 KSP Residual norm 4.714471048118e+00 44 KSP Residual norm 4.631477850608e+00 45 KSP Residual norm 4.452155189500e+00 46 KSP Residual norm 4.261269164741e+00 47 KSP Residual norm 4.115354082455e+00 48 KSP Residual norm 4.255828535191e+00 49 KSP Residual norm 4.634612216435e+00 50 KSP Residual norm 4.956703997447e+00 51 KSP Residual norm 5.121870084582e+00 52 KSP Residual norm 5.570955117866e+00 53 KSP Residual norm 6.136898064741e+00 54 KSP Residual norm 7.292469179402e+00 55 KSP Residual norm 8.715092725921e+00 56 KSP Residual norm 1.038847501282e+01 57 KSP Residual norm 1.392386666518e+01 58 KSP Residual norm 1.980530389338e+01 59 KSP Residual norm 3.452544136869e+01 60 KSP Residual norm 1.240133939606e+02 61 KSP Residual norm 7.215675789274e+01 62 KSP Residual norm 2.720635683574e+01 63 KSP Residual norm 1.769786316386e+01 64 KSP Residual norm 1.316725488921e+01 65 KSP Residual norm 1.067183035431e+01 66 KSP Residual norm 9.066109566450e+00 67 KSP Residual norm 7.889000680583e+00 68 KSP Residual norm 7.029161437082e+00 69 KSP Residual norm 6.594386394922e+00 70 KSP Residual norm 5.939467502897e+00 71 KSP Residual norm 5.471767104653e+00 72 KSP Residual norm 5.205558489220e+00 73 KSP Residual norm 5.004714319528e+00 74 KSP Residual norm 4.730798672376e+00 75 KSP Residual norm 4.607829592520e+00 76 KSP Residual norm 4.430368912200e+00 77 KSP Residual norm 4.186451390237e+00 78 KSP Residual norm 3.831562998974e+00 79 KSP Residual norm 3.728788591708e+00 80 KSP Residual norm 3.736683148136e+00 81 KSP Residual norm 4.213264533957e+00 82 KSP Residual norm 4.995765578774e+00 83 KSP Residual norm 6.640240000441e+00 84 KSP Residual norm 8.731307158814e+00 85 KSP Residual norm 1.041812326944e+01 86 KSP Residual norm 1.141212712776e+01 87 KSP Residual norm 1.168326193986e+01 88 KSP Residual norm 1.279638976039e+01 89 KSP Residual norm 1.565442437930e+01 90 KSP Residual norm 2.121058637313e+01 91 KSP Residual norm 3.281638945978e+01 92 KSP Residual norm 6.982189503743e+01 93 KSP Residual norm 4.677891614271e+02 94 KSP Residual norm 5.532764465952e+01 95 KSP Residual norm 2.929478723874e+01 96 KSP Residual norm 1.943084663884e+01 97 KSP Residual norm 1.441718245086e+01 98 KSP Residual norm 1.094776998750e+01 99 KSP Residual norm 8.595129800276e+00 100 KSP Residual norm 7.312409683173e+00 101 KSP Residual norm 6.484676004114e+00 102 KSP Residual norm 5.976488991260e+00 103 KSP Residual norm 5.237541467797e+00 104 KSP Residual norm 4.692434461742e+00 105 KSP Residual norm 4.253835580431e+00 106 KSP Residual norm 3.862269907434e+00 107 KSP Residual norm 4.151410432694e+00 108 KSP Residual norm 4.144656517062e+00 109 KSP Residual norm 4.731617442146e+00 110 KSP Residual norm 4.926392187184e+00 111 KSP Residual norm 5.603673709449e+00 112 KSP Residual norm 6.254837786050e+00 113 KSP Residual norm 7.044394954639e+00 114 KSP Residual norm 7.836644122391e+00 115 KSP Residual norm 8.955545449749e+00 116 KSP Residual norm 1.074541548683e+01 117 KSP Residual norm 1.250365336383e+01 118 KSP Residual norm 1.502655682323e+01 119 KSP Residual norm 1.785548954052e+01 120 KSP Residual norm 2.300238628903e+01 121 KSP Residual norm 3.069987218848e+01 122 KSP Residual norm 5.671197350680e+01 123 KSP Residual norm 4.275754776650e+02 124 KSP Residual norm 7.589661323771e+01 125 KSP Residual norm 3.575288785721e+01 126 KSP Residual norm 2.288743503751e+01 127 KSP Residual norm 1.655959637340e+01 128 KSP Residual norm 1.314492101899e+01 129 KSP Residual norm 1.068760529399e+01 130 KSP Residual norm 9.104358919992e+00 131 KSP Residual norm 7.467073602545e+00 132 KSP Residual norm 6.561026821307e+00 133 KSP Residual norm 5.300434117538e+00 134 KSP Residual norm 4.660199282795e+00 135 KSP Residual norm 3.822065101123e+00 136 KSP Residual norm 3.649093295089e+00 137 KSP Residual norm 3.306770175047e+00 138 KSP Residual norm 3.454336317104e+00 139 KSP Residual norm 3.673172311968e+00 140 KSP Residual norm 4.169730792245e+00 141 KSP Residual norm 4.419845565326e+00 142 KSP Residual norm 4.660421762890e+00 143 KSP Residual norm 5.133132697133e+00 144 KSP Residual norm 5.893605087911e+00 145 KSP Residual norm 7.513662740056e+00 146 KSP Residual norm 9.832092809043e+00 147 KSP Residual norm 1.474145355937e+01 148 KSP Residual norm 2.550889921651e+01 149 KSP Residual norm 1.070616259340e+02 150 KSP Residual norm 5.028617981823e+01 151 KSP Residual norm 2.116336341612e+01 152 KSP Residual norm 1.278985313936e+01 153 KSP Residual norm 9.560597526335e+00 154 KSP Residual norm 7.437932187807e+00 155 KSP Residual norm 6.326524472099e+00 156 KSP Residual norm 5.314738109767e+00 157 KSP Residual norm 4.559098618703e+00 158 KSP Residual norm 3.911091716439e+00 159 KSP Residual norm 3.338168098321e+00 160 KSP Residual norm 3.022748474601e+00 161 KSP Residual norm 2.633466599580e+00 162 KSP Residual norm 2.446324723931e+00 163 KSP Residual norm 2.353006063205e+00 164 KSP Residual norm 2.579234876419e+00 165 KSP Residual norm 2.885633135678e+00 166 KSP Residual norm 3.440098299560e+00 167 KSP Residual norm 4.103362946046e+00 168 KSP Residual norm 5.061815000297e+00 169 KSP Residual norm 6.324290982118e+00 170 KSP Residual norm 8.701728945071e+00 171 KSP Residual norm 1.231321880282e+01 172 KSP Residual norm 2.456916300008e+01 173 KSP Residual norm 2.102022127866e+02 174 KSP Residual norm 3.160516259194e+01 175 KSP Residual norm 1.436614017934e+01 176 KSP Residual norm 9.260565697025e+00 177 KSP Residual norm 6.609919380962e+00 178 KSP Residual norm 5.379594796265e+00 179 KSP Residual norm 4.715706511835e+00 180 KSP Residual norm 4.455410892780e+00 181 KSP Residual norm 4.214842600838e+00 182 KSP Residual norm 4.193754807094e+00 183 KSP Residual norm 4.076561291768e+00 184 KSP Residual norm 4.177334854435e+00 185 KSP Residual norm 4.014735888086e+00 186 KSP Residual norm 3.725460616493e+00 187 KSP Residual norm 3.380808931825e+00 188 KSP Residual norm 3.124704604744e+00 189 KSP Residual norm 2.975960861484e+00 190 KSP Residual norm 2.981761745525e+00 191 KSP Residual norm 2.885403817469e+00 192 KSP Residual norm 2.820971600252e+00 193 KSP Residual norm 2.692014825498e+00 194 KSP Residual norm 2.744190695907e+00 195 KSP Residual norm 2.703261602501e+00 196 KSP Residual norm 3.033632122242e+00 197 KSP Residual norm 3.334342308110e+00 198 KSP Residual norm 4.001318583560e+00 199 KSP Residual norm 5.099268268325e+00 200 KSP Residual norm 7.330501424750e+00 201 KSP Residual norm 1.349345795210e+01 202 KSP Residual norm 4.741607262178e+01 203 KSP Residual norm 3.033837976667e+01 204 KSP Residual norm 1.106796531846e+01 205 KSP Residual norm 6.864724095595e+00 206 KSP Residual norm 4.839160673203e+00 207 KSP Residual norm 3.770250501345e+00 208 KSP Residual norm 2.990828185717e+00 209 KSP Residual norm 2.555836508374e+00 210 KSP Residual norm 2.272801092500e+00 211 KSP Residual norm 2.005453702289e+00 212 KSP Residual norm 1.943178523614e+00 213 KSP Residual norm 1.789500517908e+00 214 KSP Residual norm 1.768945423933e+00 215 KSP Residual norm 1.670374018031e+00 216 KSP Residual norm 1.734061368864e+00 217 KSP Residual norm 1.701445779535e+00 218 KSP Residual norm 1.799417453032e+00 219 KSP Residual norm 1.819604741198e+00 220 KSP Residual norm 1.960186199131e+00 221 KSP Residual norm 2.001181208037e+00 222 KSP Residual norm 2.361126025790e+00 223 KSP Residual norm 2.795863164485e+00 224 KSP Residual norm 3.867705079969e+00 225 KSP Residual norm 5.409903116910e+00 226 KSP Residual norm 1.017223614953e+01 227 KSP Residual norm 7.139768572319e+01 228 KSP Residual norm 1.443301918472e+01 229 KSP Residual norm 6.458510760351e+00 230 KSP Residual norm 4.036038365603e+00 231 KSP Residual norm 3.063404691853e+00 232 KSP Residual norm 2.423821712216e+00 233 KSP Residual norm 2.093432170871e+00 234 KSP Residual norm 1.826464632900e+00 235 KSP Residual norm 1.646027905388e+00 236 KSP Residual norm 1.450187548873e+00 237 KSP Residual norm 1.415876292169e+00 238 KSP Residual norm 1.301467722554e+00 239 KSP Residual norm 1.379397844922e+00 240 KSP Residual norm 1.209589046159e+00 241 KSP Residual norm 1.280078125544e+00 242 KSP Residual norm 1.139506457262e+00 243 KSP Residual norm 1.206298311151e+00 244 KSP Residual norm 1.208047093003e+00 245 KSP Residual norm 1.330896391593e+00 246 KSP Residual norm 1.442629311448e+00 247 KSP Residual norm 1.768308200244e+00 248 KSP Residual norm 2.266128263176e+00 249 KSP Residual norm 3.274865096186e+00 250 KSP Residual norm 5.724980385964e+00 251 KSP Residual norm 1.913351838112e+01 252 KSP Residual norm 1.519044571058e+01 253 KSP Residual norm 5.383835640601e+00 254 KSP Residual norm 3.192539456969e+00 255 KSP Residual norm 2.244053405978e+00 256 KSP Residual norm 1.820298227939e+00 257 KSP Residual norm 1.463047636454e+00 258 KSP Residual norm 1.283919783076e+00 259 KSP Residual norm 1.102880265145e+00 260 KSP Residual norm 1.016297035090e+00 261 KSP Residual norm 9.362732604087e-01 262 KSP Residual norm 9.342040966824e-01 263 KSP Residual norm 8.722136862168e-01 264 KSP Residual norm 8.452448556773e-01 265 KSP Residual norm 8.165313601591e-01 266 KSP Residual norm 8.458409440186e-01 267 KSP Residual norm 8.827369030820e-01 268 KSP Residual norm 9.377650533433e-01 269 KSP Residual norm 9.366879829907e-01 270 KSP Residual norm 9.960135565056e-01 271 KSP Residual norm 9.897415919734e-01 272 KSP Residual norm 1.065852884216e+00 273 KSP Residual norm 1.159728565506e+00 274 KSP Residual norm 1.370243091275e+00 275 KSP Residual norm 1.781174203540e+00 276 KSP Residual norm 2.446323488917e+00 277 KSP Residual norm 4.253994149344e+00 278 KSP Residual norm 1.367185087089e+01 279 KSP Residual norm 1.153871169269e+01 280 KSP Residual norm 3.938876460915e+00 281 KSP Residual norm 2.414824648788e+00 282 KSP Residual norm 1.688485063855e+00 283 KSP Residual norm 1.326744874850e+00 284 KSP Residual norm 1.062423112105e+00 285 KSP Residual norm 9.235884499599e-01 286 KSP Residual norm 7.778259419595e-01 287 KSP Residual norm 7.189270359198e-01 288 KSP Residual norm 6.399746058065e-01 289 KSP Residual norm 6.195471374971e-01 290 KSP Residual norm 5.799769612582e-01 291 KSP Residual norm 5.862254073424e-01 292 KSP Residual norm 5.787060254457e-01 293 KSP Residual norm 6.061840360001e-01 294 KSP Residual norm 6.345774578368e-01 295 KSP Residual norm 6.540715923495e-01 296 KSP Residual norm 7.326232444370e-01 297 KSP Residual norm 7.987473527372e-01 298 KSP Residual norm 9.977779656116e-01 299 KSP Residual norm 1.207726169101e+00 300 KSP Residual norm 1.652551485650e+00 301 KSP Residual norm 2.132826267689e+00 302 KSP Residual norm 3.516579771696e+00 303 KSP Residual norm 7.265439982941e+00 304 KSP Residual norm 3.195025420908e+01 305 KSP Residual norm 4.975370257619e+00 306 KSP Residual norm 2.780700181510e+00 307 KSP Residual norm 1.883298523646e+00 308 KSP Residual norm 1.443302467402e+00 309 KSP Residual norm 1.175532045100e+00 310 KSP Residual norm 1.015965671456e+00 311 KSP Residual norm 8.948199304749e-01 312 KSP Residual norm 8.420461771827e-01 313 KSP Residual norm 7.497037114311e-01 314 KSP Residual norm 7.237362981610e-01 315 KSP Residual norm 6.787625475559e-01 316 KSP Residual norm 6.739005575258e-01 317 KSP Residual norm 6.875729639494e-01 318 KSP Residual norm 7.040505196222e-01 319 KSP Residual norm 6.878619434606e-01 320 KSP Residual norm 6.903792050752e-01 321 KSP Residual norm 6.692765102562e-01 322 KSP Residual norm 6.562633727918e-01 323 KSP Residual norm 6.439768723302e-01 324 KSP Residual norm 6.489312074797e-01 325 KSP Residual norm 6.771313116573e-01 326 KSP Residual norm 7.265592118516e-01 327 KSP Residual norm 8.046436848555e-01 328 KSP Residual norm 9.058553054135e-01 329 KSP Residual norm 1.041455584335e+00 330 KSP Residual norm 1.209199375281e+00 331 KSP Residual norm 1.548506027657e+00 332 KSP Residual norm 2.142658738653e+00 333 KSP Residual norm 3.683513800461e+00 334 KSP Residual norm 1.122853717586e+01 335 KSP Residual norm 1.066099627227e+01 336 KSP Residual norm 3.601954592228e+00 337 KSP Residual norm 2.210518944316e+00 338 KSP Residual norm 1.564487823403e+00 339 KSP Residual norm 1.258329183423e+00 340 KSP Residual norm 1.026938705493e+00 341 KSP Residual norm 8.938513929084e-01 342 KSP Residual norm 7.954471515228e-01 343 KSP Residual norm 7.081977429181e-01 344 KSP Residual norm 6.401378708681e-01 345 KSP Residual norm 5.582132815393e-01 346 KSP Residual norm 5.283678462723e-01 347 KSP Residual norm 4.731516408812e-01 348 KSP Residual norm 4.672572660355e-01 349 KSP Residual norm 4.227790579429e-01 350 KSP Residual norm 4.470403051325e-01 351 KSP Residual norm 4.358236738962e-01 352 KSP Residual norm 4.860437949303e-01 353 KSP Residual norm 4.892826062601e-01 354 KSP Residual norm 5.562196940400e-01 355 KSP Residual norm 5.946325840665e-01 356 KSP Residual norm 6.852112578578e-01 357 KSP Residual norm 7.956171258290e-01 358 KSP Residual norm 1.042726426763e+00 359 KSP Residual norm 1.421200220579e+00 360 KSP Residual norm 2.386524014266e+00 361 KSP Residual norm 6.763653761776e+00 362 KSP Residual norm 7.787894419948e+00 363 KSP Residual norm 2.490869023416e+00 364 KSP Residual norm 1.490470796302e+00 365 KSP Residual norm 1.031067192943e+00 366 KSP Residual norm 7.987937627249e-01 367 KSP Residual norm 6.145007971395e-01 368 KSP Residual norm 4.843712508337e-01 369 KSP Residual norm 3.925881046406e-01 370 KSP Residual norm 3.098533901386e-01 371 KSP Residual norm 2.760698763731e-01 372 KSP Residual norm 2.420827109514e-01 373 KSP Residual norm 2.482608656271e-01 374 KSP Residual norm 2.632799466712e-01 375 KSP Residual norm 3.224203840138e-01 376 KSP Residual norm 3.786755613491e-01 377 KSP Residual norm 5.127695383629e-01 378 KSP Residual norm 6.383639856672e-01 379 KSP Residual norm 9.575324411251e-01 380 KSP Residual norm 1.601724224784e+00 381 KSP Residual norm 5.545201754278e+00 382 KSP Residual norm 4.127667349827e+00 383 KSP Residual norm 1.523678384690e+00 384 KSP Residual norm 8.743626479489e-01 385 KSP Residual norm 6.209787838485e-01 386 KSP Residual norm 4.694541252837e-01 387 KSP Residual norm 3.915669366208e-01 388 KSP Residual norm 3.211811542639e-01 389 KSP Residual norm 2.914417049562e-01 390 KSP Residual norm 2.542301855034e-01 391 KSP Residual norm 2.335489741715e-01 392 KSP Residual norm 2.348551920749e-01 393 KSP Residual norm 2.158542845009e-01 394 KSP Residual norm 2.377048364855e-01 395 KSP Residual norm 2.344990675012e-01 396 KSP Residual norm 2.634034949202e-01 397 KSP Residual norm 2.745082447387e-01 398 KSP Residual norm 3.396867771635e-01 399 KSP Residual norm 3.863698047012e-01 400 KSP Residual norm 5.091305205194e-01 401 KSP Residual norm 6.709403582470e-01 402 KSP Residual norm 1.085323817910e+00 403 KSP Residual norm 2.386791461569e+00 404 KSP Residual norm 1.038745903184e+01 405 KSP Residual norm 1.644735715183e+00 406 KSP Residual norm 8.884770492561e-01 407 KSP Residual norm 6.098157700102e-01 408 KSP Residual norm 4.586798065650e-01 409 KSP Residual norm 3.856088018669e-01 410 KSP Residual norm 3.282784580615e-01 411 KSP Residual norm 2.928586066612e-01 412 KSP Residual norm 2.569464187867e-01 413 KSP Residual norm 2.336164147497e-01 414 KSP Residual norm 2.016533126952e-01 415 KSP Residual norm 1.890834363433e-01 416 KSP Residual norm 1.666430963019e-01 417 KSP Residual norm 1.671692678657e-01 418 KSP Residual norm 1.532465000807e-01 419 KSP Residual norm 1.632543196873e-01 420 KSP Residual norm 1.598035485862e-01 421 KSP Residual norm 1.791307643130e-01 422 KSP Residual norm 1.977946797159e-01 423 KSP Residual norm 2.448523636882e-01 424 KSP Residual norm 3.004414057222e-01 425 KSP Residual norm 4.227858920981e-01 426 KSP Residual norm 6.371022670300e-01 427 KSP Residual norm 1.331044057125e+00 428 KSP Residual norm 3.455822152226e+01 429 KSP Residual norm 1.258213589482e+00 430 KSP Residual norm 6.292260966196e-01 431 KSP Residual norm 4.159334776139e-01 432 KSP Residual norm 3.092988510021e-01 433 KSP Residual norm 2.397820700785e-01 434 KSP Residual norm 1.989199056736e-01 435 KSP Residual norm 1.734540398586e-01 436 KSP Residual norm 1.559020770519e-01 437 KSP Residual norm 1.430370566197e-01 438 KSP Residual norm 1.344586245297e-01 439 KSP Residual norm 1.240033712779e-01 440 KSP Residual norm 1.172556560960e-01 441 KSP Residual norm 1.117494468095e-01 442 KSP Residual norm 1.098416250955e-01 443 KSP Residual norm 1.126365856455e-01 444 KSP Residual norm 1.151496595858e-01 445 KSP Residual norm 1.195027134524e-01 446 KSP Residual norm 1.465711492166e-01 447 KSP Residual norm 1.855794030604e-01 448 KSP Residual norm 2.583840787165e-01 449 KSP Residual norm 3.808283875317e-01 450 KSP Residual norm 7.214776135528e-01 451 KSP Residual norm 3.386506952612e+00 452 KSP Residual norm 1.226987264329e+00 453 KSP Residual norm 5.057932646377e-01 454 KSP Residual norm 3.313867696336e-01 455 KSP Residual norm 2.308582353724e-01 456 KSP Residual norm 1.758619886210e-01 457 KSP Residual norm 1.371594571133e-01 458 KSP Residual norm 1.103701164681e-01 459 KSP Residual norm 9.257078976688e-02 460 KSP Residual norm 8.135685332165e-02 461 KSP Residual norm 7.043899466797e-02 462 KSP Residual norm 6.453207099376e-02 463 KSP Residual norm 6.266095621671e-02 464 KSP Residual norm 6.520814643666e-02 465 KSP Residual norm 7.732836725653e-02 466 KSP Residual norm 8.598352519107e-02 467 KSP Residual norm 1.138585136780e-01 468 KSP Residual norm 1.376220865771e-01 469 KSP Residual norm 2.002592763933e-01 470 KSP Residual norm 2.860280499077e-01 471 KSP Residual norm 5.961159604722e-01 472 KSP Residual norm 3.063866148869e+01 473 KSP Residual norm 6.114333305031e-01 474 KSP Residual norm 2.925525908095e-01 475 KSP Residual norm 1.865235489733e-01 476 KSP Residual norm 1.301090987523e-01 477 KSP Residual norm 9.890173970408e-02 478 KSP Residual norm 7.847477999209e-02 479 KSP Residual norm 6.180370614910e-02 480 KSP Residual norm 5.248735405127e-02 481 KSP Residual norm 4.492286771098e-02 482 KSP Residual norm 4.353625211951e-02 483 KSP Residual norm 4.238378775435e-02 484 KSP Residual norm 4.811302277613e-02 485 KSP Residual norm 5.205411471641e-02 486 KSP Residual norm 6.767220856257e-02 487 KSP Residual norm 7.959608826507e-02 488 KSP Residual norm 1.098278033774e-01 489 KSP Residual norm 1.380302124102e-01 490 KSP Residual norm 2.209758790515e-01 491 KSP Residual norm 3.887517733784e-01 492 KSP Residual norm 5.035042324863e+00 493 KSP Residual norm 4.761908438681e-01 494 KSP Residual norm 2.459644868969e-01 495 KSP Residual norm 1.468552289010e-01 496 KSP Residual norm 1.130346046281e-01 497 KSP Residual norm 8.547350791172e-02 498 KSP Residual norm 7.003863890545e-02 499 KSP Residual norm 5.934111639238e-02 500 KSP Residual norm 5.098121400616e-02 501 KSP Residual norm 4.620368159069e-02 502 KSP Residual norm 4.071207208117e-02 503 KSP Residual norm 3.966891921016e-02 504 KSP Residual norm 3.588203969216e-02 505 KSP Residual norm 3.667394047454e-02 506 KSP Residual norm 3.507410056187e-02 507 KSP Residual norm 3.953158318549e-02 508 KSP Residual norm 4.021228794311e-02 509 KSP Residual norm 4.889169415530e-02 510 KSP Residual norm 5.724535229036e-02 511 KSP Residual norm 7.970692577128e-02 512 KSP Residual norm 1.122071049203e-01 513 KSP Residual norm 2.072062779342e-01 514 KSP Residual norm 6.549832505060e-01 515 KSP Residual norm 5.285950915929e-01 516 KSP Residual norm 1.822025203860e-01 517 KSP Residual norm 1.136519929321e-01 518 KSP Residual norm 7.382125149951e-02 519 KSP Residual norm 5.986619724388e-02 520 KSP Residual norm 4.421761107329e-02 521 KSP Residual norm 3.835554541593e-02 522 KSP Residual norm 3.132168758992e-02 523 KSP Residual norm 2.896145001123e-02 524 KSP Residual norm 2.680210174662e-02 525 KSP Residual norm 2.495538132467e-02 526 KSP Residual norm 2.432177739708e-02 527 KSP Residual norm 2.449385001852e-02 528 KSP Residual norm 2.578733300390e-02 529 KSP Residual norm 2.857563291726e-02 530 KSP Residual norm 3.379859899900e-02 531 KSP Residual norm 4.139337129835e-02 532 KSP Residual norm 5.882101237621e-02 533 KSP Residual norm 8.430271248649e-02 534 KSP Residual norm 1.639458764085e-01 535 KSP Residual norm 7.793826720219e-01 536 KSP Residual norm 2.772747015893e-01 537 KSP Residual norm 1.117205101132e-01 538 KSP Residual norm 7.339187821895e-02 539 KSP Residual norm 4.951265477076e-02 540 KSP Residual norm 3.900696942697e-02 541 KSP Residual norm 2.862227355409e-02 542 KSP Residual norm 2.375683248388e-02 543 KSP Residual norm 1.910014666407e-02 544 KSP Residual norm 1.755649502601e-02 545 KSP Residual norm 1.633378986801e-02 546 KSP Residual norm 1.651961176388e-02 547 KSP Residual norm 1.799495633733e-02 548 KSP Residual norm 2.043068926939e-02 549 KSP Residual norm 2.403167634144e-02 550 KSP Residual norm 2.829706561515e-02 551 KSP Residual norm 3.472396189408e-02 552 KSP Residual norm 4.518319115998e-02 553 KSP Residual norm 6.273604545035e-02 554 KSP Residual norm 1.027682366525e-01 555 KSP Residual norm 2.537203201020e-01 556 KSP Residual norm 5.041423398651e-01 557 KSP Residual norm 1.282161540681e-01 558 KSP Residual norm 7.054651523534e-02 559 KSP Residual norm 5.197524510963e-02 560 KSP Residual norm 3.673499194667e-02 561 KSP Residual norm 3.168096120475e-02 562 KSP Residual norm 2.403458891013e-02 563 KSP Residual norm 2.165902103645e-02 564 KSP Residual norm 1.804213102716e-02 565 KSP Residual norm 1.621980431353e-02 566 KSP Residual norm 1.425672094829e-02 567 KSP Residual norm 1.297041257896e-02 568 KSP Residual norm 1.240443684341e-02 569 KSP Residual norm 1.241543959148e-02 570 KSP Residual norm 1.354305820751e-02 571 KSP Residual norm 1.496907211544e-02 572 KSP Residual norm 1.805498415883e-02 573 KSP Residual norm 2.181980186120e-02 574 KSP Residual norm 3.038058690110e-02 575 KSP Residual norm 4.181772306886e-02 576 KSP Residual norm 7.692281815241e-02 577 KSP Residual norm 2.174855445940e-01 578 KSP Residual norm 2.284334199558e-01 579 KSP Residual norm 7.203522694969e-02 580 KSP Residual norm 4.472194749269e-02 581 KSP Residual norm 3.010257037737e-02 582 KSP Residual norm 2.454808726947e-02 583 KSP Residual norm 1.916832149109e-02 584 KSP Residual norm 1.674418568860e-02 585 KSP Residual norm 1.347787134324e-02 586 KSP Residual norm 1.232080131157e-02 587 KSP Residual norm 1.023856706793e-02 588 KSP Residual norm 1.006849140901e-02 589 KSP Residual norm 8.827446753559e-03 590 KSP Residual norm 9.384794631016e-03 591 KSP Residual norm 8.994216286953e-03 592 KSP Residual norm 1.068397227289e-02 593 KSP Residual norm 1.172336201136e-02 594 KSP Residual norm 1.538341757234e-02 595 KSP Residual norm 1.866786546877e-02 596 KSP Residual norm 2.897621392517e-02 597 KSP Residual norm 4.714303565054e-02 598 KSP Residual norm 1.462656143276e-01 599 KSP Residual norm 1.535440425439e-01 600 KSP Residual norm 4.861931618647e-02 601 KSP Residual norm 2.941804165624e-02 602 KSP Residual norm 1.994174614886e-02 603 KSP Residual norm 1.577864748879e-02 604 KSP Residual norm 1.235434145271e-02 605 KSP Residual norm 1.037218478186e-02 606 KSP Residual norm 8.574949728378e-03 607 KSP Residual norm 7.807990178303e-03 608 KSP Residual norm 6.705975111161e-03 609 KSP Residual norm 6.526810383618e-03 610 KSP Residual norm 6.115019546718e-03 611 KSP Residual norm 6.711840523876e-03 612 KSP Residual norm 7.149732934384e-03 613 KSP Residual norm 8.879738802383e-03 614 KSP Residual norm 1.076581646911e-02 615 KSP Residual norm 1.470813327365e-02 616 KSP Residual norm 2.142232708853e-02 617 KSP Residual norm 3.649924614133e-02 618 KSP Residual norm 1.064402050191e-01 619 KSP Residual norm 1.190611181735e-01 620 KSP Residual norm 3.791563505455e-02 621 KSP Residual norm 2.248162258256e-02 622 KSP Residual norm 1.516704269638e-02 623 KSP Residual norm 1.154507654642e-02 624 KSP Residual norm 8.883877387686e-03 625 KSP Residual norm 6.993220939782e-03 626 KSP Residual norm 5.773739186237e-03 627 KSP Residual norm 4.876090426607e-03 628 KSP Residual norm 4.520221724139e-03 629 KSP Residual norm 4.133889265476e-03 630 KSP Residual norm 4.371211204900e-03 631 KSP Residual norm 4.505931795805e-03 632 KSP Residual norm 5.426325605458e-03 633 KSP Residual norm 6.394672613616e-03 634 KSP Residual norm 8.711429974050e-03 635 KSP Residual norm 1.174465939108e-02 636 KSP Residual norm 1.944001206412e-02 637 KSP Residual norm 4.222177733922e-02 638 KSP Residual norm 3.158254722953e-01 639 KSP Residual norm 3.337411855740e-02 640 KSP Residual norm 1.684218378095e-02 641 KSP Residual norm 1.120570413583e-02 642 KSP Residual norm 7.917901201915e-03 643 KSP Residual norm 6.182261482425e-03 644 KSP Residual norm 4.692160397344e-03 645 KSP Residual norm 3.953845851184e-03 646 KSP Residual norm 3.315523679130e-03 647 KSP Residual norm 3.052457001568e-03 648 KSP Residual norm 3.046975501774e-03 649 KSP Residual norm 3.038299195633e-03 650 KSP Residual norm 3.423902344633e-03 651 KSP Residual norm 3.571875264213e-03 652 KSP Residual norm 4.349995049028e-03 653 KSP Residual norm 5.046086553831e-03 654 KSP Residual norm 6.635610567873e-03 655 KSP Residual norm 9.101571672435e-03 656 KSP Residual norm 1.367600601428e-02 657 KSP Residual norm 2.849550792054e-02 658 KSP Residual norm 9.331364498537e-01 659 KSP Residual norm 3.007483183259e-02 660 KSP Residual norm 1.371551040171e-02 661 KSP Residual norm 9.559512937496e-03 662 KSP Residual norm 6.309970567412e-03 663 KSP Residual norm 5.305336546418e-03 664 KSP Residual norm 3.762125024187e-03 665 KSP Residual norm 3.337985152256e-03 666 KSP Residual norm 2.587728639139e-03 667 KSP Residual norm 2.485822522818e-03 668 KSP Residual norm 2.243741426883e-03 669 KSP Residual norm 2.370669233927e-03 670 KSP Residual norm 2.397878393197e-03 671 KSP Residual norm 2.651394419243e-03 672 KSP Residual norm 2.970826856756e-03 673 KSP Residual norm 3.543373944920e-03 674 KSP Residual norm 4.476658734941e-03 675 KSP Residual norm 6.188150147971e-03 676 KSP Residual norm 9.430693846454e-03 677 KSP Residual norm 1.906671262203e-02 678 KSP Residual norm 6.067004952052e-01 679 KSP Residual norm 2.041174604252e-02 680 KSP Residual norm 1.014233303137e-02 681 KSP Residual norm 6.010786013998e-03 682 KSP Residual norm 4.551585422602e-03 683 KSP Residual norm 3.087550288565e-03 684 KSP Residual norm 2.749811503461e-03 685 KSP Residual norm 2.029388360253e-03 686 KSP Residual norm 2.124798081511e-03 687 KSP Residual norm 1.667998314081e-03 688 KSP Residual norm 1.962845047597e-03 689 KSP Residual norm 1.726863858534e-03 690 KSP Residual norm 2.291586140513e-03 691 KSP Residual norm 2.316302763676e-03 692 KSP Residual norm 3.084934879177e-03 693 KSP Residual norm 3.339479926007e-03 694 KSP Residual norm 4.689797541306e-03 695 KSP Residual norm 5.666779693003e-03 696 KSP Residual norm 9.489412336890e-03 697 KSP Residual norm 1.796592170458e-02 698 KSP Residual norm 4.959934656577e-01 699 KSP Residual norm 1.729577137666e-02 700 KSP Residual norm 8.611887409885e-03 701 KSP Residual norm 5.805837029518e-03 702 KSP Residual norm 3.958615437885e-03 703 KSP Residual norm 3.183499990784e-03 704 KSP Residual norm 2.245575105051e-03 705 KSP Residual norm 2.036558397194e-03 706 KSP Residual norm 1.489277803266e-03 707 KSP Residual norm 1.571885468221e-03 708 KSP Residual norm 1.214659176535e-03 709 KSP Residual norm 1.494198194720e-03 710 KSP Residual norm 1.268921903595e-03 711 KSP Residual norm 1.851115794153e-03 712 KSP Residual norm 1.850820878223e-03 713 KSP Residual norm 3.188160860514e-03 714 KSP Residual norm 3.861562735482e-03 715 KSP Residual norm 7.794503439947e-03 716 KSP Residual norm 1.872822563554e-02 717 KSP Residual norm 2.995282781429e-02 718 KSP Residual norm 8.313860840762e-03 719 KSP Residual norm 4.601820528687e-03 720 KSP Residual norm 3.292870384002e-03 721 KSP Residual norm 2.214759669727e-03 722 KSP Residual norm 1.953703018275e-03 723 KSP Residual norm 1.408444013770e-03 724 KSP Residual norm 1.353560143566e-03 725 KSP Residual norm 1.061014127503e-03 726 KSP Residual norm 1.121817655050e-03 727 KSP Residual norm 9.987558496197e-04 728 KSP Residual norm 1.231014100116e-03 729 KSP Residual norm 1.192554003752e-03 730 KSP Residual norm 1.613729978683e-03 731 KSP Residual norm 1.666811191056e-03 732 KSP Residual norm 2.412957289809e-03 733 KSP Residual norm 2.686203393977e-03 734 KSP Residual norm 4.317184827534e-03 735 KSP Residual norm 5.658728414410e-03 736 KSP Residual norm 1.618917954096e-02 737 KSP Residual norm 3.977939908750e-02 738 KSP Residual norm 9.389372380377e-03 739 KSP Residual norm 4.308109974069e-03 740 KSP Residual norm 3.323519067325e-03 741 KSP Residual norm 2.105006722079e-03 742 KSP Residual norm 1.683539483668e-03 743 KSP Residual norm 1.272778637488e-03 744 KSP Residual norm 1.073826053910e-03 745 KSP Residual norm 9.493812585481e-04 746 KSP Residual norm 9.204507906946e-04 747 KSP Residual norm 9.368205299380e-04 748 KSP Residual norm 9.281153157005e-04 749 KSP Residual norm 1.045786112514e-03 750 KSP Residual norm 1.144592750736e-03 751 KSP Residual norm 1.446391618838e-03 752 KSP Residual norm 1.727413658851e-03 753 KSP Residual norm 2.373243462702e-03 754 KSP Residual norm 3.077594838583e-03 755 KSP Residual norm 4.621213042755e-03 756 KSP Residual norm 7.008281271882e-03 757 KSP Residual norm 1.608210602995e-02 758 KSP Residual norm 8.340998814516e-02 759 KSP Residual norm 1.232789555437e-02 760 KSP Residual norm 6.196089093583e-03 761 KSP Residual norm 5.178446214252e-03 762 KSP Residual norm 3.733926958561e-03 763 KSP Residual norm 3.791688079330e-03 764 KSP Residual norm 2.959017605618e-03 765 KSP Residual norm 2.936978406900e-03 766 KSP Residual norm 2.473115785310e-03 767 KSP Residual norm 2.160253961871e-03 768 KSP Residual norm 1.995191239655e-03 769 KSP Residual norm 1.599844549106e-03 770 KSP Residual norm 1.612648372603e-03 771 KSP Residual norm 1.244673864222e-03 772 KSP Residual norm 1.282582870651e-03 773 KSP Residual norm 1.005476831500e-03 774 KSP Residual norm 1.052067804739e-03 775 KSP Residual norm 9.667023209045e-04 776 KSP Residual norm 1.080312423162e-03 777 KSP Residual norm 1.186153967840e-03 778 KSP Residual norm 1.470434490948e-03 779 KSP Residual norm 1.963632125034e-03 780 KSP Residual norm 2.738963983163e-03 781 KSP Residual norm 4.302471210643e-03 782 KSP Residual norm 9.220998043169e-03 783 KSP Residual norm 1.039252608448e-01 784 KSP Residual norm 8.159830891425e-03 785 KSP Residual norm 4.140963275291e-03 786 KSP Residual norm 2.804900404098e-03 787 KSP Residual norm 2.143721361888e-03 788 KSP Residual norm 1.767926845869e-03 789 KSP Residual norm 1.514791676335e-03 790 KSP Residual norm 1.491812140910e-03 791 KSP Residual norm 1.388907480168e-03 792 KSP Residual norm 1.556298648272e-03 793 KSP Residual norm 1.436927925342e-03 794 KSP Residual norm 1.558509940805e-03 795 KSP Residual norm 1.470387393258e-03 796 KSP Residual norm 1.489795522287e-03 797 KSP Residual norm 1.414632698614e-03 798 KSP Residual norm 1.385315256849e-03 799 KSP Residual norm 1.350441377998e-03 800 KSP Residual norm 1.373460583574e-03 801 KSP Residual norm 1.369823782458e-03 802 KSP Residual norm 1.442130275609e-03 803 KSP Residual norm 1.526911302885e-03 804 KSP Residual norm 1.698645980225e-03 805 KSP Residual norm 2.110891164170e-03 806 KSP Residual norm 2.553191200204e-03 807 KSP Residual norm 3.967594968761e-03 808 KSP Residual norm 5.967541830895e-03 809 KSP Residual norm 1.824274411850e-02 810 KSP Residual norm 2.896802245901e-02 811 KSP Residual norm 8.805199786454e-03 812 KSP Residual norm 4.380703213122e-03 813 KSP Residual norm 3.476341893238e-03 814 KSP Residual norm 2.223584933564e-03 815 KSP Residual norm 1.949641130055e-03 816 KSP Residual norm 1.394655054554e-03 817 KSP Residual norm 1.215381696077e-03 818 KSP Residual norm 1.025117539481e-03 819 KSP Residual norm 8.859200384724e-04 820 KSP Residual norm 8.809781160994e-04 821 KSP Residual norm 7.928704986446e-04 822 KSP Residual norm 1.000958309088e-03 823 KSP Residual norm 9.295224992083e-04 824 KSP Residual norm 1.460721359287e-03 825 KSP Residual norm 1.448291907377e-03 826 KSP Residual norm 2.786236532998e-03 827 KSP Residual norm 3.254931501314e-03 828 KSP Residual norm 8.570924139438e-03 829 KSP Residual norm 5.419391941960e-02 830 KSP Residual norm 1.258241345418e-02 831 KSP Residual norm 5.329782190563e-03 832 KSP Residual norm 4.102321751661e-03 833 KSP Residual norm 2.823105021604e-03 834 KSP Residual norm 2.459487740182e-03 835 KSP Residual norm 2.026810660912e-03 836 KSP Residual norm 1.795790482523e-03 837 KSP Residual norm 1.678876156541e-03 838 KSP Residual norm 1.489804750256e-03 839 KSP Residual norm 1.649909384123e-03 840 KSP Residual norm 1.706067268169e-03 841 KSP Residual norm 2.340101887189e-03 842 KSP Residual norm 2.071524944606e-03 843 KSP Residual norm 4.267754484700e-03 844 KSP Residual norm 2.366884390001e-03 845 KSP Residual norm 9.319073774419e-03 846 KSP Residual norm 4.937903763603e-03 847 KSP Residual norm 3.594563257918e-02 848 KSP Residual norm 4.403143872929e-02 849 KSP Residual norm 1.968190470573e-01 850 KSP Residual norm 1.849162649559e-01 851 KSP Residual norm 3.614364356013e-02 852 KSP Residual norm 2.273344244162e-02 853 KSP Residual norm 7.882588048708e-03 854 KSP Residual norm 6.266809449317e-03 855 KSP Residual norm 4.866920666669e-03 856 KSP Residual norm 3.963150795547e-03 857 KSP Residual norm 5.172739147815e-03 858 KSP Residual norm 5.091505460681e-03 859 KSP Residual norm 8.844072389322e-03 860 KSP Residual norm 2.566453551524e-02 861 KSP Residual norm 6.285995622650e-02 862 KSP Residual norm 8.688012060364e-03 863 KSP Residual norm 1.331806232848e-02 864 KSP Residual norm 3.813685032335e-03 865 KSP Residual norm 5.500267752473e-03 866 KSP Residual norm 2.350439122339e-03 867 KSP Residual norm 3.057007164339e-03 868 KSP Residual norm 1.767504298026e-03 869 KSP Residual norm 2.055903914640e-03 870 KSP Residual norm 1.556153117658e-03 871 KSP Residual norm 1.684638545564e-03 872 KSP Residual norm 1.580652594713e-03 873 KSP Residual norm 1.767614963069e-03 874 KSP Residual norm 1.836302412834e-03 875 KSP Residual norm 2.370415842526e-03 876 KSP Residual norm 2.297667354455e-03 877 KSP Residual norm 3.960856441515e-03 878 KSP Residual norm 3.511627044844e-03 879 KSP Residual norm 1.002096403742e-02 880 KSP Residual norm 1.067638755648e-02 881 KSP Residual norm 9.722941077440e-02 882 KSP Residual norm 8.788071562390e-03 883 KSP Residual norm 1.472846891375e-02 884 KSP Residual norm 3.417980451951e-03 885 KSP Residual norm 1.173728564996e-02 886 KSP Residual norm 2.678552285652e-03 887 KSP Residual norm 1.464080581481e-02 888 KSP Residual norm 4.214016940557e-03 889 KSP Residual norm 1.426387581601e-01 890 KSP Residual norm 2.871257366964e-02 891 KSP Residual norm 8.017913084452e-03 892 KSP Residual norm 4.484575318856e-03 893 KSP Residual norm 2.891347851714e-03 894 KSP Residual norm 2.314227938174e-03 895 KSP Residual norm 1.632536242264e-03 896 KSP Residual norm 1.302127383816e-03 897 KSP Residual norm 1.162693024589e-03 898 KSP Residual norm 9.389818915090e-04 899 KSP Residual norm 1.004628515198e-03 900 KSP Residual norm 1.391522218159e-03 901 KSP Residual norm 1.118014790682e-03 902 KSP Residual norm 3.743364532615e-03 903 KSP Residual norm 1.694493301658e-03 904 KSP Residual norm 1.883170344129e-02 905 KSP Residual norm 5.196394010940e-03 906 KSP Residual norm 7.152330472709e-02 907 KSP Residual norm 3.246787709767e-02 908 KSP Residual norm 6.646674247509e-02 909 KSP Residual norm 3.333294477414e-03 910 KSP Residual norm 5.816959177227e-03 911 KSP Residual norm 2.019591211770e-03 912 KSP Residual norm 1.948064689808e-03 913 KSP Residual norm 1.711654219872e-03 914 KSP Residual norm 1.776219845950e-03 915 KSP Residual norm 1.891216431884e-03 916 KSP Residual norm 3.736332474999e-03 917 KSP Residual norm 2.892851593488e-03 918 KSP Residual norm 1.680871582429e-02 919 KSP Residual norm 1.139841754516e-02 920 KSP Residual norm 1.344166841034e-02 921 KSP Residual norm 5.711724618198e-03 922 KSP Residual norm 5.316884033249e-03 923 KSP Residual norm 2.688984068112e-03 924 KSP Residual norm 3.037526692558e-03 925 KSP Residual norm 1.840928701800e-03 926 KSP Residual norm 2.213509045841e-03 927 KSP Residual norm 1.405646647318e-03 928 KSP Residual norm 2.252202596370e-03 929 KSP Residual norm 1.291338004993e-03 930 KSP Residual norm 3.125142383028e-03 931 KSP Residual norm 1.524370382923e-03 932 KSP Residual norm 5.990241114465e-03 933 KSP Residual norm 4.306019146762e-03 934 KSP Residual norm 1.581048059748e-01 935 KSP Residual norm 2.962317508512e-03 936 KSP Residual norm 3.876875926942e-03 937 KSP Residual norm 1.053303688560e-03 938 KSP Residual norm 1.353232642744e-03 939 KSP Residual norm 6.786513793162e-04 940 KSP Residual norm 6.426092104388e-04 941 KSP Residual norm 5.736322551248e-04 942 KSP Residual norm 4.304913805501e-04 943 KSP Residual norm 6.505165870438e-04 944 KSP Residual norm 5.787545759083e-04 945 KSP Residual norm 1.107082892229e-03 946 KSP Residual norm 1.563374762765e-03 947 KSP Residual norm 2.836319222904e-03 948 KSP Residual norm 5.328105647367e-02 949 KSP Residual norm 3.204637600318e-01 950 KSP Residual norm 3.792328971054e-03 951 KSP Residual norm 5.910124028716e-03 952 KSP Residual norm 2.966604033487e-03 953 KSP Residual norm 5.851220081742e-03 954 KSP Residual norm 5.915997335622e-03 955 KSP Residual norm 3.672090247620e-02 956 KSP Residual norm 2.079715362446e-01 957 KSP Residual norm 3.470819113843e-01 958 KSP Residual norm 2.898125635959e-02 959 KSP Residual norm 8.431031576300e-03 960 KSP Residual norm 2.161748267862e-03 961 KSP Residual norm 3.113831067415e-03 962 KSP Residual norm 1.783687854833e-03 963 KSP Residual norm 1.683170710599e-03 964 KSP Residual norm 1.575304165401e-03 965 KSP Residual norm 1.078661374987e-03 966 KSP Residual norm 1.286262101658e-03 967 KSP Residual norm 7.573922335667e-04 968 KSP Residual norm 9.134355266936e-04 969 KSP Residual norm 5.316423433037e-04 970 KSP Residual norm 5.836210451626e-04 971 KSP Residual norm 4.050874589977e-04 972 KSP Residual norm 4.661182114361e-04 973 KSP Residual norm 4.309526235273e-04 974 KSP Residual norm 4.952611853917e-04 975 KSP Residual norm 5.501206894677e-04 976 KSP Residual norm 6.425390011620e-04 977 KSP Residual norm 8.026209184804e-04 978 KSP Residual norm 1.013325593382e-03 979 KSP Residual norm 1.315592336009e-03 980 KSP Residual norm 1.779455412570e-03 981 KSP Residual norm 2.729824153397e-03 982 KSP Residual norm 5.183087293495e-03 983 KSP Residual norm 3.772241785456e-01 984 KSP Residual norm 5.828007870144e-03 985 KSP Residual norm 2.820694222921e-03 986 KSP Residual norm 1.741387557784e-03 987 KSP Residual norm 1.616251234780e-03 988 KSP Residual norm 9.711626934190e-04 989 KSP Residual norm 1.392967980955e-03 990 KSP Residual norm 6.947830630172e-04 991 KSP Residual norm 1.536555599691e-03 992 KSP Residual norm 7.594537005005e-04 993 KSP Residual norm 2.321350848624e-03 994 KSP Residual norm 2.109371584905e-03 995 KSP Residual norm 1.652529745871e-02 996 KSP Residual norm 7.544914340239e-04 997 KSP Residual norm 2.316151051098e-03 998 KSP Residual norm 2.566871991827e-04 999 KSP Residual norm 1.014581011445e-03 1000 KSP Residual norm 2.538060451493e-04 1001 KSP Residual norm 6.521205667877e-04 1002 KSP Residual norm 3.326390838188e-04 1003 KSP Residual norm 6.062226219268e-04 1004 KSP Residual norm 5.561062947400e-04 1005 KSP Residual norm 7.834431478661e-04 1006 KSP Residual norm 1.166305163277e-03 1007 KSP Residual norm 1.258063513072e-03 1008 KSP Residual norm 2.944642144381e-03 1009 KSP Residual norm 3.467391489836e-03 1010 KSP Residual norm 1.789081339294e-01 1011 KSP Residual norm 5.179824404554e-03 1012 KSP Residual norm 3.815483517228e-03 1013 KSP Residual norm 1.947336332492e-03 1014 KSP Residual norm 2.165677084523e-03 1015 KSP Residual norm 1.647190732004e-03 1016 KSP Residual norm 1.884566894147e-03 1017 KSP Residual norm 2.003273022357e-03 1018 KSP Residual norm 2.087733503168e-03 1019 KSP Residual norm 3.171053292294e-03 1020 KSP Residual norm 2.372767734515e-03 1021 KSP Residual norm 5.679257130610e-03 1022 KSP Residual norm 2.539452514037e-03 1023 KSP Residual norm 1.133834358214e-02 1024 KSP Residual norm 3.637816649419e-03 1025 KSP Residual norm 1.528553732355e-01 1026 KSP Residual norm 5.493817790634e-04 1027 KSP Residual norm 6.560314850306e-03 1028 KSP Residual norm 7.605675399511e-04 1029 KSP Residual norm 3.048641286510e-03 1030 KSP Residual norm 9.522353241307e-04 1031 KSP Residual norm 2.328190272378e-03 1032 KSP Residual norm 1.114601050263e-03 1033 KSP Residual norm 2.303653247637e-03 1034 KSP Residual norm 1.135023927896e-03 1035 KSP Residual norm 2.486330274858e-03 1036 KSP Residual norm 9.664480638990e-04 1037 KSP Residual norm 3.022838192397e-03 1038 KSP Residual norm 9.484711697698e-04 1039 KSP Residual norm 4.179976690905e-03 1040 KSP Residual norm 1.500014302070e-03 1041 KSP Residual norm 7.146333194133e-03 1042 KSP Residual norm 4.391218532439e-03 1043 KSP Residual norm 2.114434691600e-02 1044 KSP Residual norm 9.945510473519e-02 1045 KSP Residual norm 1.242608405087e-02 1046 KSP Residual norm 9.683099779710e-03 1047 KSP Residual norm 1.017261881541e-03 1048 KSP Residual norm 1.032563391157e-02 1049 KSP Residual norm 5.179381414405e-03 1050 KSP Residual norm 1.825451989437e-02 1051 KSP Residual norm 5.399559784104e-03 1052 KSP Residual norm 2.333672354986e-03 1053 KSP Residual norm 1.261432321705e-03 1054 KSP Residual norm 1.213721675601e-03 1055 KSP Residual norm 2.267441881765e-03 1056 KSP Residual norm 1.883439571371e-03 1057 KSP Residual norm 4.858841185226e-03 1058 KSP Residual norm 3.879393232410e-03 1059 KSP Residual norm 1.494647500123e-03 1060 KSP Residual norm 1.534227173987e-03 1061 KSP Residual norm 1.036079438110e-03 1062 KSP Residual norm 1.612238612289e-03 1063 KSP Residual norm 1.271062301481e-03 1064 KSP Residual norm 2.533652169612e-03 1065 KSP Residual norm 2.545333821908e-03 1066 KSP Residual norm 5.746519474368e-03 1067 KSP Residual norm 1.600804293135e-02 1068 KSP Residual norm 1.083835461041e-02 1069 KSP Residual norm 3.906560579206e-03 1070 KSP Residual norm 2.165408135692e-03 1071 KSP Residual norm 1.819124460814e-03 1072 KSP Residual norm 9.472271872706e-04 1073 KSP Residual norm 1.078011871117e-03 1074 KSP Residual norm 4.535732574995e-04 1075 KSP Residual norm 6.771579231652e-04 1076 KSP Residual norm 2.299339731803e-04 1077 KSP Residual norm 4.394550751578e-04 1078 KSP Residual norm 1.445757897067e-04 1079 KSP Residual norm 3.258942587371e-04 1080 KSP Residual norm 1.572683495218e-04 1081 KSP Residual norm 3.003862273713e-04 1082 KSP Residual norm 2.848051654417e-04 1083 KSP Residual norm 3.675811864159e-04 1084 KSP Residual norm 6.821634071636e-04 1085 KSP Residual norm 6.975948407955e-04 1086 KSP Residual norm 2.906249615339e-03 1087 KSP Residual norm 1.976006038239e-02 1088 KSP Residual norm 2.912336926513e-03 1089 KSP Residual norm 5.471399984631e-04 1090 KSP Residual norm 9.992019994088e-04 1091 KSP Residual norm 2.319486163287e-04 1092 KSP Residual norm 5.413900368217e-04 1093 KSP Residual norm 1.458870679904e-04 1094 KSP Residual norm 3.468061135336e-04 1095 KSP Residual norm 1.661905855634e-04 1096 KSP Residual norm 2.998383557104e-04 1097 KSP Residual norm 2.764250204418e-04 1098 KSP Residual norm 2.932061611914e-04 1099 KSP Residual norm 4.818706223488e-04 1100 KSP Residual norm 2.869319882796e-04 1101 KSP Residual norm 6.780418237054e-04 1102 KSP Residual norm 5.401338949549e-04 1103 KSP Residual norm 7.909544900072e-04 1104 KSP Residual norm 1.374047728489e-03 1105 KSP Residual norm 9.311861212886e-04 1106 KSP Residual norm 4.631833537233e-03 1107 KSP Residual norm 1.008495765528e-03 1108 KSP Residual norm 1.270177744896e+00 1109 KSP Residual norm 3.598080961234e-02 1110 KSP Residual norm 1.271209672591e+00 1111 KSP Residual norm 2.802855342323e-03 1112 KSP Residual norm 4.008619198895e-03 1113 KSP Residual norm 8.964182894336e-04 1114 KSP Residual norm 1.231282170730e-03 1115 KSP Residual norm 4.290837612984e-04 1116 KSP Residual norm 5.550266545246e-04 1117 KSP Residual norm 2.637829190406e-04 1118 KSP Residual norm 3.860914881881e-04 1119 KSP Residual norm 1.861175128761e-04 1120 KSP Residual norm 4.187098576742e-04 1121 KSP Residual norm 1.875589220649e-04 1122 KSP Residual norm 6.818155989983e-04 1123 KSP Residual norm 6.073929635377e-04 1124 KSP Residual norm 2.014450651631e-03 1125 KSP Residual norm 4.801459579889e-03 1126 KSP Residual norm 6.682239485901e-03 1127 KSP Residual norm 1.780580731574e-03 1128 KSP Residual norm 2.341578025250e-03 1129 KSP Residual norm 2.878047881517e-03 1130 KSP Residual norm 4.405573903358e-03 1131 KSP Residual norm 1.043132485884e-02 1132 KSP Residual norm 6.193706214313e-04 1133 KSP Residual norm 1.434766059575e-03 1134 KSP Residual norm 1.899177113587e-04 1135 KSP Residual norm 6.569294553827e-04 1136 KSP Residual norm 1.430055571747e-04 1137 KSP Residual norm 4.224124460800e-04 1138 KSP Residual norm 1.556989062319e-04 1139 KSP Residual norm 3.658743115544e-04 1140 KSP Residual norm 2.284417881628e-04 1141 KSP Residual norm 3.610207897277e-04 1142 KSP Residual norm 3.749500997159e-04 1143 KSP Residual norm 4.135084031295e-04 1144 KSP Residual norm 8.398616639801e-04 1145 KSP Residual norm 2.423995535600e-03 1146 KSP Residual norm 2.280112104475e-03 1147 KSP Residual norm 1.990822632968e-04 1148 KSP Residual norm 4.398923940394e-04 1149 KSP Residual norm 1.960698081326e-04 1150 KSP Residual norm 3.153517252415e-04 1151 KSP Residual norm 3.350836178455e-04 1152 KSP Residual norm 3.636602984761e-04 1153 KSP Residual norm 6.415712206742e-04 1154 KSP Residual norm 4.376434279149e-04 1155 KSP Residual norm 1.458172412489e-03 1156 KSP Residual norm 5.205736911886e-04 1157 KSP Residual norm 1.105475445421e-01 1158 KSP Residual norm 5.095921549921e-04 1159 KSP Residual norm 2.388579740500e-03 1160 KSP Residual norm 1.067009852696e-03 1161 KSP Residual norm 3.956892561489e-03 1162 KSP Residual norm 5.264399809788e-03 1163 KSP Residual norm 2.279347842234e-03 1164 KSP Residual norm 6.371161540855e-04 1165 KSP Residual norm 5.083246514676e-04 1166 KSP Residual norm 3.358903422436e-04 1167 KSP Residual norm 1.875409005709e-04 1168 KSP Residual norm 2.435087560327e-04 1169 KSP Residual norm 9.742093397620e-05 1170 KSP Residual norm 2.432666554968e-04 1171 KSP Residual norm 9.224293519368e-05 1172 KSP Residual norm 7.341282128991e-04 1173 KSP Residual norm 5.889206358786e-04 1174 KSP Residual norm 3.335759216083e-04 1175 KSP Residual norm 1.296190754595e-04 1176 KSP Residual norm 2.039604771362e-04 1177 KSP Residual norm 1.901473229080e-04 1178 KSP Residual norm 2.504950787441e-04 1179 KSP Residual norm 9.788519621141e-04 1180 KSP Residual norm 9.951474041704e-04 1181 KSP Residual norm 2.752463977862e-03 1182 KSP Residual norm 5.107450638725e-04 1183 KSP Residual norm 5.714737261842e-03 1184 KSP Residual norm 2.707955182022e-04 1185 KSP Residual norm 5.442706048994e-04 1186 KSP Residual norm 2.619948843151e-04 1187 KSP Residual norm 3.159646252181e-04 1188 KSP Residual norm 8.012209948894e-04 1189 KSP Residual norm 1.506591826806e-04 1190 KSP Residual norm 3.823721089625e-04 1191 KSP Residual norm 6.760090248267e-05 1192 KSP Residual norm 2.220063216425e-04 1193 KSP Residual norm 1.262809834715e-04 1194 KSP Residual norm 1.983462399446e-04 1195 KSP Residual norm 1.783745479475e-04 1196 KSP Residual norm 1.791408158677e-04 1197 KSP Residual norm 2.652609661730e-04 1198 KSP Residual norm 2.224684303089e-04 1199 KSP Residual norm 9.212951133315e-04 1200 KSP Residual norm 6.185284779559e-04 1201 KSP Residual norm 3.273385273272e-03 1202 KSP Residual norm 9.092257450590e-04 1203 KSP Residual norm 5.633988479432e-03 1204 KSP Residual norm 9.891032325744e-04 1205 KSP Residual norm 5.783994736970e-04 1206 KSP Residual norm 4.754044168327e-04 1207 KSP Residual norm 1.761074508592e-04 1208 KSP Residual norm 2.801794265920e-04 1209 KSP Residual norm 1.671620218140e-04 1210 KSP Residual norm 1.558917431194e-04 1211 KSP Residual norm 1.077865797590e-04 1212 KSP Residual norm 1.363012502693e-04 1213 KSP Residual norm 1.134494803936e-04 1214 KSP Residual norm 2.233652430067e-04 1215 KSP Residual norm 2.720577735934e-03 1216 KSP Residual norm 1.744767452018e-03 1217 KSP Residual norm 4.105542260281e-04 1218 KSP Residual norm 2.111293463063e-04 1219 KSP Residual norm 4.666441011328e-04 1220 KSP Residual norm 8.516455723916e-04 1221 KSP Residual norm 5.931546968094e-03 1222 KSP Residual norm 2.363002839288e-03 1223 KSP Residual norm 6.135690034574e-03 1224 KSP Residual norm 6.130563984167e-04 1225 KSP Residual norm 4.144677131907e-04 1226 KSP Residual norm 1.053678776065e-04 1227 KSP Residual norm 1.219537730473e-04 1228 KSP Residual norm 1.699459339995e-04 1229 KSP Residual norm 1.302749088107e-04 1230 KSP Residual norm 6.903598661884e-04 1231 KSP Residual norm 5.850967849434e-05 1232 KSP Residual norm 1.057906464004e-04 1233 KSP Residual norm 8.530469649502e-05 1234 KSP Residual norm 7.482784464342e-05 1235 KSP Residual norm 7.536072575857e-05 1236 KSP Residual norm 6.575297932420e-05 1237 KSP Residual norm 9.609196535293e-05 1238 KSP Residual norm 7.105334115064e-05 1239 KSP Residual norm 1.883960852049e-04 1240 KSP Residual norm 1.313580659582e-04 1241 KSP Residual norm 6.284392878810e-04 1242 KSP Residual norm 4.891734712307e-04 1243 KSP Residual norm 4.776602423540e-03 1244 KSP Residual norm 4.383944694482e-02 1245 KSP Residual norm 3.272398952984e-03 1246 KSP Residual norm 1.566062417102e-04 1247 KSP Residual norm 3.145987838972e-04 1248 KSP Residual norm 8.018856611732e-05 1249 KSP Residual norm 8.347888587416e-05 1250 KSP Residual norm 9.150219790332e-05 1251 KSP Residual norm 2.548030088978e-05 1252 KSP Residual norm 1.291239241405e-04 1253 KSP Residual norm 6.298015315238e-05 1254 KSP Residual norm 2.964172610309e-04 1255 KSP Residual norm 3.102940467499e-04 1256 KSP Residual norm 5.758520441291e-05 1257 KSP Residual norm 1.203819793936e-04 1258 KSP Residual norm 6.554927861865e-05 1259 KSP Residual norm 1.978421032483e-04 1260 KSP Residual norm 2.571152675923e-04 1261 KSP Residual norm 7.152828255173e-04 1262 KSP Residual norm 5.592584080820e-03 1263 KSP Residual norm 8.875047467384e-04 1264 KSP Residual norm 1.537064162971e-04 1265 KSP Residual norm 5.157568666821e-04 1266 KSP Residual norm 7.664326353235e-04 1267 KSP Residual norm 8.925133710495e-04 1268 KSP Residual norm 1.011250974870e-04 1269 KSP Residual norm 1.380130854272e-04 1270 KSP Residual norm 3.635196503191e-05 1271 KSP Residual norm 8.172119040428e-05 1272 KSP Residual norm 2.459622975441e-05 1273 KSP Residual norm 7.444929429121e-05 1274 KSP Residual norm 5.157709196070e-05 1275 KSP Residual norm 4.562297783504e-04 1276 KSP Residual norm 1.801032546226e-03 1277 KSP Residual norm 2.817162383945e-05 1278 KSP Residual norm 6.905867593975e-05 1279 KSP Residual norm 1.723504164060e-05 1280 KSP Residual norm 5.297410744628e-05 1281 KSP Residual norm 3.165077968253e-05 1282 KSP Residual norm 7.757133729693e-05 1283 KSP Residual norm 1.543295968619e-04 1284 KSP Residual norm 8.769582297631e-04 1285 KSP Residual norm 2.209994550707e-04 1286 KSP Residual norm 1.228000351070e-04 1287 KSP Residual norm 2.145479462176e-04 1288 KSP Residual norm 7.469692328607e-05 1289 KSP Residual norm 1.299096588066e-04 1290 KSP Residual norm 2.077479409801e-05 1291 KSP Residual norm 2.792178590693e-05 1292 KSP Residual norm 1.710454714940e-05 1293 KSP Residual norm 1.985585237812e-05 1294 KSP Residual norm 2.181848911437e-05 1295 KSP Residual norm 3.902076818318e-05 1296 KSP Residual norm 3.367269220136e-05 1297 KSP Residual norm 2.055664986179e-04 1298 KSP Residual norm 9.782856905778e-05 1299 KSP Residual norm 2.873477344104e-04 1300 KSP Residual norm 6.228521170797e-05 1301 KSP Residual norm 1.478465762747e-04 1302 KSP Residual norm 1.180102858089e-04 1303 KSP Residual norm 1.534566362409e-04 1304 KSP Residual norm 7.320900518334e-04 1305 KSP Residual norm 4.649318275970e-04 1306 KSP Residual norm 3.137678684639e-04 1307 KSP Residual norm 2.336305510114e-04 1308 KSP Residual norm 5.039301818787e-04 1309 KSP Residual norm 8.845919707595e-05 1310 KSP Residual norm 4.987136427514e-05 1311 KSP Residual norm 4.404583995040e-05 1312 KSP Residual norm 2.454555606089e-05 1313 KSP Residual norm 3.680370686422e-05 1314 KSP Residual norm 1.750781845183e-05 1315 KSP Residual norm 3.210862049987e-05 1316 KSP Residual norm 1.346520528294e-05 1317 KSP Residual norm 1.000470548204e-04 1318 KSP Residual norm 1.439732555101e-04 1319 KSP Residual norm 4.204235323068e-05 1320 KSP Residual norm 1.078036280594e-04 1321 KSP Residual norm 1.149090128859e-04 1322 KSP Residual norm 3.105445657577e-04 1323 KSP Residual norm 2.048547911956e-04 1324 KSP Residual norm 3.132129635794e-04 1325 KSP Residual norm 4.525179933749e-04 1326 KSP Residual norm 2.031007916021e-04 1327 KSP Residual norm 1.508651323129e-04 1328 KSP Residual norm 7.811036752588e-05 1329 KSP Residual norm 3.043060454317e-04 1330 KSP Residual norm 2.106434451630e-04 1331 KSP Residual norm 1.249728037236e-04 1332 KSP Residual norm 1.371686545864e-04 1333 KSP Residual norm 2.697012294016e-05 1334 KSP Residual norm 3.782747132807e-05 1335 KSP Residual norm 1.002329560278e-05 1336 KSP Residual norm 1.402534098194e-05 1337 KSP Residual norm 8.817150378232e-06 1338 KSP Residual norm 1.258439373738e-05 1339 KSP Residual norm 3.042291350538e-05 1340 KSP Residual norm 1.490486329717e-05 1341 KSP Residual norm 2.884070926951e-05 1342 KSP Residual norm 1.629099481967e-05 1343 KSP Residual norm 3.712018084475e-05 1344 KSP Residual norm 1.110311743165e-04 1345 KSP Residual norm 8.612755719793e-04 1346 KSP Residual norm 6.826172488477e-04 1347 KSP Residual norm 1.679752064926e-04 1348 KSP Residual norm 7.606425385507e-05 1349 KSP Residual norm 3.804156097988e-05 1350 KSP Residual norm 3.657615677401e-05 1351 KSP Residual norm 4.819497902218e-05 1352 KSP Residual norm 2.266521540014e-04 1353 KSP Residual norm 2.762800409851e-05 1354 KSP Residual norm 2.536325995904e-05 1355 KSP Residual norm 7.739503102319e-05 1356 KSP Residual norm 9.110894339995e-04 1357 KSP Residual norm 8.526584350133e-04 1358 KSP Residual norm 7.892689637825e-05 1359 KSP Residual norm 8.919172683743e-06 1360 KSP Residual norm 4.023251698904e-05 1361 KSP Residual norm 1.607161275341e-05 1362 KSP Residual norm 1.486132831670e-05 1363 KSP Residual norm 2.150829098302e-05 1364 KSP Residual norm 2.338800274308e-05 1365 KSP Residual norm 3.061864087734e-05 1366 KSP Residual norm 4.013031679626e-05 1367 KSP Residual norm 5.994189720693e-05 1368 KSP Residual norm 6.151894429995e-05 1369 KSP Residual norm 3.664344285670e-04 1370 KSP Residual norm 2.305589888131e-03 1371 KSP Residual norm 3.434450820063e-04 1372 KSP Residual norm 7.674198935565e-05 1373 KSP Residual norm 2.234863508606e-04 1374 KSP Residual norm 3.561304940544e-05 1375 KSP Residual norm 1.318224323943e-03 1376 KSP Residual norm 3.248154393747e-05 1377 KSP Residual norm 1.887329667494e-04 1378 KSP Residual norm 5.732415184417e-05 1379 KSP Residual norm 4.825644442281e-05 1380 KSP Residual norm 7.474274599291e-05 1381 KSP Residual norm 1.197088877698e-04 1382 KSP Residual norm 1.173083980188e-04 1383 KSP Residual norm 2.557873680288e-05 1384 KSP Residual norm 1.484355572815e-05 1385 KSP Residual norm 1.897697685842e-05 1386 KSP Residual norm 5.787338611007e-05 1387 KSP Residual norm 2.276727004670e-05 1388 KSP Residual norm 3.716230416021e-04 1389 KSP Residual norm 2.206573100894e-05 1390 KSP Residual norm 1.056979499451e-04 1391 KSP Residual norm 1.616503139284e-04 1392 KSP Residual norm 1.330543174938e-04 1393 KSP Residual norm 2.657212496157e-04 1394 KSP Residual norm 1.258630868299e-03 1395 KSP Residual norm 2.410266081827e-04 1396 KSP Residual norm 2.019344635335e-04 1397 KSP Residual norm 8.712070539718e-05 1398 KSP Residual norm 7.457438476344e-05 1399 KSP Residual norm 4.941629503586e-05 1400 KSP Residual norm 3.214064542167e-05 1401 KSP Residual norm 3.171595276517e-05 1402 KSP Residual norm 2.055711840225e-05 1403 KSP Residual norm 2.227786734821e-05 1404 KSP Residual norm 3.500282843845e-05 1405 KSP Residual norm 2.255674103526e-05 1406 KSP Residual norm 8.200485890019e-05 1407 KSP Residual norm 1.041856274484e-05 1408 KSP Residual norm 1.400936785982e-05 1409 KSP Residual norm 3.540269145642e-06 1410 KSP Residual norm 7.228571422443e-06 1411 KSP Residual norm 4.030746370654e-06 1412 KSP Residual norm 5.745076034199e-06 1413 KSP Residual norm 7.242248502902e-06 1414 KSP Residual norm 7.238044941456e-06 1415 KSP Residual norm 1.910196404804e-05 1416 KSP Residual norm 2.401437027355e-05 1417 KSP Residual norm 2.765083036543e-04 1418 KSP Residual norm 6.272741312045e-05 1419 KSP Residual norm 1.840293064439e-04 1420 KSP Residual norm 3.919280306016e-05 1421 KSP Residual norm 4.013363415717e-05 1422 KSP Residual norm 1.251723652952e-05 1423 KSP Residual norm 1.220622131860e-05 1424 KSP Residual norm 9.656111115038e-06 1425 KSP Residual norm 8.702362267456e-06 1426 KSP Residual norm 1.052449440009e-05 1427 KSP Residual norm 5.458761531935e-05 1428 KSP Residual norm 4.692660279643e-05 1429 KSP Residual norm 7.858823389532e-06 1430 KSP Residual norm 5.640206075277e-05 1431 KSP Residual norm 5.915617111209e-06 1432 KSP Residual norm 8.847671457706e-06 1433 KSP Residual norm 4.883690982863e-06 1434 KSP Residual norm 7.720578293518e-05 1435 KSP Residual norm 6.312762727739e-05 1436 KSP Residual norm 2.515721975162e-05 1437 KSP Residual norm 2.017626893065e-05 1438 KSP Residual norm 1.169235039202e-04 1439 KSP Residual norm 1.854795855138e-05 1440 KSP Residual norm 1.341726057736e-05 1441 KSP Residual norm 6.780475156536e-06 1442 KSP Residual norm 5.364951115618e-06 1443 KSP Residual norm 4.361865585599e-06 1444 KSP Residual norm 3.316028238364e-06 1445 KSP Residual norm 3.350195967070e-06 1446 KSP Residual norm 2.608038326062e-06 1447 KSP Residual norm 2.663155245606e-06 1448 KSP Residual norm 2.636316515428e-06 1449 KSP Residual norm 2.256744622522e-06 1450 KSP Residual norm 2.667562868727e-06 1451 KSP Residual norm 2.154725320276e-06 Linear solve converged due to CONVERGED_RTOL iterations 1451 KSP Object: 4 MPI processes type: groppcg maximum iterations=40000, initial guess is zero tolerances: relative=1e-06, absolute=1e-50, divergence=1e+06 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: 4 MPI processes type: gamg type is MULTIPLICATIVE, levels=4 cycles=v Cycles per PCApply=1 Using externally compute Galerkin coarse grid matrices GAMG specific options Threshold for dropping small values in graph on each level = -1. -1. -1. -1. Threshold scaling factor for each level not specified = 1. AGG specific options Number of levels to square graph 1 Number smoothing steps 1 Complexity: grid = 1.01439 operator = 1.03229 Coarse grid solver -- level 0 ------------------------------- KSP Object: (mg_coarse_) 4 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_coarse_) 4 MPI processes type: bjacobi number of blocks = 4 Local solver information for first block is in the following KSP and PC objects on rank 0: Use -mg_coarse_ksp_view ::ascii_info_detail to display information for all blocks KSP Object: (mg_coarse_sub_) 1 MPI process type: preonly maximum iterations=1, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_coarse_sub_) 1 MPI process type: lu out-of-place factorization tolerance for zero pivot 2.22045e-14 using diagonal shift on blocks to prevent zero pivot [INBLOCKS] matrix ordering: nd factor fill ratio given 5., needed 1. Factored matrix follows: Mat Object: (mg_coarse_sub_) 1 MPI process type: seqaijcusparse rows=19, cols=19 package used to perform factorization: cusparse total: nonzeros=361, allocated nonzeros=361 using I-node routines: found 4 nodes, limit used is 5 linear system matrix = precond matrix: Mat Object: (mg_coarse_sub_) 1 MPI process type: seqaijcusparse rows=19, cols=19 total: nonzeros=361, allocated nonzeros=361 total number of mallocs used during MatSetValues calls=0 not using I-node routines linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=19, cols=19 total: nonzeros=361, allocated nonzeros=361 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Down solver (pre-smoother) on level 1 ------------------------------- KSP Object: (mg_levels_1_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.214884, max 2.36372 eigenvalues provided (min 0.349763, max 2.14884) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_1_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=777, cols=777 total: nonzeros=207255, allocated nonzeros=207255 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 2 ------------------------------- KSP Object: (mg_levels_2_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.136436, max 1.50079 eigenvalues provided (min 0.555598, max 1.36436) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_2_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=10842, cols=10842 total: nonzeros=907022, allocated nonzeros=907022 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 3 ------------------------------- KSP Object: (mg_levels_3_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.523254, max 5.75579 eigenvalues provided (min 0.247422, max 5.23254) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_3_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=808996, cols=808996 total: nonzeros=34524680, allocated nonzeros=147207720 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=808996, cols=808996 total: nonzeros=34524680, allocated nonzeros=147207720 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines In petsc::solve(), after solution of Ax = b KSP Object: 4 MPI processes type: groppcg maximum iterations=40000, initial guess is zero tolerances: relative=1e-06, absolute=1e-50, divergence=1e+06 left preconditioning using PRECONDITIONED norm type for convergence test PC Object: 4 MPI processes type: gamg type is MULTIPLICATIVE, levels=4 cycles=v Cycles per PCApply=1 Using externally compute Galerkin coarse grid matrices GAMG specific options Threshold for dropping small values in graph on each level = -1. -1. -1. -1. Threshold scaling factor for each level not specified = 1. AGG specific options Number of levels to square graph 1 Number smoothing steps 1 Complexity: grid = 1.01439 operator = 1.03229 Coarse grid solver -- level 0 ------------------------------- KSP Object: (mg_coarse_) 4 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_coarse_) 4 MPI processes type: bjacobi number of blocks = 4 Local solver information for first block is in the following KSP and PC objects on rank 0: Use -mg_coarse_ksp_view ::ascii_info_detail to display information for all blocks KSP Object: (mg_coarse_sub_) 1 MPI process type: preonly maximum iterations=1, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_coarse_sub_) 1 MPI process type: lu out-of-place factorization tolerance for zero pivot 2.22045e-14 using diagonal shift on blocks to prevent zero pivot [INBLOCKS] matrix ordering: nd factor fill ratio given 5., needed 1. Factored matrix follows: Mat Object: (mg_coarse_sub_) 1 MPI process type: seqaijcusparse rows=19, cols=19 package used to perform factorization: cusparse total: nonzeros=361, allocated nonzeros=361 using I-node routines: found 4 nodes, limit used is 5 linear system matrix = precond matrix: Mat Object: (mg_coarse_sub_) 1 MPI process type: seqaijcusparse rows=19, cols=19 total: nonzeros=361, allocated nonzeros=361 total number of mallocs used during MatSetValues calls=0 not using I-node routines linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=19, cols=19 total: nonzeros=361, allocated nonzeros=361 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Down solver (pre-smoother) on level 1 ------------------------------- KSP Object: (mg_levels_1_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.214884, max 2.36372 eigenvalues provided (min 0.349763, max 2.14884) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_1_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=777, cols=777 total: nonzeros=207255, allocated nonzeros=207255 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 2 ------------------------------- KSP Object: (mg_levels_2_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.136436, max 1.50079 eigenvalues provided (min 0.555598, max 1.36436) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_2_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=10842, cols=10842 total: nonzeros=907022, allocated nonzeros=907022 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 3 ------------------------------- KSP Object: (mg_levels_3_) 4 MPI processes type: chebyshev Chebyshev polynomial of first kind eigenvalue targets used: min 0.523254, max 5.75579 eigenvalues provided (min 0.247422, max 5.23254) with transform: [0. 0.1; 0. 1.1] maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_3_) 4 MPI processes type: jacobi type DIAGONAL linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=808996, cols=808996 total: nonzeros=34524680, allocated nonzeros=147207720 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines Up solver (post-smoother) same as down solver (pre-smoother) linear system matrix = precond matrix: Mat Object: 4 MPI processes type: mpiaijcusparse rows=808996, cols=808996 total: nonzeros=34524680, allocated nonzeros=147207720 total number of mallocs used during MatSetValues calls=0 not using I-node (on process 0) routines **************************************************************************************************************************************************************** *** WIDEN YOUR WINDOW TO 160 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** **************************************************************************************************************************************************************** ------------------------------------------------------------------ PETSc Performance Summary: ------------------------------------------------------------------ argv0 on a named nid008505 with 4 processors, by cho Fri Apr 12 14:00:30 2024 Using 2 OpenMP threads Using Petsc Release Version 3.19.4, Jul 31, 2023 Max Max/Min Avg Total Time (sec): 5.713e+00 1.000 5.713e+00 Objects: 1.317e+03 1.000 1.317e+03 Flops: 1.552e+11 1.172 1.453e+11 5.812e+11 Flops/sec: 2.717e+10 1.172 2.543e+10 1.017e+11 MPI Msg Count: 7.921e+04 1.039 7.697e+04 3.079e+05 MPI Msg Len (bytes): 1.216e+09 1.163 1.474e+04 4.539e+09 MPI Reductions: 5.520e+02 1.000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 5.7127e+00 100.0% 5.8116e+11 100.0% 3.079e+05 100.0% 1.474e+04 100.0% 5.340e+02 96.7% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage cuBLAS Init 1 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxCreate 14 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxDestroy 12 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxSetUp 14 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxSetDevice 4 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxDuplicate 12 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxWaitForCtx 24 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxFork 27 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxJoin 27 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxSync 98915 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 14 0 0 0 0 14 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 DCtxMark 120 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 110 1.0 nan nan 0.00e+00 0.0 7.2e+02 4.0e+00 1.1e+02 2 0 0 0 20 2 0 0 0 21 -nan -nan 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 41 1.0 nan nan 0.00e+00 0.0 1.9e+02 7.2e+04 4.1e+01 1 0 0 0 7 1 0 0 0 8 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatMult 18906 1.0 nan nan 1.36e+11 1.2 2.3e+05 1.9e+04 0.0e+00 30 88 74 97 0 30 88 74 97 0 -nan -nan 2 1.05e+02 0 0.00e+00 100 MatMultAdd 4356 1.0 nan nan 3.00e+09 1.2 3.9e+04 9.0e+02 0.0e+00 7 2 13 1 0 7 2 13 1 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 MatMultTranspose 4356 1.0 nan nan 2.68e+09 1.2 3.9e+04 9.0e+02 0.0e+00 5 2 13 1 0 5 2 13 1 0 -nan -nan 1 2.97e-02 0 0.00e+00 100 MatSolve 1452 0.0 nan nan 1.02e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 MatLUFactorSym 1 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 nan nan 4.41e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 1 3.80e-05 0 0.00e+00 0 MatConvert 12 1.0 nan nan 0.00e+00 0.0 9.6e+01 6.2e+03 4.0e+00 2 0 0 0 1 2 0 0 0 1 -nan -nan 0 0.00e+00 4 2.23e+00 0 MatScale 6 1.0 nan nan 2.07e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 6 7.61e+00 9 9.25e+00 50 MatResidual 4356 1.0 nan nan 2.80e+10 1.2 5.2e+04 1.7e+04 0.0e+00 8 18 17 20 0 8 18 17 20 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 MatAssemblyBegin 44 1.0 nan nan 0.00e+00 0.0 1.9e+02 7.2e+04 3.3e+01 1 0 0 0 6 1 0 0 0 6 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 44 1.0 nan nan 0.00e+00 0.0 5.1e+02 2.3e+03 1.5e+02 2 0 0 0 27 2 0 0 0 28 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatCreateSubMat 2 1.0 nan nan 0.00e+00 0.0 2.1e+01 1.7e+02 3.0e+01 0 0 0 0 5 0 0 0 0 6 -nan -nan 0 0.00e+00 2 7.22e-04 0 MatGetOrdering 1 0.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatCoarsen 3 1.0 nan nan 4.37e+07 1.2 8.4e+02 6.4e+03 1.4e+02 5 0 0 0 26 5 0 0 0 27 -nan -nan 23 1.34e+02 16 1.78e+01 100 MatView 14 1.4 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+01 0 0 0 0 2 0 0 0 0 2 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatAXPY 6 1.0 nan nan 9.74e+06 1.2 7.2e+01 4.3e+03 2.1e+01 6 0 0 0 4 6 0 0 0 4 -nan -nan 0 0.00e+00 6 7.61e+00 0 MatTranspose 6 1.0 nan nan 0.00e+00 0.0 3.8e+02 3.8e+04 5.4e+01 3 0 0 0 10 3 0 0 0 10 -nan -nan 0 0.00e+00 2 1.62e+00 0 MatMatMultSym 4 1.0 nan nan 1.95e+07 1.2 2.1e+02 6.1e+03 3.2e+01 2 0 0 0 6 2 0 0 0 6 -nan -nan 31 2.98e+01 24 1.59e+01 100 MatMatMultNum 4 1.0 nan nan 0.00e+00 0.0 8.4e+01 1.8e+02 2.4e+01 0 0 0 0 4 0 0 0 0 4 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatPtAPSymbolic 4 1.0 nan nan 1.73e+08 1.3 7.9e+02 3.0e+04 4.0e+01 5 0 0 1 7 5 0 0 1 7 -nan -nan 40 1.72e+02 32 3.44e+01 100 MatPtAPNumeric 4 1.0 nan nan 1.69e+08 1.3 1.4e+02 2.4e+04 2.4e+01 0 0 0 0 4 0 0 0 0 4 -nan -nan 15 2.47e+00 0 0.00e+00 100 MatGetLocalMat 4 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 11 1.25e+01 4 6.24e+00 0 MatGetBrAoCol 8 1.0 nan nan 0.00e+00 0.0 2.7e+02 3.1e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 55 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 2 0 0 0 0 2 0 0 0 0 -nan -nan 55 2.95e+02 0 0.00e+00 0 MatCUSPARSCopyFr 20 1.1 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 20 1.91e+01 0 MatCUSPARSGenT 8 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 MatSetPreallCOO 8 1.0 nan nan 0.00e+00 0.0 1.8e+02 4.2e+02 4.0e+01 2 0 0 0 7 2 0 0 0 7 -nan -nan 32 3.81e+01 24 1.08e+01 0 MatSetValuesCOO 8 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecMDot 30 1.0 nan nan 2.38e+07 1.1 0.0e+00 0.0e+00 3.0e+01 0 0 0 0 5 0 0 0 0 6 -nan -nan 0 0.00e+00 27 1.27e-03 100 VecNorm 34 1.0 nan nan 5.19e+06 1.1 0.0e+00 0.0e+00 3.4e+01 0 0 0 0 6 0 0 0 0 6 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecScale 33 1.0 nan nan 2.38e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecCopy 13073 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 3 0 0 0 0 3 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecSet 8742 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecAXPY 4356 1.0 nan nan 1.86e+09 1.1 0.0e+00 0.0e+00 0.0e+00 1 1 0 0 0 1 1 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecAYPX 29036 1.0 nan nan 5.01e+09 1.1 0.0e+00 0.0e+00 0.0e+00 9 3 0 0 0 9 3 0 0 0 -nan -nan 1 1.62e+00 0 0.00e+00 100 VecAXPBYCZ 8712 1.0 nan nan 3.14e+09 1.1 0.0e+00 0.0e+00 0.0e+00 4 2 0 0 0 4 2 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecMAXPY 33 1.0 nan nan 2.81e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 33 1.56e-03 0 0.00e+00 100 VecAssemblyBegin 9 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 8.0e+00 0 0 0 0 1 0 0 0 0 1 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 9 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecPointwiseMult 17457 1.0 nan nan 1.26e+09 1.1 0.0e+00 0.0e+00 0.0e+00 3 1 0 0 0 3 1 0 0 0 -nan -nan 10 6.54e+00 0 0.00e+00 0 VecScatterBegin 27625 1.0 nan nan 0.00e+00 0.0 3.1e+05 1.5e+04 0.0e+00 13 0 99 99 0 13 0 99 99 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 27625 1.0 nan nan 1.27e+06 1.2 0.0e+00 0.0e+00 0.0e+00 23 0 0 0 0 23 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecReduceArith 4354 1.0 nan nan 1.86e+09 1.1 0.0e+00 0.0e+00 0.0e+00 2 1 0 0 0 2 1 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecReduceBegin 2903 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecReduceEnd 2903 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 VecNormalize 33 1.0 nan nan 7.14e+06 1.1 0.0e+00 0.0e+00 3.3e+01 0 0 0 0 6 0 0 0 0 6 -nan -nan 0 0.00e+00 0 0.00e+00 100 VecCUDACopyTo 20 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 20 1.31e+01 0 0.00e+00 0 VecCUDACopyFrom 10 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 10 6.54e+00 0 SFSetGraph 69 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFSetUp 69 1.0 nan nan 0.00e+00 0.0 1.2e+03 5.9e+03 6.9e+01 1 0 0 0 12 1 0 0 0 13 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFBcastBegin 25 1.0 nan nan 0.00e+00 0.0 2.9e+02 1.1e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFBcastEnd 25 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 26 1.0 nan nan 0.00e+00 0.0 2.6e+02 3.9e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 26 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 4 1.0 nan nan 0.00e+00 0.0 4.2e+01 3.9e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 4 1.0 nan nan 0.00e+00 0.0 4.2e+01 3.9e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFPack 27680 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 0 SFUnpack 27684 1.0 nan nan 1.27e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 0 0.00e+00 0 0.00e+00 100 KSPSetUp 9 1.0 nan nan 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00 0 0 0 0 1 0 0 0 0 1 -nan -nan 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 3.7376e+00 1.0 1.55e+11 1.2 3.0e+05 1.5e+04 7.0e+00 65 100 99 99 1 65 100 99 99 1 154876 -nan 10 6.55e+00 3 1.64e+00 99 KSPGMRESOrthog 30 1.0 nan nan 4.76e+07 1.1 0.0e+00 0.0e+00 3.0e+01 0 0 0 0 5 0 0 0 0 6 -nan -nan 30 1.32e-03 27 1.27e-03 100 PCSetUp_GAMG+ 1 1.0 nan nan 6.24e+08 1.2 2.8e+03 1.9e+04 4.9e+02 23 0 1 1 89 23 0 1 1 93 -nan -nan 139 3.23e+02 108 7.27e+01 98 PCGAMGCreateG 3 1.0 nan nan 9.53e+06 1.2 4.0e+02 3.7e+04 4.8e+01 9 0 0 0 9 9 0 0 0 9 -nan -nan 0 0.00e+00 4 2.23e+00 0 GAMG Coarsen 3 1.0 nan nan 4.37e+07 1.2 8.4e+02 6.4e+03 1.4e+02 5 0 0 0 26 5 0 0 0 27 -nan -nan 23 1.34e+02 16 1.78e+01 100 GAMG MIS/Agg 3 1.0 nan nan 4.37e+07 1.2 8.4e+02 6.4e+03 1.4e+02 5 0 0 0 26 5 0 0 0 27 -nan -nan 23 1.34e+02 16 1.78e+01 100 PCGAMGProl 3 1.0 nan nan 0.00e+00 0.0 1.1e+02 6.8e+03 4.8e+01 1 0 0 0 9 1 0 0 0 9 -nan -nan 0 0.00e+00 0 0.00e+00 0 GAMG Prol-col 3 1.0 nan nan 0.00e+00 0.0 3.6e+01 1.0e+04 1.8e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 0 0.00e+00 0 0.00e+00 0 GAMG Prol-lift 3 1.0 nan nan 0.00e+00 0.0 7.2e+01 5.1e+03 1.8e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 0 0.00e+00 0 0.00e+00 0 PCGAMGOptProl 3 1.0 nan nan 2.72e+08 1.2 6.1e+02 1.2e+04 1.3e+02 4 0 0 0 24 4 0 0 0 25 -nan -nan 76 1.43e+02 63 2.98e+01 98 GAMG smooth 3 1.0 nan nan 2.16e+07 1.2 2.5e+02 5.0e+03 5.1e+01 3 0 0 0 9 3 0 0 0 10 -nan -nan 32 3.39e+01 33 2.81e+01 93 PCGAMGCreateL 3 1.0 nan nan 2.99e+08 1.3 8.0e+02 3.1e+04 1.0e+02 4 0 0 1 19 4 0 0 1 19 -nan -nan 40 4.61e+01 26 2.30e+01 100 GAMG PtAP 3 1.0 nan nan 2.99e+08 1.3 7.6e+02 3.3e+04 4.8e+01 4 0 0 1 9 4 0 0 1 9 -nan -nan 40 4.61e+01 24 2.30e+01 100 GAMG Reduce 1 1.0 nan nan 0.00e+00 0.0 4.2e+01 9.5e+01 5.5e+01 0 0 0 0 10 0 0 0 0 10 -nan -nan 0 0.00e+00 2 7.22e-04 0 PCGAMG Gal l00 1 1.0 nan nan 2.53e+08 1.3 2.5e+02 4.9e+04 1.6e+01 2 0 0 0 3 2 0 0 0 3 -nan -nan 14 4.13e+01 8 2.07e+01 100 PCGAMG Opt l00 1 1.0 nan nan 1.84e+07 1.2 8.4e+01 1.4e+04 1.4e+01 2 0 0 0 3 2 0 0 0 3 -nan -nan 8 2.35e+01 6 1.08e+01 100 PCGAMG Gal l01 1 1.0 nan nan 4.22e+07 1.8 2.5e+02 4.7e+04 1.6e+01 1 0 0 0 3 1 0 0 0 3 -nan -nan 14 4.61e+00 8 2.19e+00 100 PCGAMG Opt l01 1 1.0 nan nan 5.36e+05 1.4 8.4e+01 9.9e+02 1.4e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 8 1.01e+00 6 4.36e-01 100 PCGAMG Gal l02 1 1.0 nan nan 3.02e+06 1.8 2.5e+02 1.8e+03 1.6e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 12 1.45e-01 8 4.63e-02 100 PCGAMG Opt l02 1 1.0 nan nan 1.31e+05 1.7 8.4e+01 4.0e+02 1.4e+01 0 0 0 0 3 0 0 0 0 3 -nan -nan 8 7.68e-02 6 3.46e-02 100 PCSetUp 2 1.0 nan nan 6.24e+08 1.2 2.8e+03 1.9e+04 4.9e+02 23 0 1 1 89 23 0 1 1 93 -nan -nan 140 3.23e+02 108 7.27e+01 98 PCSetUpOnBlocks 1452 1.0 nan nan 4.41e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 -nan -nan 1 3.80e-05 0 0.00e+00 0 PCApply 1452 1.0 nan nan 1.23e+11 1.2 2.9e+05 1.3e+04 6.0e+00 57 79 93 81 1 57 79 93 81 1 -nan -nan 10 6.55e+00 3 1.64e+00 99 --- Event Stage 1: Unknown --------------------------------------------------------------------------------------------------------------------------------------------------------------- Object Type Creations Destructions. Reports information only for process 0. --- Event Stage 0: Main Stage PetscDeviceContext 4 12 Viewer 7 6 Container 19 19 Matrix 149 149 Matrix Coarsen 3 3 Vector 176 176 Index Set 98 98 IS L to G Mapping 16 16 Star Forest Graph 77 77 Krylov Solver 9 9 Preconditioner 9 9 PetscRandom 3 3 Distributed Mesh 6 6 Discrete System 6 6 Weak Form 6 6 --- Event Stage 1: Unknown ======================================================================================================================== Average time to get PetscTime(): 3.11e-08 Average time for MPI_Barrier(): 1.3986e-06 Average time for zero size MPI_Send(): 2.034e-06 #PETSc Option Table entries: -device_view # (source: command line) -ksp_converged_reason # (source: command line) -ksp_divtol 1.e6 # (source: command line) -ksp_max_it 40000 # (source: command line) -ksp_monitor # (source: command line) -ksp_rtol 1.e-6 # (source: command line) -ksp_type groppcg # (source: command line) -ksp_view # (source: command line) -log_view # (source: command line) -mat_type aijcusparse # (source: command line) -options_left # (source: command line) -pc_type gamg # (source: command line) -vec_type cuda # (source: command line) #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --prefix=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 --with-make-exec=make --with-cc=/tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gcc --with-cxx=/tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/g++ --with-fc=/tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gfortran --with-precision=double --with-scalar-type=real --with-shared-libraries=1 --with-debugging=0 --with-openmp=1 --with-64-bit-indices=0 --with-blaslapack-lib=/opt/cray/pe/libsci/default/gnu/12.3/x86_64/lib/libsci_gnu.so --with-x=0 --with-clanguage=C --with-cuda=1 --with-cuda-dir=/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2 --with-hip=0 --with-metis=1 --with-metis-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/include --with-metis-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/lib/libmetis.so --with-hypre=1 --with-hypre-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/include --with-hypre-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/lib/libHYPRE.so --with-parmetis=1 --with-parmetis-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/include --with-parmetis-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/lib/libparmetis.so --with-kokkos=0 --with-kokkos-kernels=0 --with-superlu_dist=1 --with-superlu_dist-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/include --with-superlu_dist-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/lib/libsuperlu_dist.so --with-ptscotch=0 --with-suitesparse=0 --with-hdf5=1 --with-hdf5-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/include --with-hdf5-lib="//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_hl_fortran.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_hl_f90cstub.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_hl.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_fortran.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5_f90cstub.so //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib/libhdf5.so" --with-zlib=1 --with-zlib-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/include --with-zlib-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/lib/libz.so --with-mumps=0 --with-trilinos=0 --with-fftw=0 --with-valgrind=0 --with-gmp=0 --with-libpng=0 --with-giflib=0 --with-mpfr=0 --with-netcdf=0 --with-pnetcdf=0 --with-moab=0 --with-random123=0 --with-exodusii=0 --with-cgns=0 --with-memkind=0 --with-p4est=0 --with-saws=0 --with-yaml=0 --with-hwloc=0 --with-libjpeg=0 --with-scalapack=1 --with-scalapack-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/netlib-scalapack-2.2.0-ayc5v4dec5qhurhpzvrhwduqayhife37/lib/libscalapack.so --with-strumpack=1 --with-strumpack-include=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/include --with-strumpack-lib=//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/lib64/libstrumpack.so --with-mmg=0 --with-parmmg=0 --with-tetgen=0 --with-cuda-arch=80 ----------------------------------------- Libraries compiled on 2024-02-22 17:45:47 on login09 Machine characteristics: Linux-5.14.21-150400.24.81_12.0.87-cray_shasta_c-x86_64-with-glibc2.31 Using PETSc directory: //////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr Using PETSc arch: ----------------------------------------- Using C compiler: /tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gcc -fPIC -O -fopenmp Using Fortran compiler: /tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gfortran -fPIC -O -fopenmp -fopenmp ----------------------------------------- Using include paths: -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/include -I//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/include -I/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/include -I/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/math_libs/12.2/include ----------------------------------------- Using C linker: /tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gcc Using Fortran linker: /tmp/m3503/ci/siddiq90/builds/vyq9qqM1/001/NERSC/spack-infrastructure/spack/lib/spack/env/gcc/gfortran Using libraries: -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.19.4-ervgmeilljizyhslpjlpbln452bu3grr/lib -lpetsc -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hypre-2.28.0-u2zpru43ewdtxymben5brf2ibpy7yelz/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/lib64 -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/strumpack-7.1.3-zcsk4cxtufxzkdlt7aew7m74cvdvrud7/lib64 -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/netlib-scalapack-2.2.0-ayc5v4dec5qhurhpzvrhwduqayhife37/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/netlib-scalapack-2.2.0-ayc5v4dec5qhurhpzvrhwduqayhife37/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/superlu-dist-8.1.2-mmwe6u7fwcafwfbowb5dcrftnwj2f4l3/lib -Wl,-rpath,/opt/cray/pe/libsci/default/gnu/12.3/x86_64/lib -L/opt/cray/pe/libsci/default/gnu/12.3/x86_64/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/hdf5-1.14.2-hhcvc6dav7jhfh4ribgx5ligi3ycawzj/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/parmetis-4.0.3-yesrb2na4ypmqvbtmolrq6bl5jf6fyl7/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/metis-5.1.0-ihgnhlwec57cxhehkn27exwrpqngrhvp/lib -Wl,-rpath,//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/lib -L//////////////////////////////////////////////////////global/common/software/spackecp/perlmutter/e4s-23.08/94543/spack/opt/spack/linux-sles15-zen3/gcc-12.3.0/zlib-1.2.13-3afyrxptrw67pubkdej3edkzidmfol7h/lib -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/lib64/stubs -Wl,-rpath,/opt/cray/pe/mpich/8.1.28/ofi/gnu/12.3/lib -L/opt/cray/pe/mpich/8.1.28/ofi/gnu/12.3/lib -Wl,-rpath,/opt/cray/pe/libsci/23.12.5/GNU/12.3/x86_64/lib -L/opt/cray/pe/libsci/23.12.5/GNU/12.3/x86_64/lib -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/lib64/stubs -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/nvvm/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/nvvm/lib64 -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/extras/CUPTI/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/extras/CUPTI/lib64 -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/extras/Debugger/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/cuda/12.2/extras/Debugger/lib64 -Wl,-rpath,/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/math_libs/12.2/lib64 -L/opt/nvidia/hpc_sdk/Linux_x86_64/23.9/math_libs/12.2/lib64 -Wl,-rpath,/opt/cray/pe/dsmml/0.2.2/dsmml/lib -L/opt/cray/pe/dsmml/0.2.2/dsmml/lib -Wl,-rpath,/opt/cray/pe/pmi/6.1.13/lib -L/opt/cray/pe/pmi/6.1.13/lib -Wl,-rpath,/opt/cray/xpmem/2.6.2-2.5_2.38__gd067c3f.shasta/lib64 -L/opt/cray/xpmem/2.6.2-2.5_2.38__gd067c3f.shasta/lib64 -Wl,-rpath,/usr/lib64/gcc/x86_64-suse-linux/12 -L/usr/lib64/gcc/x86_64-suse-linux/12 -Wl,-rpath,/usr/x86_64-suse-linux/lib -L/usr/x86_64-suse-linux/lib -lHYPRE -lstrumpack -lscalapack -lsuperlu_dist -lsci_gnu -lhdf5_hl_fortran -lhdf5_hl_f90cstub -lhdf5_hl -lhdf5_fortran -lhdf5_f90cstub -lhdf5 -lparmetis -lmetis -lz -lcudart -lnvToolsExt -lcufft -lcublas -lcusparse -lcusolver -lcurand -lcuda -ldl -lxpmem -lgfortran -lm -lcupti -lcudart -lsci_gnu_123_mpi -lsci_gnu_123 -lmpifort_gnu_123 -lmpi_gnu_123 -ldsmml -lpmi -lpmi2 -lgfortran -lquadmath -lpthread -lm -lgcc_s -lstdc++ ----------------------------------------- #PETSc Option Table entries: -device_view # (source: command line) -ksp_converged_reason # (source: command line) -ksp_divtol 1.e6 # (source: command line) -ksp_max_it 40000 # (source: command line) -ksp_monitor # (source: command line) -ksp_rtol 1.e-6 # (source: command line) -ksp_type groppcg # (source: command line) -ksp_view # (source: command line) -log_view # (source: command line) -mat_type aijcusparse # (source: command line) -options_left # (source: command line) -pc_type gamg # (source: command line) -vec_type cuda # (source: command line) #End of PETSc Option Table entries There are no unused options.