3D POISEUILLE BASEFLOW COMPUTED ON GRID WITH NX =301 NY =301 Time for build and assembly of baseflow operator = 0.7800 seconds. Time for Matrix summation = 0.0480 seconds. KSP Object: 128 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-10, absolute=1e-10, divergence=10000 left preconditioning using NONE norm type for convergence test PC Object: 128 MPI processes type: lu LU: out-of-place factorization tolerance for zero pivot 2.22045e-14 matrix ordering: natural factor fill ratio given 0, needed 0 Factored matrix follows: Mat Object: 128 MPI processes type: mpiaij rows=90601, cols=90601 package used to perform factorization: superlu_dist total: nonzeros=0, allocated nonzeros=0 total number of mallocs used during MatSetValues calls =0 SuperLU_DIST run parameters: Process grid nprow 16 x npcol 8 Equilibrate matrix TRUE Matrix input mode 1 Replace tiny pivots TRUE Use iterative refinement FALSE Processors in row 16 col partition 8 Row permutation LargeDiag Column permutation METIS_AT_PLUS_A Parallel symbolic factorization FALSE Repeated factorization SamePattern_SameRowPerm linear system matrix = precond matrix: Mat Object: 128 MPI processes type: mpiaij rows=90601, cols=90601 total: nonzeros=1.52102e+06, allocated nonzeros=1.54022e+06 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines U00 ( 0.58937082625527526 , 0.0000000000000000 ) Time for baseflow computation = 7.7045 seconds. Time to Build A (FD) = 5.668 seconds. Time to assemble A = 0.060 seconds. Time to Build and Assemble B = 0.004 seconds. norm A: 150600.72354576783 norm B: 517.88319146309436 Current Memory Usage -------------------- Before EPSSetTolerances, on Processor 0, memory: 0.78008320000E+08 Before EPSSetTolerances, on Processor 1, memory: 0.75333632000E+08 Before EPSSetTolerances, on Processor 2, memory: 0.75776000000E+08 Before EPSSetTolerances, on Processor 3, memory: 0.75063296000E+08 Before EPSSetTolerances, on Processor 4, memory: 0.74809344000E+08 Before EPSSetTolerances, on Processor 5, memory: 0.75354112000E+08 Before EPSSetTolerances, on Processor 6, memory: 0.74973184000E+08 Before EPSSetTolerances, on Processor 7, memory: 0.75534336000E+08 Before EPSSetTolerances, on Processor 8, memory: 0.76087296000E+08 Before EPSSetTolerances, on Processor 9, memory: 0.79233024000E+08 Before EPSSetTolerances, on Processor 10, memory: 0.75804672000E+08 Before EPSSetTolerances, on Processor 11, memory: 0.76136448000E+08 Before EPSSetTolerances, on Processor 12, memory: 0.75886592000E+08 Before EPSSetTolerances, on Processor 13, memory: 0.76226560000E+08 Before EPSSetTolerances, on Processor 14, memory: 0.75939840000E+08 Before EPSSetTolerances, on Processor 15, memory: 0.76480512000E+08 Before EPSSetTolerances, on Processor 16, memory: 0.74690560000E+08 Before EPSSetTolerances, on Processor 17, memory: 0.74854400000E+08 Before EPSSetTolerances, on Processor 18, memory: 0.78196736000E+08 Before EPSSetTolerances, on Processor 19, memory: 0.75001856000E+08 Before EPSSetTolerances, on Processor 20, memory: 0.74387456000E+08 Before EPSSetTolerances, on Processor 21, memory: 0.75010048000E+08 Before EPSSetTolerances, on Processor 22, memory: 0.74379264000E+08 Before EPSSetTolerances, on Processor 23, memory: 0.74956800000E+08 Before EPSSetTolerances, on Processor 24, memory: 0.75644928000E+08 Before EPSSetTolerances, on Processor 25, memory: 0.75788288000E+08 Before EPSSetTolerances, on Processor 26, memory: 0.75272192000E+08 Before EPSSetTolerances, on Processor 27, memory: 0.78340096000E+08 Before EPSSetTolerances, on Processor 28, memory: 0.75624448000E+08 Before EPSSetTolerances, on Processor 29, memory: 0.75735040000E+08 Before EPSSetTolerances, on Processor 30, memory: 0.75988992000E+08 Before EPSSetTolerances, on Processor 31, memory: 0.74526720000E+08 Before EPSSetTolerances, on Processor 32, memory: 0.74764288000E+08 Before EPSSetTolerances, on Processor 33, memory: 0.75038720000E+08 Before EPSSetTolerances, on Processor 34, memory: 0.74162176000E+08 Before EPSSetTolerances, on Processor 35, memory: 0.74547200000E+08 Before EPSSetTolerances, on Processor 36, memory: 0.78520320000E+08 Before EPSSetTolerances, on Processor 37, memory: 0.75341824000E+08 Before EPSSetTolerances, on Processor 38, memory: 0.75272192000E+08 Before EPSSetTolerances, on Processor 39, memory: 0.75657216000E+08 Before EPSSetTolerances, on Processor 40, memory: 0.77058048000E+08 Before EPSSetTolerances, on Processor 41, memory: 0.76857344000E+08 Before EPSSetTolerances, on Processor 42, memory: 0.75808768000E+08 Before EPSSetTolerances, on Processor 43, memory: 0.75907072000E+08 Before EPSSetTolerances, on Processor 44, memory: 0.76029952000E+08 Before EPSSetTolerances, on Processor 45, memory: 0.80420864000E+08 Before EPSSetTolerances, on Processor 64, memory: 0.77451264000E+08 Before EPSSetTolerances, on Processor 65, memory: 0.75710464000E+08 Before EPSSetTolerances, on Processor 66, memory: 0.73621504000E+08 Before EPSSetTolerances, on Processor 67, memory: 0.72921088000E+08 Before EPSSetTolerances, on Processor 68, memory: 0.73003008000E+08 Before EPSSetTolerances, on Processor 69, memory: 0.75350016000E+08 Before EPSSetTolerances, on Processor 70, memory: 0.74391552000E+08 Before EPSSetTolerances, on Processor 71, memory: 0.75714560000E+08 Before EPSSetTolerances, on Processor 72, memory: 0.74493952000E+08 Before EPSSetTolerances, on Processor 73, memory: 0.77090816000E+08 Before EPSSetTolerances, on Processor 74, memory: 0.72597504000E+08 Before EPSSetTolerances, on Processor 75, memory: 0.73109504000E+08 Before EPSSetTolerances, on Processor 76, memory: 0.72658944000E+08 Before EPSSetTolerances, on Processor 77, memory: 0.73936896000E+08 Before EPSSetTolerances, on Processor 78, memory: 0.73412608000E+08 Before EPSSetTolerances, on Processor 79, memory: 0.74551296000E+08 Before EPSSetTolerances, on Processor 80, memory: 0.73334784000E+08 Before EPSSetTolerances, on Processor 81, memory: 0.73265152000E+08 Before EPSSetTolerances, on Processor 82, memory: 0.77107200000E+08 Before EPSSetTolerances, on Processor 96, memory: 0.76558336000E+08 Before EPSSetTolerances, on Processor 97, memory: 0.75272192000E+08 Before EPSSetTolerances, on Processor 98, memory: 0.74825728000E+08 Before EPSSetTolerances, on Processor 99, memory: 0.74805248000E+08 Before EPSSetTolerances, on Processor100, memory: 0.79794176000E+08 Before EPSSetTolerances, on Processor101, memory: 0.75329536000E+08 Before EPSSetTolerances, on Processor102, memory: 0.75132928000E+08 Before EPSSetTolerances, on Processor103, memory: 0.75661312000E+08 Before EPSSetTolerances, on Processor104, memory: 0.75452416000E+08 Before EPSSetTolerances, on Processor105, memory: 0.75661312000E+08 Before EPSSetTolerances, on Processor106, memory: 0.75399168000E+08 Before EPSSetTolerances, on Processor107, memory: 0.75378688000E+08 Before EPSSetTolerances, on Processor108, memory: 0.75399168000E+08 Before EPSSetTolerances, on Processor109, memory: 0.79253504000E+08 Before EPSSetTolerances, on Processor110, memory: 0.75759616000E+08 Before EPSSetTolerances, on Processor111, memory: 0.76181504000E+08 Current Memory Usage -------------------- Before EPSGetST, on Processor 0, memory: 0.78012416000E+08 Before EPSGetST, on Processor 1, memory: 0.75411456000E+08 Before EPSGetST, on Processor 2, memory: 0.75853824000E+08 Before EPSGetST, on Processor 3, memory: 0.75141120000E+08 Before EPSGetST, on Processor 4, memory: 0.74887168000E+08 Before EPSGetST, on Processor 5, memory: 0.75431936000E+08 Before EPSGetST, on Processor 6, memory: 0.75051008000E+08 Before EPSGetST, on Processor 7, memory: 0.75612160000E+08 Before EPSGetST, on Processor 8, memory: 0.76165120000E+08 Before EPSGetST, on Processor 9, memory: 0.79310848000E+08 Before EPSGetST, on Processor 10, memory: 0.75882496000E+08 Before EPSGetST, on Processor 11, memory: 0.76214272000E+08 Before EPSGetST, on Processor 12, memory: 0.75964416000E+08 Before EPSGetST, on Processor 13, memory: 0.76304384000E+08 Before EPSGetST, on Processor 14, memory: 0.76017664000E+08 Before EPSGetST, on Processor 15, memory: 0.76558336000E+08 Before EPSGetST, on Processor 16, memory: 0.74768384000E+08 Before EPSGetST, on Processor 17, memory: 0.74932224000E+08 Before EPSGetST, on Processor 18, memory: 0.78274560000E+08 Before EPSGetST, on Processor 19, memory: 0.75079680000E+08 Before EPSGetST, on Processor 20, memory: 0.74465280000E+08 Before EPSGetST, on Processor 21, memory: 0.75087872000E+08 Before EPSGetST, on Processor 22, memory: 0.74457088000E+08 Before EPSGetST, on Processor 23, memory: 0.75034624000E+08 Before EPSGetST, on Processor 24, memory: 0.75722752000E+08 Before EPSGetST, on Processor 25, memory: 0.75866112000E+08 Before EPSGetST, on Processor 26, memory: 0.75350016000E+08 Before EPSGetST, on Processor 27, memory: 0.78417920000E+08 Before EPSGetST, on Processor 28, memory: 0.75702272000E+08 Before EPSGetST, on Processor 29, memory: 0.75812864000E+08 Before EPSGetST, on Processor 30, memory: 0.76066816000E+08 Before EPSGetST, on Processor 31, memory: 0.74604544000E+08 Current Memory Usage -------------------- Before EPSSolve, on Processor 0, memory: 0.78254080000E+08 Before EPSSolve, on Processor 1, memory: 0.75644928000E+08 Before EPSSolve, on Processor 2, memory: 0.76087296000E+08 Before EPSSolve, on Processor 3, memory: 0.75374592000E+08 Before EPSSolve, on Processor 4, memory: 0.75120640000E+08 Before EPSSolve, on Processor 5, memory: 0.75665408000E+08 Before EPSSolve, on Processor 6, memory: 0.75284480000E+08 Before EPSSolve, on Processor 7, memory: 0.75845632000E+08 Before EPSSolve, on Processor 8, memory: 0.76398592000E+08 Before EPSSolve, on Processor 9, memory: 0.79544320000E+08 Before EPSSolve, on Processor 10, memory: 0.76115968000E+08 Before EPSSolve, on Processor 11, memory: 0.76447744000E+08 Before EPSSolve, on Processor 12, memory: 0.76197888000E+08 Before EPSSolve, on Processor 13, memory: 0.76537856000E+08 Before EPSSolve, on Processor 14, memory: 0.76251136000E+08 Before EPSSolve, on Processor 15, memory: 0.76791808000E+08 Before EPSSolve, on Processor 16, memory: 0.75001856000E+08 Before EPSSolve, on Processor 17, memory: 0.75165696000E+08 Before EPSSolve, on Processor 18, memory: 0.78508032000E+08 Before EPSSolve, on Processor 19, memory: 0.75313152000E+08 Before EPSSolve, on Processor 20, memory: 0.74698752000E+08 Before EPSSolve, on Processor 21, memory: 0.75321344000E+08 Before EPSSolve, on Processor 22, memory: 0.74690560000E+08 Before EPSSolve, on Processor 23, memory: 0.75268096000E+08 Before EPSSolve, on Processor 24, memory: 0.75956224000E+08 Before EPSSolve, on Processor 25, memory: 0.76099584000E+08 Before EPSSolve, on Processor 26, memory: 0.75583488000E+08 Before EPSSolve, on Processor 27, memory: 0.78651392000E+08 Before EPSSolve, on Processor 28, memory: 0.75935744000E+08 Before EPSSolve, on Processor 29, memory: 0.76046336000E+08 Before EPSSolve, on Processor 30, memory: 0.76300288000E+08 Before EPSSolve, on Processor 31, memory: 0.74842112000E+08 Before EPSSetTolerances, on Processor 46, memory: 0.76816384000E+08 Before EPSSetTolerances, on Processor 83, memory: 0.72724480000E+08 Before EPSSetTolerances, on Processor 47, memory: 0.78082048000E+08 Before EPSSetTolerances, on Processor 48, memory: 0.76029952000E+08 Before EPSSetTolerances, on Processor 49, memory: 0.75997184000E+08 Before EPSSetTolerances, on Processor 50, memory: 0.74563584000E+08 Before EPSSetTolerances, on Processor 51, memory: 0.74981376000E+08 Before EPSSetTolerances, on Processor 52, memory: 0.75554816000E+08 Before EPSSetTolerances, on Processor 53, memory: 0.76288000000E+08 Before EPSSetTolerances, on Processor 54, memory: 0.78635008000E+08 Before EPSSetTolerances, on Processor 55, memory: 0.77176832000E+08 Before EPSSetTolerances, on Processor 56, memory: 0.76726272000E+08 Before EPSSetTolerances, on Processor 57, memory: 0.76353536000E+08 Before EPSSetTolerances, on Processor 58, memory: 0.74481664000E+08 Before EPSSetTolerances, on Processor 59, memory: 0.74702848000E+08 Before EPSSetTolerances, on Processor 60, memory: 0.75067392000E+08 Before EPSSetTolerances, on Processor 61, memory: 0.76668928000E+08 Before EPSSetTolerances, on Processor 62, memory: 0.76320768000E+08 Before EPSSetTolerances, on Processor 63, memory: 0.79261696000E+08 Before EPSSetTolerances, on Processor 84, memory: 0.73433088000E+08 Before EPSSetTolerances, on Processor 85, memory: 0.72978432000E+08 Before EPSSetTolerances, on Processor 86, memory: 0.72437760000E+08 Before EPSSetTolerances, on Processor 87, memory: 0.72847360000E+08 Before EPSSetTolerances, on Processor 88, memory: 0.73007104000E+08 Before EPSSetTolerances, on Processor 89, memory: 0.73748480000E+08 Before EPSSetTolerances, on Processor 90, memory: 0.73347072000E+08 Before EPSSetTolerances, on Processor 91, memory: 0.75268096000E+08 Before EPSSetTolerances, on Processor 92, memory: 0.73469952000E+08 Before EPSSetTolerances, on Processor 93, memory: 0.72740864000E+08 Before EPSSetTolerances, on Processor 94, memory: 0.73240576000E+08 Before EPSSetTolerances, on Processor 95, memory: 0.73322496000E+08 Before EPSGetST, on Processor 32, memory: 0.74842112000E+08 Before EPSGetST, on Processor 33, memory: 0.75116544000E+08 Before EPSGetST, on Processor 34, memory: 0.74240000000E+08 Before EPSGetST, on Processor 35, memory: 0.74625024000E+08 Before EPSGetST, on Processor 36, memory: 0.78598144000E+08 Before EPSGetST, on Processor 37, memory: 0.75419648000E+08 Before EPSGetST, on Processor 38, memory: 0.75350016000E+08 Before EPSGetST, on Processor 39, memory: 0.75735040000E+08 Before EPSGetST, on Processor 40, memory: 0.77135872000E+08 Before EPSGetST, on Processor 64, memory: 0.77529088000E+08 Before EPSGetST, on Processor 65, memory: 0.75788288000E+08 Before EPSGetST, on Processor 66, memory: 0.73699328000E+08 Before EPSGetST, on Processor 67, memory: 0.73003008000E+08 Before EPSGetST, on Processor 68, memory: 0.73080832000E+08 Before EPSGetST, on Processor 69, memory: 0.75427840000E+08 Before EPSGetST, on Processor 70, memory: 0.74473472000E+08 Before EPSGetST, on Processor 71, memory: 0.75796480000E+08 Before EPSGetST, on Processor 72, memory: 0.74571776000E+08 Before EPSGetST, on Processor 73, memory: 0.77168640000E+08 Before EPSGetST, on Processor 74, memory: 0.72675328000E+08 Before EPSGetST, on Processor 75, memory: 0.73187328000E+08 Before EPSGetST, on Processor 76, memory: 0.72736768000E+08 Before EPSGetST, on Processor 77, memory: 0.74014720000E+08 Before EPSGetST, on Processor 78, memory: 0.73490432000E+08 Before EPSGetST, on Processor 79, memory: 0.74629120000E+08 Before EPSGetST, on Processor 80, memory: 0.73412608000E+08 Before EPSGetST, on Processor 81, memory: 0.73342976000E+08 Before EPSGetST, on Processor 82, memory: 0.77185024000E+08 Before EPSGetST, on Processor 83, memory: 0.72806400000E+08 Before EPSGetST, on Processor 84, memory: 0.73510912000E+08 Before EPSGetST, on Processor 85, memory: 0.73056256000E+08 Before EPSGetST, on Processor 86, memory: 0.72519680000E+08 Before EPSGetST, on Processor 87, memory: 0.72933376000E+08 Before EPSGetST, on Processor 88, memory: 0.73084928000E+08 Before EPSGetST, on Processor 89, memory: 0.73826304000E+08 Before EPSGetST, on Processor 90, memory: 0.73424896000E+08 Before EPSGetST, on Processor 91, memory: 0.75345920000E+08 Before EPSGetST, on Processor 92, memory: 0.73547776000E+08 Before EPSGetST, on Processor 93, memory: 0.72822784000E+08 Before EPSGetST, on Processor 94, memory: 0.73318400000E+08 Before EPSGetST, on Processor 95, memory: 0.73400320000E+08 Before EPSGetST, on Processor 41, memory: 0.76935168000E+08 Before EPSGetST, on Processor 42, memory: 0.75886592000E+08 Before EPSGetST, on Processor 43, memory: 0.75984896000E+08 Before EPSGetST, on Processor 44, memory: 0.76107776000E+08 Before EPSGetST, on Processor 45, memory: 0.80498688000E+08 Before EPSGetST, on Processor 46, memory: 0.76894208000E+08 Before EPSGetST, on Processor 47, memory: 0.78159872000E+08 Before EPSGetST, on Processor 48, memory: 0.76107776000E+08 Before EPSGetST, on Processor 49, memory: 0.76075008000E+08 Before EPSGetST, on Processor 50, memory: 0.74641408000E+08 Before EPSGetST, on Processor 51, memory: 0.75059200000E+08 Before EPSGetST, on Processor 52, memory: 0.75632640000E+08 Before EPSGetST, on Processor 53, memory: 0.76365824000E+08 Before EPSGetST, on Processor 54, memory: 0.78712832000E+08 Before EPSGetST, on Processor 55, memory: 0.77254656000E+08 Before EPSGetST, on Processor 56, memory: 0.76804096000E+08 Before EPSGetST, on Processor 57, memory: 0.76431360000E+08 Before EPSGetST, on Processor 58, memory: 0.74559488000E+08 Before EPSGetST, on Processor 59, memory: 0.74780672000E+08 Before EPSGetST, on Processor 60, memory: 0.75145216000E+08 Before EPSGetST, on Processor 61, memory: 0.76746752000E+08 Before EPSGetST, on Processor 62, memory: 0.76398592000E+08 Before EPSGetST, on Processor 63, memory: 0.79339520000E+08 Before EPSSolve, on Processor 64, memory: 0.77762560000E+08 Before EPSSolve, on Processor 65, memory: 0.76021760000E+08 Before EPSSolve, on Processor 66, memory: 0.73932800000E+08 Before EPSSolve, on Processor 67, memory: 0.73420800000E+08 Before EPSSolve, on Processor 68, memory: 0.73404416000E+08 Before EPSSolve, on Processor 69, memory: 0.75661312000E+08 Before EPSSolve, on Processor 70, memory: 0.74887168000E+08 Before EPSSolve, on Processor 71, memory: 0.76210176000E+08 Before EPSSolve, on Processor 72, memory: 0.74805248000E+08 Before EPSSolve, on Processor 73, memory: 0.77402112000E+08 Before EPSSolve, on Processor 74, memory: 0.72908800000E+08 Before EPSSolve, on Processor 75, memory: 0.73420800000E+08 Before EPSSolve, on Processor 32, memory: 0.75075584000E+08 Before EPSSolve, on Processor 33, memory: 0.75350016000E+08 Before EPSSolve, on Processor 34, memory: 0.74473472000E+08 Before EPSSolve, on Processor 35, memory: 0.74858496000E+08 Before EPSSolve, on Processor 36, memory: 0.78831616000E+08 Before EPSSolve, on Processor 37, memory: 0.75653120000E+08 Before EPSSolve, on Processor 38, memory: 0.75583488000E+08 Before EPSSolve, on Processor 39, memory: 0.75968512000E+08 Before EPSSolve, on Processor 40, memory: 0.77369344000E+08 Before EPSSolve, on Processor 41, memory: 0.77168640000E+08 Before EPSSolve, on Processor 42, memory: 0.76120064000E+08 Before EPSSolve, on Processor 43, memory: 0.76218368000E+08 Before EPSSolve, on Processor 44, memory: 0.76341248000E+08 Before EPSSolve, on Processor 45, memory: 0.80732160000E+08 Before EPSSolve, on Processor 46, memory: 0.77127680000E+08 Before EPSSolve, on Processor 47, memory: 0.78393344000E+08 Before EPSSolve, on Processor 48, memory: 0.76341248000E+08 Before EPSSolve, on Processor 49, memory: 0.76308480000E+08 Before EPSSolve, on Processor 50, memory: 0.74874880000E+08 Before EPSSolve, on Processor 51, memory: 0.75292672000E+08 Before EPSSolve, on Processor 52, memory: 0.75866112000E+08 Before EPSSolve, on Processor 53, memory: 0.76599296000E+08 Before EPSSolve, on Processor 54, memory: 0.78946304000E+08 Before EPSSolve, on Processor 55, memory: 0.77488128000E+08 Before EPSSolve, on Processor 56, memory: 0.77037568000E+08 Before EPSSolve, on Processor 57, memory: 0.76664832000E+08 Before EPSSolve, on Processor 58, memory: 0.74792960000E+08 Before EPSSolve, on Processor 59, memory: 0.75014144000E+08 Before EPSSolve, on Processor 60, memory: 0.75378688000E+08 Before EPSSolve, on Processor 61, memory: 0.76980224000E+08 Before EPSSolve, on Processor 62, memory: 0.76632064000E+08 Before EPSSolve, on Processor 63, memory: 0.79572992000E+08 Before EPSSetTolerances, on Processor112, memory: 0.76218368000E+08 Before EPSSetTolerances, on Processor113, memory: 0.76222464000E+08 Before EPSSetTolerances, on Processor114, memory: 0.74764288000E+08 Before EPSSetTolerances, on Processor115, memory: 0.75644928000E+08 Before EPSSetTolerances, on Processor116, memory: 0.75415552000E+08 Before EPSSetTolerances, on Processor117, memory: 0.76070912000E+08 Before EPSSetTolerances, on Processor118, memory: 0.80433152000E+08 Before EPSSetTolerances, on Processor119, memory: 0.76840960000E+08 Before EPSSetTolerances, on Processor120, memory: 0.76226560000E+08 Before EPSSetTolerances, on Processor121, memory: 0.75927552000E+08 Before EPSSetTolerances, on Processor122, memory: 0.75362304000E+08 Before EPSSetTolerances, on Processor123, memory: 0.75448320000E+08 Before EPSSetTolerances, on Processor124, memory: 0.76480512000E+08 Before EPSSetTolerances, on Processor125, memory: 0.76238848000E+08 Before EPSSetTolerances, on Processor126, memory: 0.76967936000E+08 Before EPSSetTolerances, on Processor127, memory: 0.78888960000E+08 Before EPSSolve, on Processor 76, memory: 0.72970240000E+08 Before EPSGetST, on Processor 96, memory: 0.76636160000E+08 Before EPSGetST, on Processor 97, memory: 0.75350016000E+08 Before EPSGetST, on Processor 98, memory: 0.74903552000E+08 Before EPSGetST, on Processor 99, memory: 0.74883072000E+08 Before EPSGetST, on Processor100, memory: 0.79872000000E+08 Before EPSGetST, on Processor101, memory: 0.75407360000E+08 Before EPSGetST, on Processor102, memory: 0.75210752000E+08 Before EPSGetST, on Processor103, memory: 0.75739136000E+08 Before EPSGetST, on Processor104, memory: 0.75530240000E+08 Before EPSGetST, on Processor105, memory: 0.75739136000E+08 Before EPSGetST, on Processor106, memory: 0.75476992000E+08 Before EPSGetST, on Processor107, memory: 0.75456512000E+08 Before EPSGetST, on Processor108, memory: 0.75476992000E+08 Before EPSGetST, on Processor109, memory: 0.79331328000E+08 Before EPSGetST, on Processor110, memory: 0.75837440000E+08 Before EPSSolve, on Processor 77, memory: 0.74248192000E+08 Before EPSSolve, on Processor 78, memory: 0.73723904000E+08 Before EPSSolve, on Processor 79, memory: 0.74862592000E+08 Before EPSSolve, on Processor 80, memory: 0.73646080000E+08 Before EPSSolve, on Processor 81, memory: 0.73576448000E+08 Before EPSSolve, on Processor 82, memory: 0.77418496000E+08 Before EPSSolve, on Processor 83, memory: 0.73224192000E+08 Before EPSSolve, on Processor 84, memory: 0.73744384000E+08 Before EPSSolve, on Processor 85, memory: 0.73289728000E+08 Before EPSSolve, on Processor 86, memory: 0.72941568000E+08 Before EPSSolve, on Processor 87, memory: 0.73347072000E+08 Before EPSSolve, on Processor 88, memory: 0.73318400000E+08 Before EPSSolve, on Processor 89, memory: 0.74059776000E+08 Before EPSSolve, on Processor 90, memory: 0.73658368000E+08 Before EPSSolve, on Processor 91, memory: 0.75579392000E+08 Before EPSSolve, on Processor 92, memory: 0.73781248000E+08 Before EPSSolve, on Processor 93, memory: 0.73236480000E+08 Before EPSSolve, on Processor 94, memory: 0.73551872000E+08 Before EPSSolve, on Processor 95, memory: 0.73633792000E+08 Before EPSGetST, on Processor111, memory: 0.76259328000E+08 Before EPSGetST, on Processor112, memory: 0.76296192000E+08 Before EPSGetST, on Processor113, memory: 0.76300288000E+08 Before EPSGetST, on Processor114, memory: 0.74842112000E+08 Before EPSGetST, on Processor115, memory: 0.75722752000E+08 Before EPSGetST, on Processor116, memory: 0.75493376000E+08 Before EPSGetST, on Processor117, memory: 0.76148736000E+08 Before EPSGetST, on Processor118, memory: 0.80510976000E+08 Before EPSGetST, on Processor119, memory: 0.76918784000E+08 Before EPSGetST, on Processor120, memory: 0.76304384000E+08 Before EPSGetST, on Processor121, memory: 0.76005376000E+08 Before EPSGetST, on Processor122, memory: 0.75440128000E+08 Before EPSGetST, on Processor123, memory: 0.75526144000E+08 Before EPSGetST, on Processor124, memory: 0.76558336000E+08 Before EPSGetST, on Processor125, memory: 0.76316672000E+08 Before EPSGetST, on Processor126, memory: 0.77045760000E+08 Before EPSGetST, on Processor127, memory: 0.78966784000E+08 Before EPSSolve, on Processor 96, memory: 0.76869632000E+08 Before EPSSolve, on Processor 97, memory: 0.75583488000E+08 Before EPSSolve, on Processor 98, memory: 0.75137024000E+08 Before EPSSolve, on Processor 99, memory: 0.75116544000E+08 Before EPSSolve, on Processor100, memory: 0.80105472000E+08 Before EPSSolve, on Processor101, memory: 0.75640832000E+08 Before EPSSolve, on Processor102, memory: 0.75444224000E+08 Before EPSSolve, on Processor103, memory: 0.75972608000E+08 Before EPSSolve, on Processor104, memory: 0.75763712000E+08 Before EPSSolve, on Processor105, memory: 0.75972608000E+08 Before EPSSolve, on Processor106, memory: 0.75710464000E+08 Before EPSSolve, on Processor107, memory: 0.75689984000E+08 Before EPSSolve, on Processor108, memory: 0.75710464000E+08 Before EPSSolve, on Processor109, memory: 0.79564800000E+08 Before EPSSolve, on Processor110, memory: 0.76070912000E+08 Before EPSSolve, on Processor111, memory: 0.76492800000E+08 Before EPSSolve, on Processor112, memory: 0.76529664000E+08 Before EPSSolve, on Processor113, memory: 0.76533760000E+08 Before EPSSolve, on Processor114, memory: 0.75075584000E+08 Before EPSSolve, on Processor115, memory: 0.75956224000E+08 Before EPSSolve, on Processor116, memory: 0.75726848000E+08 Before EPSSolve, on Processor117, memory: 0.76382208000E+08 Before EPSSolve, on Processor118, memory: 0.80744448000E+08 Before EPSSolve, on Processor119, memory: 0.77152256000E+08 Before EPSSolve, on Processor120, memory: 0.76537856000E+08 Before EPSSolve, on Processor121, memory: 0.76238848000E+08 Before EPSSolve, on Processor122, memory: 0.75673600000E+08 Before EPSSolve, on Processor123, memory: 0.75759616000E+08 Before EPSSolve, on Processor124, memory: 0.76791808000E+08 Before EPSSolve, on Processor125, memory: 0.76550144000E+08 Before EPSSolve, on Processor126, memory: 0.77279232000E+08 Before EPSSolve, on Processor127, memory: 0.79200256000E+08 [117]PETSC ERROR: ------------------------------------------------------------------------ [117]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range [117]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [117]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [117]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [117]PETSC ERROR: likely location of problem given in stack below [117]PETSC ERROR: --------------------- Stack Frames ------------------------------------ [117]PETSC ERROR: Note: The EXACT line numbers in the stack are not available, [117]PETSC ERROR: INSTEAD the line number of the start of the function [117]PETSC ERROR: is given. [117]PETSC ERROR: [117] SuperLU_DIST:pzgssvx line 411 /lustre/home1/u/anthony/petsc-3.6.1/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c [117]PETSC ERROR: [117] MatLUFactorNumeric_SuperLU_DIST line 282 /lustre/home1/u/anthony/petsc-3.6.1/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c [117]PETSC ERROR: [117] MatLUFactorNumeric line 2935 /lustre/home1/u/anthony/petsc-3.6.1/src/mat/interface/matrix.c [117]PETSC ERROR: [117] PCSetUp_LU line 99 /lustre/home1/u/anthony/petsc-3.6.1/src/ksp/pc/impls/factor/lu/lu.c [117]PETSC ERROR: [117] PCSetUp line 944 /lustre/home1/u/anthony/petsc-3.6.1/src/ksp/pc/interface/precon.c [117]PETSC ERROR: [117] KSPSetUp line 247 /lustre/home1/u/anthony/petsc-3.6.1/src/ksp/ksp/interface/itfunc.c [117]PETSC ERROR: [117] STSetUp_Sinvert line 116 /lustre/home1/u/anthony/slepc-3.6.1/src/sys/classes/st/impls/sinvert/sinvert.c [117]PETSC ERROR: [117] STSetUp line 273 /lustre/home1/u/anthony/slepc-3.6.1/src/sys/classes/st/interface/stsolve.c [117]PETSC ERROR: [117] EPSSetUp line 58 /lustre/home1/u/anthony/slepc-3.6.1/src/eps/interface/epssetup.c [117]PETSC ERROR: [117] EPSSolve line 83 /lustre/home1/u/anthony/slepc-3.6.1/src/eps/interface/epssolve.c [117]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [117]PETSC ERROR: Signal received [117]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [117]PETSC ERROR: Petsc Release Version 3.6.1, Jul, 22, 2015 [117]PETSC ERROR: BiGlobal_Solver.x on a linux-gnu-debug-mumps-superludist-4.1-complex named nid04987 by anthony Thu Sep 24 15:20:10 2015 [117]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu-debug-mumps-superludist-4.1-complex CC=cc CXX=CC FC=ftn --useThreads=1 --with-x=0 --with-clib-autodetect=0 --with-cxxlib-autodetect=0 --with-fortranlib-autodetect=0 --with-scalar-type=complex --download-metis --download-parmetis --download-scalapack --download-mumps --download-superlu_dist=/lustre/home1/u/anthony/superlu_dist_4.1.tar.gz [117]PETSC ERROR: #1 User provided function() line 0 in unknown file Rank 117 [Thu Sep 24 15:22:03 2015] [c5-1c2s2n3] application called MPI_Abort(MPI_COMM_WORLD, 59) - process 117 Program received signal SIGABRT: Process abort signal. Backtrace for this error: #0 0x25F345D in _gfortrani_backtrace at backtrace.c:258 #1 0x25DF290 in _gfortrani_backtrace_handler at compile_options.c:129 #2 0x27A9EDF in raise #3 0x27A9E9B in raise at pt-raise.c:41 #4 0x27BDAB0 in abort at abort.c:92 #5 0x26868F1 in MPID_Abort #6 0x265B942 in PMPI_Abort #7 0x4F6522 in PetscSignalHandlerDefault at signal.c:161 #8 0x4F5D75 in PetscSignalHandler_Private at signal.c:49 #9 0x27A9EDF in raise #10 0x1C6FBF0 in psymbfact_LUXpand at psymbfact_util.c:314 #11 0x1C64E5F in symbfact_vtx at psymbfact.c:2057 #12 0x1C6625D in blk_symbfact at psymbfact.c:2508 #13 0x1C6DDA8 in intraLvl_symbfact at psymbfact.c:4854 #14 0x1C60E26 in symbfact_dist at psymbfact.c:456 #15 0x1C2CB15 in pzgssvx at pzgssvx.c:1011 #16 0x10876EA in MatLUFactorNumeric_SuperLU_DIST at superlu_dist.c:411 #17 0x10D486D in MatLUFactorNumeric at matrix.c:2946 #18 0x136620A in PCSetUp_LU at lu.c:152 #19 0x126A9C2 in PCSetUp at precon.c:982 #20 0x143C348 in KSPSetUp at itfunc.c:332 #21 0x1D22E0A in STSetUp_Sinvert at sinvert.c:147 #22 0x1E93556 in STSetUp at stsolve.c:305 #23 0x1D61094 in EPSSetUp at epssetup.c:208 #24 0x1D65001 in EPSSolve at epssolve.c:88 #25 0x1CFBFD6 in epssolve_ at epssolvef.c:88 #26 0x41FD59 in __setupsolveevp_MOD_setupsolvegevp at module_SetupSolveEVP.F90:274 #27 0x43BAAE in biglobal_solver at BiGlobal_Solver.F90:403 _pmiu_daemon(SIGCHLD): [NID 04987] [c5-1c2s2n3] [Thu Sep 24 15:22:06 2015] PE RANK 117 exit signal Aborted [NID 04987] 2015-09-24 15:22:06 Apid 32680922: initiated application termination Application 32680922 exit codes: 134 Application 32680922 exit signals: Killed Application 32680922 resources: utime ~112s, stime ~13s, Rss ~484832, inblocks ~223949, outblocks ~563447