mpirun -np 4 ./reader -pc_type asm -sub_pc_type lu -sub_mat_type dense -ksp_monitor -ksp_rtol 1e-13 -ksp_max_it 100 -vecscatter_alltoall -log_summary 0 KSP Residual norm 2.796180560928e+11 1 KSP Residual norm 2.759734147989e+11 2 KSP Residual norm 2.246291222323e+11 3 KSP Residual norm 2.243754143244e+11 4 KSP Residual norm 2.233233743268e+11 5 KSP Residual norm 2.205423624921e+11 6 KSP Residual norm 2.149640078607e+11 7 KSP Residual norm 2.141812259181e+11 8 KSP Residual norm 2.131891340598e+11 9 KSP Residual norm 2.120128062147e+11 10 KSP Residual norm 2.105077339616e+11 11 KSP Residual norm 2.087049338248e+11 12 KSP Residual norm 2.086858042000e+11 13 KSP Residual norm 2.085462944526e+11 14 KSP Residual norm 2.084540136893e+11 15 KSP Residual norm 2.074353771155e+11 16 KSP Residual norm 2.037710564549e+11 17 KSP Residual norm 2.036318375222e+11 18 KSP Residual norm 2.035689987707e+11 19 KSP Residual norm 2.023827066517e+11 20 KSP Residual norm 2.020709886915e+11 21 KSP Residual norm 2.016179439540e+11 22 KSP Residual norm 1.999395699480e+11 23 KSP Residual norm 1.994247004409e+11 24 KSP Residual norm 1.984416281397e+11 25 KSP Residual norm 1.969463176856e+11 26 KSP Residual norm 1.969459764358e+11 27 KSP Residual norm 1.969156622998e+11 28 KSP Residual norm 1.968759534376e+11 29 KSP Residual norm 1.967604681262e+11 30 KSP Residual norm 1.967600926560e+11 31 KSP Residual norm 1.967600920595e+11 32 KSP Residual norm 1.967600175468e+11 33 KSP Residual norm 1.967600168963e+11 34 KSP Residual norm 1.967599162445e+11 35 KSP Residual norm 1.967599111343e+11 36 KSP Residual norm 1.967598808269e+11 37 KSP Residual norm 1.967598786199e+11 38 KSP Residual norm 1.967598485660e+11 39 KSP Residual norm 1.967598459587e+11 40 KSP Residual norm 1.967598391955e+11 41 KSP Residual norm 1.967598033535e+11 42 KSP Residual norm 1.967597895101e+11 43 KSP Residual norm 1.967597159280e+11 44 KSP Residual norm 1.967578705555e+11 45 KSP Residual norm 1.967572667009e+11 46 KSP Residual norm 1.967549548934e+11 47 KSP Residual norm 1.967520060154e+11 48 KSP Residual norm 1.967516106829e+11 49 KSP Residual norm 1.967491207618e+11 50 KSP Residual norm 1.967455806534e+11 51 KSP Residual norm 1.967454356577e+11 52 KSP Residual norm 1.967406709910e+11 53 KSP Residual norm 1.967406655553e+11 54 KSP Residual norm 1.967338772292e+11 55 KSP Residual norm 1.967336950680e+11 56 KSP Residual norm 1.967042306653e+11 57 KSP Residual norm 1.967014079325e+11 58 KSP Residual norm 1.965966955099e+11 59 KSP Residual norm 1.965946552939e+11 60 KSP Residual norm 1.965920360828e+11 61 KSP Residual norm 1.965920352510e+11 62 KSP Residual norm 1.965920352488e+11 63 KSP Residual norm 1.965920349421e+11 64 KSP Residual norm 1.965920327559e+11 65 KSP Residual norm 1.965920314831e+11 66 KSP Residual norm 1.965920305431e+11 67 KSP Residual norm 1.965920300813e+11 68 KSP Residual norm 1.965920299420e+11 69 KSP Residual norm 1.965920297841e+11 70 KSP Residual norm 1.965920294962e+11 71 KSP Residual norm 1.965920288893e+11 72 KSP Residual norm 1.965920257956e+11 73 KSP Residual norm 1.965920173914e+11 74 KSP Residual norm 1.965919597187e+11 75 KSP Residual norm 1.965919378134e+11 76 KSP Residual norm 1.965918186553e+11 77 KSP Residual norm 1.965918183509e+11 78 KSP Residual norm 1.965915059134e+11 79 KSP Residual norm 1.965915021381e+11 80 KSP Residual norm 1.965914921284e+11 81 KSP Residual norm 1.965914884570e+11 82 KSP Residual norm 1.965913656300e+11 83 KSP Residual norm 1.965910010479e+11 84 KSP Residual norm 1.965904806173e+11 85 KSP Residual norm 1.965904678796e+11 86 KSP Residual norm 1.965878981130e+11 87 KSP Residual norm 1.965872174387e+11 88 KSP Residual norm 1.965614316753e+11 89 KSP Residual norm 1.965475964313e+11 90 KSP Residual norm 1.965120825947e+11 91 KSP Residual norm 1.965120587176e+11 92 KSP Residual norm 1.965120587133e+11 93 KSP Residual norm 1.965120586451e+11 94 KSP Residual norm 1.965120509329e+11 95 KSP Residual norm 1.965120508150e+11 96 KSP Residual norm 1.965120498460e+11 97 KSP Residual norm 1.965120482082e+11 98 KSP Residual norm 1.965120456362e+11 99 KSP Residual norm 1.965120430903e+11 100 KSP Residual norm 1.965120353353e+11 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./reader on a production named fsi with 4 processors, by anil Wed Mar 27 09:40:23 2013 Using Petsc Development GIT revision: d2d62a27393019ec1607ccfb8b73077d351f6280 GIT Date: 2013-03-20 22:13:25 -0500 Max Max/Min Avg Total Time (sec): 1.766e+00 1.00000 1.766e+00 Objects: 4.540e+02 1.02483 4.512e+02 Flops: 4.578e+08 1.46172 3.721e+08 1.488e+09 Flops/sec: 2.592e+08 1.46172 2.107e+08 8.426e+08 MPI Messages: 8.200e+01 1.64000 6.600e+01 2.640e+02 MPI Message Lengths: 3.806e+05 1.71456 4.480e+03 1.183e+06 MPI Reductions: 3.229e+03 1.00311 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flops ----- --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total counts %Total Avg %Total counts %Total 0: Main Stage: 1.7664e+00 100.0% 1.4884e+09 100.0% 2.640e+02 100.0% 4.480e+03 100.0% 3.226e+03 99.9% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flops: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent Avg. len: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %f - percent flops in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flops --- Global --- --- Stage --- Total Max Ratio Max Ratio Max Ratio Mess Avg len Reduct %T %f %M %L %R %T %f %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage VecMax 6 1.0 5.8889e-05 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecMin 6 1.0 1.5855e-04 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecMDot 100 1.0 5.1952e-01169.3 2.70e+06 1.2 0.0e+00 0.0e+00 1.0e+02 19 1 0 0 3 19 1 0 0 3 19 VecNorm 104 1.0 3.2657e-0248.6 1.93e+05 1.2 0.0e+00 0.0e+00 1.0e+02 1 0 0 0 3 1 0 0 0 3 22 VecScale 104 1.0 1.6236e-04 1.1 9.67e+04 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2230 VecCopy 4 1.0 1.3351e-05 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecSet 2142 1.1 7.7987e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAXPY 7 1.0 2.4080e-05 1.1 1.30e+04 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2024 VecMAXPY 104 1.0 3.7069e-03 1.2 2.88e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 2911 VecAssemblyBegin 126 1.0 5.7156e-03 2.1 0.00e+00 0.0 4.8e+01 2.0e+02 3.8e+02 0 0 18 1 12 0 0 18 1 12 0 VecAssemblyEnd 126 1.0 1.2398e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecScatterBegin 6065 1.0 5.3101e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 2.1e+03 0 0 0 61 65 0 0 0 61 66 0 VecScatterEnd 4089 1.0 1.1003e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecNormalize 104 1.0 3.2904e-0235.7 2.90e+05 1.2 0.0e+00 0.0e+00 1.0e+02 1 0 0 0 3 1 0 0 0 3 33 InitVec 1 1.0 6.5088e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 0 0 InitCluster 1 1.0 4.6802e-04 1.0 0.00e+00 0.0 2.4e+01 1.7e+02 1.2e+01 0 0 9 0 0 0 0 9 0 0 0 InitIS 1 1.0 4.4680e-04 1.0 0.00e+00 0.0 2.0e+01 1.5e+03 1.1e+01 0 0 8 3 0 0 0 8 3 0 0 InitGhost 1 1.0 5.2595e-04 1.0 0.00e+00 0.0 4.4e+01 1.4e+03 3.7e+01 0 0 17 5 1 0 0 17 5 1 0 InitMat 1 1.0 7.5793e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 4.8e+01 0 0 0 0 1 0 0 0 0 1 0 Post Processing 1 1.0 1.2221e-03 1.1 0.00e+00 0.0 2.0e+01 2.0e+03 1.0e+01 0 0 8 3 0 0 0 8 3 0 0 MatMult 103 1.0 1.6388e+00 1.5 4.29e+08 1.5 0.0e+00 0.0e+00 4.1e+02 73 93 0 51 13 73 93 0 51 13 841 MatSolve 1560 1.5 1.8429e-02 1.3 1.90e+07 1.6 0.0e+00 0.0e+00 0.0e+00 1 4 0 0 0 1 4 0 0 0 3584 MatLUFactorSym 19 1.1 7.8678e-06 4.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatLUFactorNum 19 1.1 1.7062e-02 7.2 6.59e+06 2.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 1261 MatAssemblyBegin 19 1.1 8.8215e-06 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatAssemblyEnd 19 1.1 3.0994e-06 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetSubMatrice 1 1.0 6.6030e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 7.5e+01 0 0 0 0 2 0 0 0 0 2 0 MatView 1 1.0 4.0531e-06 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 KSPGMRESOrthog 100 1.0 5.2255e-0178.2 5.39e+06 1.2 0.0e+00 0.0e+00 1.0e+02 19 1 0 0 3 19 1 0 0 3 39 KSPSetUp 20 1.1 7.7963e-05 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 KSPSolve 1 1.0 1.7157e+00 1.0 4.58e+08 1.5 0.0e+00 0.0e+00 3.0e+03 97100 0 51 92 97100 0 51 92 868 PCSetUp 20 1.1 2.6649e-02 2.6 6.59e+06 2.1 0.0e+00 0.0e+00 3.8e+02 1 1 0 0 12 1 1 0 0 12 808 PCSetUpOnBlocks 1 1.0 1.7533e-02 6.2 6.59e+06 2.1 0.0e+00 0.0e+00 3.8e+01 0 1 0 0 1 0 1 0 0 1 1227 PCApply 104 1.0 4.1471e-02 1.1 1.90e+07 1.6 0.0e+00 0.0e+00 2.0e+03 2 4 0 0 61 2 4 0 0 61 1593 InitVec 1 1.0 1.7095e-04 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 8.0e+00 0 0 0 0 0 0 0 0 0 0 0 InitCluster 1 1.0 5.9390e-04 1.0 0.00e+00 0.0 2.4e+01 2.3e+02 1.2e+01 0 0 9 0 0 0 0 9 0 0 0 InitIS 1 1.0 5.4693e-04 1.0 0.00e+00 0.0 4.0e+01 2.9e+03 2.2e+01 0 0 15 10 1 0 0 15 10 1 0 InitGhost 1 1.0 9.6202e-04 1.0 0.00e+00 0.0 6.4e+01 3.2e+03 6.2e+01 0 0 24 17 2 0 0 24 17 2 0 InitRHS 1 1.0 3.2440e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 2 0 0 0 0 2 0 0 0 0 0 Post Processing 1 1.0 7.8430e-0319.2 0.00e+00 0.0 2.8e+01 4.2e+03 1.0e+01 0 0 11 10 0 0 0 11 10 0 0 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Vector 131 119 633520 0 Vector Scatter 69 69 66036 0 Index Set 151 151 142804 0 IS L to G Mapping 22 22 19344 0 Matrix 40 40 1024276 0 Viewer 1 0 0 0 Krylov Solver 20 20 40256 0 Preconditioner 20 20 19472 0 ======================================================================================================================== Average time to get PetscTime(): 0 Average time for MPI_Barrier(): 5.38826e-06 Average time for zero size MPI_Send(): 1.29938e-05 #PETSc Option Table entries: -ksp_max_it 100 -ksp_monitor -ksp_rtol 1e-13 -log_summary -pc_type asm -sub_mat_type dense -sub_pc_type lu -vecscatter_alltoall #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure run at: Thu Mar 21 16:54:16 2013 Configure options: PETSC_ARCH=production --prefix=/opt/petsc/petsc-3.3-p5_production --with-clanguage=cxx --with-debugging=0 --download--mpich=../petscExternalPackages/mpich2-1.4.1p1.tar.gz --download-parmetis=../petscExternalPackages/parmetis-4.0.2-p3.tar.gz --with-sieve --download-fftw=../petscExternalPackages/fftw-3.3.2.tar.gz --download-sprng=../petscExternalPackages/sprng-1.0.tar.gz --with-boost --download-metis=../petscExternalPackages/metis-5.0.2-p3.tar.gz --download-sowing=../petscExternalPackages/sowing-1.1.16d.tar.gz --download-c2html=../petscExternalPackages/c2html.tar.gz CXXOPTFLAGS=-03 ----------------------------------------- Libraries compiled on Thu Mar 21 16:54:16 2013 on fsi Machine characteristics: Linux-3.2.0-37-generic-x86_64-with-LinuxMint-13-maya Using PETSc directory: /home/anil/repo_clones/petsc Using PETSc arch: production ----------------------------------------- Using C compiler: mpicxx -Wall -Wwrite-strings -Wno-strict-aliasing -Wno-unknown-pragmas -fPIC ${COPTFLAGS} ${CFLAGS} Using Fortran compiler: mpif90 -fPIC -Wall -Wno-unused-variable -Wno-unused-dummy-argument -O ${FOPTFLAGS} ${FFLAGS} ----------------------------------------- Using include paths: -I/home/anil/repo_clones/petsc/production/include -I/home/anil/repo_clones/petsc/include -I/home/anil/repo_clones/petsc/include -I/home/anil/repo_clones/petsc/production/include -I/home/anil/repo_clones/petsc/include/sieve -I/usr/lib/openmpi/include -I/usr/lib/openmpi/include/openmpi ----------------------------------------- Using C linker: mpicxx Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/home/anil/repo_clones/petsc/production/lib -L/home/anil/repo_clones/petsc/production/lib -lpetsc -llapack -lblas -lX11 -Wl,-rpath,/home/anil/repo_clones/petsc/production/lib -L/home/anil/repo_clones/petsc/production/lib -lparmetis -lmetis -llcg -lpthread -lfftw3_mpi -lfftw3 -Wl,-rpath,/usr/lib/openmpi/lib -L/usr/lib/openmpi/lib -Wl,-rpath,/usr/lib/gcc/x86_64-linux-gnu/4.6 -L/usr/lib/gcc/x86_64-linux-gnu/4.6 -Wl,-rpath,/usr/lib/x86_64-linux-gnu -L/usr/lib/x86_64-linux-gnu -Wl,-rpath,/lib/x86_64-linux-gnu -L/lib/x86_64-linux-gnu -lmpi_f90 -lmpi_f77 -lgfortran -lm -lgfortran -lm -lgfortran -lm -lm -lquadmath -lm -Wl,-rpath,/usr/lib/gcc/x86_64-linux-gnu/4.7 -L/usr/lib/gcc/x86_64-linux-gnu/4.7 -lmpi_cxx -lstdc++ -ldl -lmpi -lopen-rte -lopen-pal -lnsl -lutil -lgcc_s -lpthread -ldl -----------------------------------------