[petsc-dev] TS error with optimimzied build

[Barry Smith]

   It is useful to run with valgrind, even on a completely different machine, when you have errors because it will detect any memory corruption. So currently I do my valgrind runs on a linux machine.

   Assuming the prefix is correct -snes_monitor should print an initial residual norm before doing any solves so it is curious you got no output. You can run with -snes_error_if_not_converged -ksp_error_if_not_converged to try to get it to output as soon as a problem is detected.

   Barry


> On Dec 15, 2016, at 4:56 PM, Mark Adams <mfadams at lbl.gov> wrote:
> 
> I have a code that work on my Mac but it fails on both a Cray XC30 and a KNL, unless the code is build with debug. I get this error message + -info output. I am using -snes_monitor but get no output. This code was working and I added a new feature. It does seem to fail when this new feature is used.
> 
> And, alas, I do not have a functioning valgrind right now.
> 
> I will start toggling optimization flags but any thoughts would be welcome.
> 
> Mark
> 
> [0] MatAssemblyEnd_SeqAIJ(): Matrix size: 4290 X 4290; storage space: 0 unneeded,132612 used
> [0] MatAssemblyEnd_SeqAIJ(): Number of mallocs during MatSetValues() is 0
> [0] MatAssemblyEnd_SeqAIJ(): Maximum nonzeros in any row is 50
> [0] MatCheckCompressedRow(): Found the ratio (num_zerorows 0)/(num_localrows 4290) < 0.6. Do not use CompressedRow routines.
> [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374784
> [0] DMGetDMKSP(): Creating new DMKSP
> [0] TSAdaptCheckStage(): Step=0, nonlinear solve failures 1 greater than current TS allowed, stopping solve
> [0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
> [0]PETSC ERROR:
> [0]PETSC ERROR: TSStep has failed due to DIVERGED_NONLINEAR_SOLVE, increase -ts_max_snes_failures or make negative to attempt recovery
> [0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
> [0]PETSC ERROR: Petsc Development GIT revision: unknown  GIT Date: unknown
> [0]PETSC ERROR: /global/u2/m/madams/landaufem/Plex/./landaufem on a arch-cori-knl-opt64-novector-intel named nid09355 by madams Thu Dec 15 14:25:00 2016
> [0]PETSC ERROR: TSSolve failed
> 1 TS time steps, 512 cells, Nq=9 (4608 IPs), T=0.
> Configure options COPTFLAGS="  -g -O1 -fp-model fast -qopt-report=5 -hcpu=mic-knl -no-simd" CXXOPTFLAGS="-g -O1 -fp-model fast -qopt-report=5 -hcpu=mic-knl -no-simd" FOPTFLAGS="  -g -O1 -fp-model fast -qopt-report=5 -hcpu=mic-knl -no-simd" --download-metis=1 --download-parmetis=1 --with-blas-lapack-dir=/usr/common/software/intel/compilers_and_libraries_2016.3.210/linux/mkl --with-cc=mpiicc --with-cxx=mpiicpc --with-debugging=0 --with-fc=mpiifort --with-mpiexec=srun --with-batch=0 --with-memalign=64 --with-64-bit-indices PETSC_ARCH=arch-cori-knl-opt64-novector-intel --with-openmp=0 --download-p4est=0
> [0]PETSC ERROR: #1 TSStep() line 3972 in /global/u2/m/madams/petsc/src/ts/interface/ts.c
> [0]PETSC ERROR: #2 TSSolve() line 4218 in /global/u2/m/madams/petsc/src/ts/interface/ts.c
>