[petsc-dev] testing on Titan

[Lawrence Mitchell]

> On 29 Jun 2018, at 12:46, Mark Adams <mfadams at lbl.gov> wrote:
> 
> I can not even run a job here. This is from an interactive shell:
> 
> 64-pgi ex19-batch1:~/petsc/src/snes/examples/tutorials> make PETSC_DIR=/autofs/nccs-svm1_home1/adams/petsc PETSC_ARCH=arch-titan-dbg6
> cc -o ex19.o -c -fast -mp   -I/autofs/nccs-svm1_home1/adams/petsc/include -I/autofs/nccs-svm1_home1/adams/petsc/arch-titan-dbg64-pgi/include -I/ccs/proj/env003/petscv3.9-dbg64-pgi/include    `pwd`/ex19.c
> cc -fast -mp  -o ex19  ex19.o -L/autofs/nccs-svm1_home1/adams/petsc/arch-titan-dbg64-pgi/lib -Wl,-rpath,/ccs/proj/env003/petscv3.9-dbg64-pgi/lib -L/ccs/proj/env003/petscv3.9-dbg64-pgi/lib -lpetsc -lHYPRE -lflapack -lfblas -lparmetis -lmetis -lstdc++ -ldl
> /autofs/nccs-svm1_home1/adams/petsc/arch-titan-dbg64-pgi/lib/libpetsc.a(dlimpl.o): In function `PetscDLOpen':
> /autofs/nccs-svm1_home1/adams/petsc/src/sys/dll/dlimpl.c:54: warning: Using 'dlopen' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
> /autofs/nccs-svm1_home1/adams/petsc/arch-titan-dbg64-pgi/lib/libpetsc.a(send.o): In function `PetscOpenSocket':
> /autofs/nccs-svm1_home1/adams/petsc/src/sys/classes/viewer/impls/socket/send.c:106: warning: Using 'gethostbyname' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
> adams at titan-batch1:~/petsc/src/snes/examples/tutorials> aprun -n 1 ./ex19
> [NID 02258] 2018-06-29 07:45:09 Exec ./ex19 failed: chdir /autofs/nccs-svm1_home1/adams/petsc/src/snes/examples/tutorials No such file or directory
> adams at titan-batch1:~/petsc/src/snes/examples/tutorials> 

Lots of Crays, I think Titan is one (per https://www.olcf.ornl.gov/for-users/system-user-guides/titan/running-jobs/#filesystems-available-to-compute-nodes) do not mount all the filesystems on the compute nodes.

So plausibly you need to run from a "work" directory.

Lawrence