[petsc-dev] errors with cuda + mumps
Zhang, Junchao
jczhang at mcs.anl.gov
Wed Mar 13 17:10:58 CDT 2019
search='snes_tutorials-ex69_q2p1fetidp_deluxe snes_tutorials-ex62_fetidp_2d_quad snes_tutorials-ex69_q2p1fetidp_deluxe_adaptive ksp_ksp_tutorials-ex52f_mumps'
Already made a PR.
--Junchao Zhang
On Wed, Mar 13, 2019 at 4:55 PM Balay, Satish <balay at mcs.anl.gov<mailto:balay at mcs.anl.gov>> wrote:
On Wed, 13 Mar 2019, Zhang, Junchao wrote:
>
>
>
> On Wed, Mar 13, 2019 at 3:49 PM Balay, Satish <balay at mcs.anl.gov<mailto:balay at mcs.anl.gov>> wrote:
> mailers that only format html and not the text form are annoying :(
>
>
> On Wed, 13 Mar 2019, Zhang, Junchao wrote:
>
> > Satish, I found something strange. I configured with --with-cuda --with-precision=single, then
> with -log_view, I saw
> > Compiled with single precision PetscScalar and PetscReal
> > Compiled with full precision matrices (default)
>
> This message is misleading [and should be fixed]. This feature was removed.
>
> >
> > I found that confused mumps. When I added --with-precision=double, I got consistent MatScalar
> and PetscScalar precision, and the errors I reported
> > disappeared. Do you know why?
>
> how is mumps confused? Perhaps this example doesn't work with single precision? [or mumps single
> precision doesn't work for this problem?]
>
>
> OK, I thought mumps was inputed with a double precision matrix and single precision vectors. I was wrong. I
> tested on my laptop --with-cuda --with-precision=single, these errors did show up. In petsc dashboard, we do
> not have "single + mumps" combination. I will create a PR to mark these tests require double.
Which examples are you referring to? Do they fail in master - or only in your feature branch?
Satish
>
> Lots of examples fail with single precision..
>
> Satish
>
> >
> > --Junchao Zhang
> >
> >
> > On Wed, Mar 13, 2019 at 11:15 AM Junchao Zhang <jczhang at mcs.anl.gov<mailto:jczhang at mcs.anl.gov>> wrote:
> > I met some errors with cuda + mumps. It was tested with
> > make -f gmakefile test search='snes_tutorials-ex69_q2p1fetidp_deluxe
> snes_tutorials-ex62_fetidp_2d_quad
> > snes_tutorials-ex69_q2p1fetidp_deluxe_adaptive ksp_ksp_tutorials-ex52f_mumps'
> >
> > I can reproduce it with petsc master. The first line of petsc nightly
> > (http://ftp.mcs.anl.gov/pub/petsc/nightlylogs/archive/2019/03/12/master.html) shows another
> error. But I guess they have the same root: PETSc
> > gives random wrong results in some cases. For example, I ran ksp_ksp_tutorials-ex52f_mumps twice
> and saw
> >
> > $ mpirun -n 3 ./ex52f
> > Mumps row pivot threshhold = 1.00E-06
> > Mumps determinant=( 9.01E-01 0.00E+00)*2^ 99
> > Norm of error 1.5554E-06 iterations 1
> >
> > $ mpirun -n 3 ./ex52f
> > Mumps row pivot threshhold = 1.00E-06
> > Mumps determinant=( 9.01E-01 0.00E+00)*2^ 99
> > Norm of error 1.6356E-06 iterations 1
> >
> >
> > The correct output has "Norm of error < 1.e-12,iterations 1". Currently, I do know the
> reason.
> >
> > --Junchao Zhang
> >
> >
> >
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20190313/f595a3ad/attachment.html>
More information about the petsc-dev
mailing list