[petsc-users] SNES NEWTONLS serial vs. parallel

David Knezevic david.knezevic at akselos.com
Wed Jan 13 14:48:57 CST 2016


I'm using NEWTONLS (with mumps for the linear solves) to do a nonlinear PDE
solve. It converges well when I use 1 core. When I use 2 or more cores, the
line search stagnates. I've pasted the output of -snes_linesearch_monitor
below in these two cases.

I was wondering if this implies that I must have a bug in parallel, or if
perhaps the NEWTONLS solver can behave slightly differently in parallel?

Thanks,
David

---------------------------------------------------------------------------------------

*Serial case:*
  NL step  0, |residual|_2 = 4.714515e-02
      Line search: gnorm after quadratic fit 7.862867755323e-02
      Line search: Cubically determined step, current gnorm
4.663945043239e-02 lambda=1.4276549921126183e-02
  NL step  1, |residual|_2 = 4.663945e-02
      Line search: gnorm after quadratic fit 6.977268575068e-02
      Line search: Cubically determined step, current gnorm
4.594912794004e-02 lambda=2.3644825912085998e-02
  NL step  2, |residual|_2 = 4.594913e-02
      Line search: gnorm after quadratic fit 5.502067932478e-02
      Line search: Cubically determined step, current gnorm
4.494531294405e-02 lambda=4.1260497615261321e-02
  NL step  3, |residual|_2 = 4.494531e-02
      Line search: gnorm after quadratic fit 5.415371063247e-02
      Line search: Cubically determined step, current gnorm
4.392165925471e-02 lambda=3.6375618871780056e-02
  NL step  4, |residual|_2 = 4.392166e-02
      Line search: gnorm after quadratic fit 4.631663976615e-02
      Line search: Cubically determined step, current gnorm
4.246200798775e-02 lambda=5.0000000000000003e-02
  NL step  5, |residual|_2 = 4.246201e-02
      Line search: gnorm after quadratic fit 4.222105321728e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step  6, |residual|_2 = 4.222105e-02
      Line search: gnorm after quadratic fit 4.026081251872e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step  7, |residual|_2 = 4.026081e-02
      Line search: gnorm after quadratic fit 3.776439532346e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step  8, |residual|_2 = 3.776440e-02
      Line search: gnorm after quadratic fit 3.659796311121e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step  9, |residual|_2 = 3.659796e-02
      Line search: gnorm after quadratic fit 3.423207664901e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 10, |residual|_2 = 3.423208e-02
      Line search: gnorm after quadratic fit 3.116928452225e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 11, |residual|_2 = 3.116928e-02
      Line search: gnorm after quadratic fit 2.874310955274e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 12, |residual|_2 = 2.874311e-02
      Line search: gnorm after quadratic fit 2.587826662305e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 13, |residual|_2 = 2.587827e-02
      Line search: gnorm after quadratic fit 2.344161073075e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 14, |residual|_2 = 2.344161e-02
      Line search: gnorm after quadratic fit 2.187719889554e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 15, |residual|_2 = 2.187720e-02
      Line search: gnorm after quadratic fit 1.983089075086e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 16, |residual|_2 = 1.983089e-02
      Line search: gnorm after quadratic fit 1.791227711151e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 17, |residual|_2 = 1.791228e-02
      Line search: gnorm after quadratic fit 1.613250573900e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 18, |residual|_2 = 1.613251e-02
      Line search: gnorm after quadratic fit 1.455841843183e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 19, |residual|_2 = 1.455842e-02
      Line search: gnorm after quadratic fit 1.321849780208e-02
      Line search: Quadratically determined step,
lambda=1.0574876450981290e-01
  NL step 20, |residual|_2 = 1.321850e-02
      Line search: gnorm after quadratic fit 9.209641609489e-03
      Line search: Quadratically determined step,
lambda=3.0589684959139674e-01
  NL step 21, |residual|_2 = 9.209642e-03
      Line search: gnorm after quadratic fit 7.590942028574e-03
      Line search: Quadratically determined step,
lambda=2.0920305898507460e-01
  NL step 22, |residual|_2 = 7.590942e-03
      Line search: gnorm after quadratic fit 4.373918927227e-03
      Line search: Quadratically determined step,
lambda=4.2379743128074154e-01
  NL step 23, |residual|_2 = 4.373919e-03
      Line search: gnorm after quadratic fit 3.681351665911e-03
      Line search: Quadratically determined step,
lambda=1.9626618428089049e-01
  NL step 24, |residual|_2 = 3.681352e-03
      Line search: gnorm after quadratic fit 2.594782418891e-03
      Line search: Quadratically determined step,
lambda=3.8057533372167579e-01
  NL step 25, |residual|_2 = 2.594782e-03
      Line search: gnorm after quadratic fit 1.803188279452e-03
      Line search: Quadratically determined step,
lambda=4.3574109448916826e-01
  NL step 26, |residual|_2 = 1.803188e-03
      Line search: Using full step: fnorm 1.803188279452e-03 gnorm
9.015947319176e-04
  NL step 27, |residual|_2 = 9.015947e-04
      Line search: Using full step: fnorm 9.015947319176e-04 gnorm
7.088879385731e-08
  NL step 28, |residual|_2 = 7.088879e-08
      Line search: gnorm after quadratic fit 7.088878906502e-08
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088878957116e-08 lambda=2.1132490715284968e-01
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385683e-08 lambda=9.2196195824189087e-02
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385711e-08 lambda=4.0004532931495446e-02
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385722e-08 lambda=1.7374764617622523e-02
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385726e-08 lambda=7.5449542135114234e-03
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=3.2764749100364717e-03
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.4228361655588414e-03
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=6.1787884492365153e-04
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.6831916265377548e-04
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.1651988987471248e-04
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=5.0599757911789984e-05
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.1973377296845284e-05
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=9.5421268734746417e-06
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=4.1437501409853001e-06
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.7994589108402447e-06
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=7.8143041004756041e-07
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=3.3934283359762142e-07
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.4736252548330828e-07
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=6.3993436038104693e-08
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.7789696481734489e-08
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.2067913185456743e-08
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=5.2405944320925838e-09
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.2757729177880525e-09
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=9.8827383810151057e-10
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=4.2916635989551390e-10
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.8636915940199893e-10
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=8.0932400164504977e-11
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=3.5145586412497970e-11
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.5262271250668997e-11
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=6.6277717206096633e-12
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.8781665100197773e-12
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.2498684035299616e-12
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=5.4276603549660526e-13
      Line search: unable to find good step length! After 33 tries
      Line search: fnorm=7.0888793857309783e-08,
gnorm=7.0888793857309783e-08, ynorm=2.4650076775058285e-08,
minlambda=9.9999999999999998e-13, lambda=5.4276603549660526e-13, initial
slope=-5.0252210945441613e-15


*Parallel case:*
  NL step  0, |residual|_2 = 4.714515e-02
      Line search: gnorm after quadratic fit 7.862867755323e-02
      Line search: Cubically determined step, current gnorm
4.663945043239e-02 lambda=1.4276549921126183e-02
  NL step  1, |residual|_2 = 4.663945e-02
      Line search: gnorm after quadratic fit 6.977268575068e-02
      Line search: Cubically determined step, current gnorm
4.594912794004e-02 lambda=2.3644825912085998e-02
  NL step  2, |residual|_2 = 4.594913e-02
      Line search: gnorm after quadratic fit 5.502067932478e-02
      Line search: Cubically determined step, current gnorm
4.494531294405e-02 lambda=4.1260497615261321e-02
  NL step  3, |residual|_2 = 4.494531e-02
      Line search: gnorm after quadratic fit 5.415371063247e-02
      Line search: Cubically determined step, current gnorm
4.392165925471e-02 lambda=3.6375618871780056e-02
  NL step  4, |residual|_2 = 4.392166e-02
      Line search: gnorm after quadratic fit 4.631663976615e-02
      Line search: Cubically determined step, current gnorm
4.246200798775e-02 lambda=5.0000000000000003e-02
  NL step  5, |residual|_2 = 4.246201e-02
      Line search: gnorm after quadratic fit 4.222105321728e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step  6, |residual|_2 = 4.222105e-02
      Line search: gnorm after quadratic fit 4.026081251872e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step  7, |residual|_2 = 4.026081e-02
      Line search: gnorm after quadratic fit 3.776439532346e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step  8, |residual|_2 = 3.776440e-02
      Line search: gnorm after quadratic fit 3.659796311121e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step  9, |residual|_2 = 3.659796e-02
      Line search: gnorm after quadratic fit 3.423207664901e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 10, |residual|_2 = 3.423208e-02
      Line search: gnorm after quadratic fit 3.116928452225e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 11, |residual|_2 = 3.116928e-02
      Line search: gnorm after quadratic fit 2.874310955274e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 12, |residual|_2 = 2.874311e-02
      Line search: gnorm after quadratic fit 2.587826662305e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 13, |residual|_2 = 2.587827e-02
      Line search: gnorm after quadratic fit 2.344161073075e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 14, |residual|_2 = 2.344161e-02
      Line search: gnorm after quadratic fit 2.187719889554e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 15, |residual|_2 = 2.187720e-02
      Line search: gnorm after quadratic fit 1.983089075086e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 16, |residual|_2 = 1.983089e-02
      Line search: gnorm after quadratic fit 1.791227711151e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 17, |residual|_2 = 1.791228e-02
      Line search: gnorm after quadratic fit 1.613250573900e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 18, |residual|_2 = 1.613251e-02
      Line search: gnorm after quadratic fit 1.455841843183e-02
      Line search: Quadratically determined step,
lambda=1.0000000000000001e-01
  NL step 19, |residual|_2 = 1.455842e-02
      Line search: gnorm after quadratic fit 1.321849780208e-02
      Line search: Quadratically determined step,
lambda=1.0574876450981290e-01
  NL step 20, |residual|_2 = 1.321850e-02
      Line search: gnorm after quadratic fit 9.209641609489e-03
      Line search: Quadratically determined step,
lambda=3.0589684959139674e-01
  NL step 21, |residual|_2 = 9.209642e-03
      Line search: gnorm after quadratic fit 7.590942028574e-03
      Line search: Quadratically determined step,
lambda=2.0920305898507460e-01
  NL step 22, |residual|_2 = 7.590942e-03
      Line search: gnorm after quadratic fit 4.373918927227e-03
      Line search: Quadratically determined step,
lambda=4.2379743128074154e-01
  NL step 23, |residual|_2 = 4.373919e-03
      Line search: gnorm after quadratic fit 3.681351665911e-03
      Line search: Quadratically determined step,
lambda=1.9626618428089049e-01
  NL step 24, |residual|_2 = 3.681352e-03
      Line search: gnorm after quadratic fit 2.594782418891e-03
      Line search: Quadratically determined step,
lambda=3.8057533372167579e-01
  NL step 25, |residual|_2 = 2.594782e-03
      Line search: gnorm after quadratic fit 1.803188279452e-03
      Line search: Quadratically determined step,
lambda=4.3574109448916826e-01
  NL step 26, |residual|_2 = 1.803188e-03
      Line search: Using full step: fnorm 1.803188279452e-03 gnorm
9.015947319176e-04
  NL step 27, |residual|_2 = 9.015947e-04
      Line search: Using full step: fnorm 9.015947319176e-04 gnorm
7.088879385731e-08
  NL step 28, |residual|_2 = 7.088879e-08
      Line search: gnorm after quadratic fit 7.088878906502e-08
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088878957116e-08 lambda=2.1132490715284968e-01
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385683e-08 lambda=9.2196195824189087e-02
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385711e-08 lambda=4.0004532931495446e-02
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385722e-08 lambda=1.7374764617622523e-02
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385726e-08 lambda=7.5449542135114234e-03
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=3.2764749100364717e-03
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.4228361655588414e-03
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=6.1787884492365153e-04
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.6831916265377548e-04
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.1651988987471248e-04
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=5.0599757911789984e-05
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.1973377296845284e-05
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=9.5421268734746417e-06
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=4.1437501409853001e-06
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.7994589108402447e-06
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=7.8143041004756041e-07
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=3.3934283359762142e-07
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.4736252548330828e-07
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=6.3993436038104693e-08
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.7789696481734489e-08
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.2067913185456743e-08
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=5.2405944320925838e-09
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.2757729177880525e-09
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=9.8827383810151057e-10
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=4.2916635989551390e-10
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.8636915940199893e-10
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=8.0932400164504977e-11
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=3.5145586412497970e-11
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.5262271250668997e-11
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=6.6277717206096633e-12
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=2.8781665100197773e-12
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=1.2498684035299616e-12
      Line search: Cubic step no good, shrinking lambda, current gnorm
7.088879385731e-08 lambda=5.4276603549660526e-13
      Line search: unable to find good step length! After 33 tries
      Line search: fnorm=7.0888793857309783e-08,
gnorm=7.0888793857309783e-08, ynorm=2.4650076775058285e-08,
minlambda=9.9999999999999998e-13, lambda=5.4276603549660526e-13, initial
slope=-5.0252210945441613e-15
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20160113/6b6f100d/attachment-0001.html>


More information about the petsc-users mailing list