[petsc-dev] new P^1.5 algorithm in VecAssembleBegin?

Mark Adams mfadams at lbl.gov
Fri May 29 07:55:16 CDT 2015


I am suspecting that it is catching load imbalance and just not reporting
it correctly. I've added a barrier in the code.

Here are the two log files.

On Thu, May 28, 2015 at 7:48 PM, Barry Smith <bsmith at mcs.anl.gov> wrote:

>
>    VecAssemblyBegin() serves as a barrier unless you set the vector option
> VEC_IGNORE_OFF_PROC_ENTRIES so I am not surprised that it "appears" to take
> a lot of time. BUT the balance between the fastest and slowest is listed in
> your table below is 1.0  which is very surprising; indicating every process
> supposedly spent the same amount of time within the VecAssemblyBegin().
> Note that for VecAssemblyEnd() the balance is 2.3 which is what I commonly
> would expect. Please send me ALL the output for -log_summary for these
> cases.  Version of PETSc shouldn't matter for this issue.
>
> > On May 28, 2015, at 4:59 PM, Mark Adams <mfadams at lbl.gov> wrote:
> >
> > We are seeing some large times spent in VecAssemblyBegin:
> >
> > VecAssemblyBegin     242 1.0 7.9796e+01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00
> 7.3e+02 12  0  0  0  5  76  0  0  0 10     0
> > VecAssemblyEnd       242 1.0 5.6624e-04 2.3 0.00e+00 0.0 0.0e+00 0.0e+00
> 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
> >
> > This is with 64K cores on Edison.  On 128K cores (weak speedup) we see:
> >
> > VecAssemblyBegin     248 1.0 2.3615e+02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00
> 7.4e+02 17  0  0  0  4  87  0  0  0 10     0
> > VecAssemblyEnd       248 1.0 6.8855e-04 2.3 0.00e+00 0.0 0.0e+00 0.0e+00
> 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
> >
> > We are working on using older versions of PETSc to make sure this is a
> PETSc issue but does anyone have any thoughts on this?
> >
> > Mark
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20150529/430e5628/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: log_64K
Type: application/octet-stream
Size: 287627 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20150529/430e5628/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: log_128K
Type: application/octet-stream
Size: 309714 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20150529/430e5628/attachment-0001.obj>


More information about the petsc-dev mailing list