<html><body><div style="color:#000; background-color:#fff; font-family:arial, helvetica, sans-serif;font-size:12pt"><div>Thanks Barry and Jed.</div><div><br></div><div><span>on the NERSC computers, the installed petsc version of 3.1 is giving the error</span></div><div><span>'undefined reference to `PetscViewerHDF5Open' </span></div><div>I included petscsys.h </div><div>I also tried to run the two example programs </div><div>http://www.mcs.anl.gov/petsc/petsc-as/snapshots/petsc-3.1/src/dm/da/examples/tutorials/ex10.c.html and ex9.c<br></div><div><br></div><div>illustrating the HDF5 output. They also give the same error.</div><div><br></div><div>Could you please tell me if I am missing something or the nersc installation is missing something. </div><div style="font-size: 12pt; font-family: arial, helvetica, sans-serif; "><div style="font-size: 12pt; font-family: 'times new roman', 'new york', times, serif; "><font size="2"
face="Arial"><br><hr size="1"><b><span style="font-weight:bold;">From:</span></b> Barry Smith <bsmith@mcs.anl.gov><br><b><span style="font-weight: bold;">To:</span></b> PETSc users list <petsc-users@mcs.anl.gov><br><b><span style="font-weight: bold;">Cc:</span></b> khalid ashraf <khalid_eee@yahoo.com><br><b><span style="font-weight: bold;">Sent:</span></b> Friday, September 23, 2011 12:40 PM<br><b><span style="font-weight: bold;">Subject:</span></b> Re: [petsc-users] scaling a parallel matrix<br></font><br><br>On Sep 23, 2011, at 1:48 PM, Jed Brown wrote:<br><br>> On Fri, Sep 23, 2011 at 13:35, khalid ashraf <<a ymailto="mailto:khalid_eee@yahoo.com" href="mailto:khalid_eee@yahoo.com">khalid_eee@yahoo.com</a>> wrote:<br>> Hi, I have a vector defined on a 3D DA of size ~1000X1000X30. I run the program on ~4000 processors. <br>> After doing the calculations, print the vector in vtk format. I need to print about ~10 times at
different time steps.<br>> The printing takes about 3 hours. Is there a way to reduce the time required to print parallel vector printing.<br>> <br>> The VTK ASCII format is a horrible parallel format. One reliable option if you like the VTK tool chain is to write a "parallel" VTK XML format with binary appended data. You can also write an HDF5 file and either provide your own reader for whatever visualization software you are using or write an XDMF file to inform the reader of what to find where.<br>> <br>> <br>> I am trying to average over some blocks of grid points and represent the data with a smaller sized vector defined on a smaller 3D DA. One thing I am not clear is that how to get the same layout for the large and smaller DA, so that all the calculations are local when doing the averaging. Could you please provide any guidance ?<br>> <br>> See the lx,ly,lz parameters to DMDACreate3d().<br>> <br>> <a
href="http://www.mcs.anl.gov/petsc/petsc-as/snapshots/petsc-dev/docs/manualpages/DM/DMDACreate3d.html" target="_blank">http://www.mcs.anl.gov/petsc/petsc-as/snapshots/petsc-dev/docs/manualpages/DM/DMDACreate3d.html</a><br> <br> Or you can generate the finer DMDA by refining the coarse grid with DMRefine() or generate the coarser mesh by DMCoarsening the finer. They will automatically have the correct layout. Note you can use DMGetInterpolation() to get an operator that can be used to restrict from the fine grid to the coarse then scale by the vector argument returned by DMGetInterpolation(). Using the MatRestrict() with that operator performs a local piecewise linear averaging.<br><br> Barry<br><br><br><br><br></div></div></div></body></html>