[Nek5000-users] compilation, large memory

Fri Apr 23 07:46:23 CDT 2010

Hi Stefan,

It is not clear what NELGT in the definition of LELT at this link is (it
is not defined anywhere on the site).

Maximum number of local elements for T-mesh (>= int(NELGT/NP) + 1)

Cheers,
Frank

On Fri, 2010-04-23 at 14:36 +0200, nek5000-users at lists.mcs.anl.gov
wrote:
> Frank,
> 
> for lelt see here:
> http://nek5000.mcs.anl.gov/index.php/SIZEu
> 
> Stefan
> 
> 
> On Apr 23, 2010, at 2:36 PM, nek5000-users at lists.mcs.anl.gov wrote:
> 
> > On Fri, 2010-04-23 at 07:08 -0500, nek5000-users at lists.mcs.anl.gov
> > wrote:
> >> Hi Frank,
> >> 
> >> Are you running in parallel?   How many processors, and how
> >> many elements in the problem of interest?
> > 
> > Hi Paul,
> > 
> > I am using 72 elements and 8 processors.  I reduced lelt to 72 and it
> > works.  In general, should lelt=(# elements)/(# processors)?
> > 
> > Cheers,
> > Frank
> > 
> >> 
> >> If you have, say, 120 elements, and are running on 4 processors,
> >> you can set lelt=30, which would reduce your per-processor-memory
> >> footprint by a factor of 4.
> >> 
> >> Cheers,
> >> 
> >> Paul
> >> 
> >> 
> >> On Fri, 23 Apr 2010, nek5000-users at lists.mcs.anl.gov wrote:
> >> 
> >>> Hello all,
> >> 
> >> I am having a problem compiling on an x86_64 system.  Smaller problems
> >> work fine.  My SIZE file starts out with:
> >> 
> >>       parameter (ldim=3)
> >>       parameter (lx1=6*4,ly1=lx1,lz1=lx1,lelt=120,lelv=lelt)
> >>       parameter (lxd=9*4,lyd=lxd,lzd=lxd)
> >> 
> >> The error message is:
> >> 
> >> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/bin/mpif77 -mcmodel=medium
> >> -shared-intel -c  -O2 -r8 -fpconstant -fpp -DMPI -DLONGINT8
> >> -I/home/fmuldoo/programs/nek5000/nek5/trunk/nek
> >> -I/data/fmuldoo/engineering-marangoni-flows/sim2/sim1/sim1/sim7/AR-.66-RE-1800-PR-04.0-dt-6.0e-5-time-006.0-grid-3-Intel /data/fmuldoo/engineering-marangoni-flows/sim2/sim1/sim1/sim7/AR-.66-RE-1800-PR-04.0-dt-6.0e-5-time-006.0-grid-3-Intel/delet.f -o delet.o 
> >> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/bin/mpif77 -mcmodel=medium
> >> -shared-intel -o nek5000  delet.o drive.o drive1.o drive2.o plan4.o
> >> bdry.o coef.o conduct.o connect1.o connect2.o dssum.o edgec.o eigsolv.o
> >> gauss.o genxyz.o navier1.o navier0.o navier2.o navier3.o navier4.o
> >> prepost.o speclib.o map2.o turb.o mvmesh.o ic.o ssolv.o planx.o math.o
> >> mxm_wrapper.o hmholtz.o gfdm_par.o  gfdm_op.o gfdm_solve.o subs1.o
> >> subs2.o genbox.o gmres.o hsmg.o convect.o induct.o perturb.o navier5.o
> >> navier6.o navier7.o navier8.o fast3d.o fasts.o calcz.o byte.o chelpers.o
> >> byte_mpi.o postpro.o cvode_driver.o cvode_aux.o setprop.o qthermal.o
> >> makeq.o papi.o ssygv.o dsygv.o mxm_std.o blas.o   comm_mpi.o jl2_gs.o
> >> jl2_sort.o jl2_sarray_transfer.o jl2_sarray_sort.o jl2_gs_local.o
> >> jl2_crystal.o jl2_comm.o jl2_tensor.o jl2_fail.o jl2_fcrystal.o
> >> jl_tuple_list.o jl_transfer.o jl_sort.o jl_fcrystal.o jl_errmem.o
> >> jl_crystal.o jl_findpts.o jl_pfindpt.o jl_tensor.o jl_findpt.o jl_poly.o
> >> jl2_sparse_cholesky.o jl2_xxt.o jl2_fcrs.o 
> >> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/lib/libmpich.a(setbotf.o):
> >> In function `mpirinitf_':
> >> setbotf.f:(.text+0xd): relocation truncated to fit: R_X86_64_32 against
> >> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
> >> setbotf.f:(.text+0x12): relocation truncated to fit: R_X86_64_32 against
> >> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
> >> setbotf.f:(.text+0x17): relocation truncated to fit: R_X86_64_32 against
> >> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
> >> setbotf.f:(.text+0x1c): relocation truncated to fit: R_X86_64_32 against
> >> symbol `mpipriv2_' defined in COMMON section in comm_mpi.o
> >> setbotf.f:(.text+0x22): relocation truncated to fit: R_X86_64_32 against
> >> symbol `mpipriv2_' defined in COMMON section in comm_mpi.o
> >> setbotf.f:(.text+0x28): relocation truncated to fit: R_X86_64_32 against
> >> symbol `mpiprivc_' defined in COMMON section in comm_mpi.o
> >> setbotf.f:(.text+0x34): relocation truncated to fit: R_X86_64_32 against
> >> symbol `mpiprivc_' defined in COMMON section in comm_mpi.o
> >> make: *** [nek5000] Error 1
> >> 
> >> 
> >> 
> >> 
> >> -- 
> >> Frank Herbert Muldoon, Ph.D. Mechanical Engineering
> >> Technische Universität Wien (Technical University of Vienna)
> >> Inst. f. Strömungsmechanik und Wärmeübertragung (Institute of Fluid
> >> Mechanics and Heat Transfer)
> >> Resselgasse 3
> >> 1040 Wien
> >> Tel: +4315880132232
> >> Fax: +4315880132299 
> >> Cell:+436765203470
> >> fmuldoo (skype)
> >> http://tetra.fluid.tuwien.ac.at/fmuldoo/public_html/webpage/frank-muldoon.html
> >> 
> >> _______________________________________________
> >> Nek5000-users mailing list
> >> Nek5000-users at lists.mcs.anl.gov
> >> https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
> >> _______________________________________________ Nek5000-users mailing list Nek5000-users at lists.mcs.anl.gov https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
> > -- 
> > Frank Herbert Muldoon, Ph.D. Mechanical Engineering
> > Technische Universität Wien (Technical University of Vienna)
> > Inst. f. Strömungsmechanik und Wärmeübertragung (Institute of Fluid
> > Mechanics and Heat Transfer)
> > Resselgasse 3
> > 1040 Wien
> > Tel: +4315880132232
> > Fax: +4315880132299 
> > Cell:+436765203470
> > fmuldoo (skype)
> > http://tetra.fluid.tuwien.ac.at/fmuldoo/public_html/webpage/frank-muldoon.html
> > 
> > _______________________________________________
> > Nek5000-users mailing list
> > Nek5000-users at lists.mcs.anl.gov
> > https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
> 
> _______________________________________________
> Nek5000-users mailing list
> Nek5000-users at lists.mcs.anl.gov
> https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
-- 
Frank Herbert Muldoon, Ph.D. Mechanical Engineering
Technische Universität Wien (Technical University of Vienna)
Inst. f. Strömungsmechanik und Wärmeübertragung (Institute of Fluid
Mechanics and Heat Transfer)
Resselgasse 3
1040 Wien
Tel: +4315880132232
Fax: +4315880132299 
Cell:+436765203470
fmuldoo (skype)
http://tetra.fluid.tuwien.ac.at/fmuldoo/public_html/webpage/frank-muldoon.html