[Nek5000-users] compilation, large memory

Fri Apr 23 07:47:34 CDT 2010

NELGT is the actual total number of elements where LELG is an upper limit for NELGT.
So if:

LELT >= int(LELG/NP) + 1

you're ok for sure!

btw: I think the wiki is open for everybody. Please try to improve it together with us!

hth,
Stefan

On Apr 23, 2010, at 2:46 PM, nek5000-users at lists.mcs.anl.gov wrote:

> Hi Stefan,
> 
> It is not clear what NELGT in the definition of LELT at this link is (it
> is not defined anywhere on the site).
> 
> Maximum number of local elements for T-mesh (>= int(NELGT/NP) + 1)
> 
> Cheers,
> Frank
> 
> 
> 
> 
> On Fri, 2010-04-23 at 14:36 +0200, nek5000-users at lists.mcs.anl.gov
> wrote:
>> Frank,
>> 
>> for lelt see here:
>> http://nek5000.mcs.anl.gov/index.php/SIZEu
>> 
>> Stefan
>> 
>> 
>> On Apr 23, 2010, at 2:36 PM, nek5000-users at lists.mcs.anl.gov wrote:
>> 
>>> On Fri, 2010-04-23 at 07:08 -0500, nek5000-users at lists.mcs.anl.gov
>>> wrote:
>>>> Hi Frank,
>>>> 
>>>> Are you running in parallel?   How many processors, and how
>>>> many elements in the problem of interest?
>>> 
>>> Hi Paul,
>>> 
>>> I am using 72 elements and 8 processors.  I reduced lelt to 72 and it
>>> works.  In general, should lelt=(# elements)/(# processors)?
>>> 
>>> Cheers,
>>> Frank
>>> 
>>>> 
>>>> If you have, say, 120 elements, and are running on 4 processors,
>>>> you can set lelt=30, which would reduce your per-processor-memory
>>>> footprint by a factor of 4.
>>>> 
>>>> Cheers,
>>>> 
>>>> Paul
>>>> 
>>>> 
>>>> On Fri, 23 Apr 2010, nek5000-users at lists.mcs.anl.gov wrote:
>>>> 
>>>>> Hello all,
>>>> 
>>>> I am having a problem compiling on an x86_64 system.  Smaller problems
>>>> work fine.  My SIZE file starts out with:
>>>> 
>>>>      parameter (ldim=3)
>>>>      parameter (lx1=6*4,ly1=lx1,lz1=lx1,lelt=120,lelv=lelt)
>>>>      parameter (lxd=9*4,lyd=lxd,lzd=lxd)
>>>> 
>>>> The error message is:
>>>> 
>>>> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/bin/mpif77 -mcmodel=medium
>>>> -shared-intel -c  -O2 -r8 -fpconstant -fpp -DMPI -DLONGINT8
>>>> -I/home/fmuldoo/programs/nek5000/nek5/trunk/nek
>>>> -I/data/fmuldoo/engineering-marangoni-flows/sim2/sim1/sim1/sim7/AR-.66-RE-1800-PR-04.0-dt-6.0e-5-time-006.0-grid-3-Intel /data/fmuldoo/engineering-marangoni-flows/sim2/sim1/sim1/sim7/AR-.66-RE-1800-PR-04.0-dt-6.0e-5-time-006.0-grid-3-Intel/delet.f -o delet.o 
>>>> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/bin/mpif77 -mcmodel=medium
>>>> -shared-intel -o nek5000  delet.o drive.o drive1.o drive2.o plan4.o
>>>> bdry.o coef.o conduct.o connect1.o connect2.o dssum.o edgec.o eigsolv.o
>>>> gauss.o genxyz.o navier1.o navier0.o navier2.o navier3.o navier4.o
>>>> prepost.o speclib.o map2.o turb.o mvmesh.o ic.o ssolv.o planx.o math.o
>>>> mxm_wrapper.o hmholtz.o gfdm_par.o  gfdm_op.o gfdm_solve.o subs1.o
>>>> subs2.o genbox.o gmres.o hsmg.o convect.o induct.o perturb.o navier5.o
>>>> navier6.o navier7.o navier8.o fast3d.o fasts.o calcz.o byte.o chelpers.o
>>>> byte_mpi.o postpro.o cvode_driver.o cvode_aux.o setprop.o qthermal.o
>>>> makeq.o papi.o ssygv.o dsygv.o mxm_std.o blas.o   comm_mpi.o jl2_gs.o
>>>> jl2_sort.o jl2_sarray_transfer.o jl2_sarray_sort.o jl2_gs_local.o
>>>> jl2_crystal.o jl2_comm.o jl2_tensor.o jl2_fail.o jl2_fcrystal.o
>>>> jl_tuple_list.o jl_transfer.o jl_sort.o jl_fcrystal.o jl_errmem.o
>>>> jl_crystal.o jl_findpts.o jl_pfindpt.o jl_tensor.o jl_findpt.o jl_poly.o
>>>> jl2_sparse_cholesky.o jl2_xxt.o jl2_fcrs.o 
>>>> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/lib/libmpich.a(setbotf.o):
>>>> In function `mpirinitf_':
>>>> setbotf.f:(.text+0xd): relocation truncated to fit: R_X86_64_32 against
>>>> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
>>>> setbotf.f:(.text+0x12): relocation truncated to fit: R_X86_64_32 against
>>>> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
>>>> setbotf.f:(.text+0x17): relocation truncated to fit: R_X86_64_32 against
>>>> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
>>>> setbotf.f:(.text+0x1c): relocation truncated to fit: R_X86_64_32 against
>>>> symbol `mpipriv2_' defined in COMMON section in comm_mpi.o
>>>> setbotf.f:(.text+0x22): relocation truncated to fit: R_X86_64_32 against
>>>> symbol `mpipriv2_' defined in COMMON section in comm_mpi.o
>>>> setbotf.f:(.text+0x28): relocation truncated to fit: R_X86_64_32 against
>>>> symbol `mpiprivc_' defined in COMMON section in comm_mpi.o
>>>> setbotf.f:(.text+0x34): relocation truncated to fit: R_X86_64_32 against
>>>> symbol `mpiprivc_' defined in COMMON section in comm_mpi.o
>>>> make: *** [nek5000] Error 1
>>>> 
>>>> 
>>>> 
>>>> 
>>>> -- 
>>>> Frank Herbert Muldoon, Ph.D. Mechanical Engineering
>>>> Technische Universität Wien (Technical University of Vienna)
>>>> Inst. f. Strömungsmechanik und Wärmeübertragung (Institute of Fluid
>>>> Mechanics and Heat Transfer)
>>>> Resselgasse 3
>>>> 1040 Wien
>>>> Tel: +4315880132232
>>>> Fax: +4315880132299 
>>>> Cell:+436765203470
>>>> fmuldoo (skype)
>>>> http://tetra.fluid.tuwien.ac.at/fmuldoo/public_html/webpage/frank-muldoon.html
>>>> 
>>>> _______________________________________________
>>>> Nek5000-users mailing list
>>>> Nek5000-users at lists.mcs.anl.gov
>>>> https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
>>>> _______________________________________________ Nek5000-users mailing list Nek5000-users at lists.mcs.anl.gov https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
>>> -- 
>>> Frank Herbert Muldoon, Ph.D. Mechanical Engineering
>>> Technische Universität Wien (Technical University of Vienna)
>>> Inst. f. Strömungsmechanik und Wärmeübertragung (Institute of Fluid
>>> Mechanics and Heat Transfer)
>>> Resselgasse 3
>>> 1040 Wien
>>> Tel: +4315880132232
>>> Fax: +4315880132299 
>>> Cell:+436765203470
>>> fmuldoo (skype)
>>> http://tetra.fluid.tuwien.ac.at/fmuldoo/public_html/webpage/frank-muldoon.html
>>> 
>>> _______________________________________________
>>> Nek5000-users mailing list
>>> Nek5000-users at lists.mcs.anl.gov
>>> https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
>> 
>> _______________________________________________
>> Nek5000-users mailing list
>> Nek5000-users at lists.mcs.anl.gov
>> https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
> -- 
> Frank Herbert Muldoon, Ph.D. Mechanical Engineering
> Technische Universität Wien (Technical University of Vienna)
> Inst. f. Strömungsmechanik und Wärmeübertragung (Institute of Fluid
> Mechanics and Heat Transfer)
> Resselgasse 3
> 1040 Wien
> Tel: +4315880132232
> Fax: +4315880132299 
> Cell:+436765203470
> fmuldoo (skype)
> http://tetra.fluid.tuwien.ac.at/fmuldoo/public_html/webpage/frank-muldoon.html
> 
> _______________________________________________
> Nek5000-users mailing list
> Nek5000-users at lists.mcs.anl.gov
> https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users