[Nek5000-users] compilation, large memory

Fri Apr 23 07:36:28 CDT 2010

On Fri, 2010-04-23 at 07:08 -0500, nek5000-users at lists.mcs.anl.gov
wrote:
> Hi Frank,
> 
> Are you running in parallel?   How many processors, and how
> many elements in the problem of interest?

Hi Paul,

I am using 72 elements and 8 processors.  I reduced lelt to 72 and it
works.  In general, should lelt=(# elements)/(# processors)?

Cheers,
Frank

> 
> If you have, say, 120 elements, and are running on 4 processors,
> you can set lelt=30, which would reduce your per-processor-memory
> footprint by a factor of 4.
> 
> Cheers,
> 
> Paul
> 
> 
> On Fri, 23 Apr 2010, nek5000-users at lists.mcs.anl.gov wrote:
> 
> > Hello all,
> 
> I am having a problem compiling on an x86_64 system.  Smaller problems
> work fine.  My SIZE file starts out with:
> 
>        parameter (ldim=3)
>        parameter (lx1=6*4,ly1=lx1,lz1=lx1,lelt=120,lelv=lelt)
>        parameter (lxd=9*4,lyd=lxd,lzd=lxd)
> 
> The error message is:
> 
> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/bin/mpif77 -mcmodel=medium
> -shared-intel -c  -O2 -r8 -fpconstant -fpp -DMPI -DLONGINT8
> -I/home/fmuldoo/programs/nek5000/nek5/trunk/nek
> -I/data/fmuldoo/engineering-marangoni-flows/sim2/sim1/sim1/sim7/AR-.66-RE-1800-PR-04.0-dt-6.0e-5-time-006.0-grid-3-Intel /data/fmuldoo/engineering-marangoni-flows/sim2/sim1/sim1/sim7/AR-.66-RE-1800-PR-04.0-dt-6.0e-5-time-006.0-grid-3-Intel/delet.f -o delet.o 
> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/bin/mpif77 -mcmodel=medium
> -shared-intel -o nek5000  delet.o drive.o drive1.o drive2.o plan4.o
> bdry.o coef.o conduct.o connect1.o connect2.o dssum.o edgec.o eigsolv.o
> gauss.o genxyz.o navier1.o navier0.o navier2.o navier3.o navier4.o
> prepost.o speclib.o map2.o turb.o mvmesh.o ic.o ssolv.o planx.o math.o
> mxm_wrapper.o hmholtz.o gfdm_par.o  gfdm_op.o gfdm_solve.o subs1.o
> subs2.o genbox.o gmres.o hsmg.o convect.o induct.o perturb.o navier5.o
> navier6.o navier7.o navier8.o fast3d.o fasts.o calcz.o byte.o chelpers.o
> byte_mpi.o postpro.o cvode_driver.o cvode_aux.o setprop.o qthermal.o
> makeq.o papi.o ssygv.o dsygv.o mxm_std.o blas.o   comm_mpi.o jl2_gs.o
> jl2_sort.o jl2_sarray_transfer.o jl2_sarray_sort.o jl2_gs_local.o
> jl2_crystal.o jl2_comm.o jl2_tensor.o jl2_fail.o jl2_fcrystal.o
> jl_tuple_list.o jl_transfer.o jl_sort.o jl_fcrystal.o jl_errmem.o
> jl_crystal.o jl_findpts.o jl_pfindpt.o jl_tensor.o jl_findpt.o jl_poly.o
> jl2_sparse_cholesky.o jl2_xxt.o jl2_fcrs.o 
> /home/fmuldoo/programs/mpich2-1.2.1p1-intel/lib/libmpich.a(setbotf.o):
> In function `mpirinitf_':
> setbotf.f:(.text+0xd): relocation truncated to fit: R_X86_64_32 against
> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
> setbotf.f:(.text+0x12): relocation truncated to fit: R_X86_64_32 against
> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
> setbotf.f:(.text+0x17): relocation truncated to fit: R_X86_64_32 against
> symbol `mpipriv1_' defined in COMMON section in comm_mpi.o
> setbotf.f:(.text+0x1c): relocation truncated to fit: R_X86_64_32 against
> symbol `mpipriv2_' defined in COMMON section in comm_mpi.o
> setbotf.f:(.text+0x22): relocation truncated to fit: R_X86_64_32 against
> symbol `mpipriv2_' defined in COMMON section in comm_mpi.o
> setbotf.f:(.text+0x28): relocation truncated to fit: R_X86_64_32 against
> symbol `mpiprivc_' defined in COMMON section in comm_mpi.o
> setbotf.f:(.text+0x34): relocation truncated to fit: R_X86_64_32 against
> symbol `mpiprivc_' defined in COMMON section in comm_mpi.o
> make: *** [nek5000] Error 1
> 
> 
> 
> 
> -- 
> Frank Herbert Muldoon, Ph.D. Mechanical Engineering
> Technische Universität Wien (Technical University of Vienna)
> Inst. f. Strömungsmechanik und Wärmeübertragung (Institute of Fluid
> Mechanics and Heat Transfer)
> Resselgasse 3
> 1040 Wien
> Tel: +4315880132232
> Fax: +4315880132299 
> Cell:+436765203470
> fmuldoo (skype)
> http://tetra.fluid.tuwien.ac.at/fmuldoo/public_html/webpage/frank-muldoon.html
> 
> _______________________________________________
> Nek5000-users mailing list
> Nek5000-users at lists.mcs.anl.gov
> https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
> _______________________________________________ Nek5000-users mailing list Nek5000-users at lists.mcs.anl.gov https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users
-- 
Frank Herbert Muldoon, Ph.D. Mechanical Engineering
Technische Universität Wien (Technical University of Vienna)
Inst. f. Strömungsmechanik und Wärmeübertragung (Institute of Fluid
Mechanics and Heat Transfer)
Resselgasse 3
1040 Wien
Tel: +4315880132232
Fax: +4315880132299 
Cell:+436765203470
fmuldoo (skype)
http://tetra.fluid.tuwien.ac.at/fmuldoo/public_html/webpage/frank-muldoon.html