<div dir="ltr">I sent the logs, but they're awaiting moderator permission to be posted on the list.<br><br><div class="gmail_quote">On Tue, Oct 11, 2011 at 9:06 PM, Mani Chandra <span dir="ltr"><<a href="mailto:mc0710@gmail.com">mc0710@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div dir="ltr">Hi Stefan,<div><br></div><div>The problem starts to appear when I use 128 processors. It works with 64 processors.</div>
<div><br></div><div><font color="#888888">Mani<br><br></font><div class="gmail_quote"><div class="im">On Tue, Oct 11, 2011 at 7:06 PM, <span dir="ltr"><<a href="mailto:nek5000-users@lists.mcs.anl.gov" target="_blank">nek5000-users@lists.mcs.anl.gov</a>></span> wrote:<br>
</div><div><div></div><div class="h5"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Doesn't sound like a memory problem given 4GB of memory per core and a<br>
total static data size of ~350MB (according to the output of size).<br>
The size of the executable doesn't matter in this case.<br>
<br>
- Can you post your logfile again (for the case where the SEMG was disabled).<br>
- What's the lowest number of processors you can reproduce the problem<br>
(try with lx1=4)<br>
<br>
-Stefan<br>
<br>
On 10/11/11, <a href="mailto:nek5000-users@lists.mcs.anl.gov" target="_blank">nek5000-users@lists.mcs.anl.gov</a><br>
<div><div></div><div><<a href="mailto:nek5000-users@lists.mcs.anl.gov" target="_blank">nek5000-users@lists.mcs.anl.gov</a>> wrote:<br>
> Hi Stefan,<br>
><br>
> Each node has 64 GB of RAM. There are 16 cores in each node. Each core has<br>
> the 4096 KB of cache. The size of the executable 'nek5000' is 5.6 MB. I<br>
> tried running with p43=1 and it still gets stuck. The full specifications of<br>
> each core are given below:<br>
><br>
> vendor_id : GenuineIntel<br>
> cpu family : 6<br>
> model : 15<br>
> model name : Intel(R) Xeon(R) CPU X7350 @ 2.93GHz<br>
> stepping : 11<br>
> cpu MHz : <a href="tel:2933.445" value="+492933445" target="_blank">2933.445</a><br>
> cache size : 4096 KB<br>
> physical id : 6<br>
> siblings : 4<br>
> core id : 3<br>
> cpu cores : 4<br>
> fpu : yes<br>
> fpu_exception : yes<br>
> cpuid level : 10<br>
> wp : yes<br>
> flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca<br>
> cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall lm<br>
> constant_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr lahf_lm<br>
> bogomips : <a href="tel:5866.92" value="+49586692" target="_blank">5866.92</a><br>
> clflush size : 64<br>
> cache_alignment : 64<br>
> address sizes : 40 bits physical, 48 bits virtual<br>
><br>
> Thanks,<br>
> Mani<br>
><br>
><br>
> On Mon, Oct 10, 2011 at 11:56 PM, <<a href="mailto:nek5000-users@lists.mcs.anl.gov" target="_blank">nek5000-users@lists.mcs.anl.gov</a>> wrote:<br>
><br>
>> What's the memory size per core?<br>
>><br>
>> Sure p43=0 is correct if you want to use the multilevel Schwarz<br>
>> solver. Just as a cross check: set p43=1 and try again.<br>
>><br>
>> On 10/10/11, <a href="mailto:nek5000-users@lists.mcs.anl.gov" target="_blank">nek5000-users@lists.mcs.anl.gov</a><br>
>> <<a href="mailto:nek5000-users@lists.mcs.anl.gov" target="_blank">nek5000-users@lists.mcs.anl.gov</a>> wrote:<br>
>> > Hi Stefan,<br>
>> ><br>
>> > The following is the output of 'size nek5000'<br>
>> ><br>
>> > text data bss dec hex filename<br>
>> > <a href="tel:5163006" value="+495163006" target="_blank">5163006</a> 59896 <a href="tel:333337824" value="+49333337824" target="_blank">333337824</a> <a href="tel:338560726" value="+49338560726" target="_blank">338560726</a> 142e06d6 nek5000<br>
>> ><br>
>> ><br>
>> > In the .rea file, p43 has been set to 0.<br>
>> ><br>
>> > Mani<br>
>> ><br>
>> _______________________________________________<br>
>> Nek5000-users mailing list<br>
>> <a href="mailto:Nek5000-users@lists.mcs.anl.gov" target="_blank">Nek5000-users@lists.mcs.anl.gov</a><br>
>> <a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users" target="_blank">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a><br>
>><br>
><br>
_______________________________________________<br>
Nek5000-users mailing list<br>
<a href="mailto:Nek5000-users@lists.mcs.anl.gov" target="_blank">Nek5000-users@lists.mcs.anl.gov</a><br>
<a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users" target="_blank">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a><br>
</div></div></blockquote></div></div></div><br></div></div>
</blockquote></div><br></div>