<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=iso-8859-1">
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:Arial;
color:windowtext;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:Arial;
color:navy;}
@page Section1
{size:595.3pt 841.9pt;
margin:70.85pt 70.85pt 56.7pt 70.85pt;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>bastian,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>The error for MPICH2 states that there is
a stack overflow. I suspect this is a problem with the way the fortran
application was compiled. I don’t remember the details off the top of my
head but I believe if you tell the compiler to increase the amount of global
memory so you can have a large static array for instance, then this also
affects the amount of memory available for the thread stacks. The only way to
resolve it is to use memory off the heap instead of large static variables and
not increase the global memory space.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>I may be way off my diagnosis. What
parameters to the compiler or #pragmas did you use to compile the application?<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>-David Ashton<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<div>
<div class=MsoNormal align=center style='margin-left:35.4pt;text-align:center'><font
size=3 face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<p class=MsoNormal style='margin-left:35.4pt'><b><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma;font-weight:bold'>From:</span></font></b><font
size=2 face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'>
owner-mpich-discuss@mcs.anl.gov [mailto:owner-mpich-discuss@mcs.anl.gov] <b><span
style='font-weight:bold'>On Behalf Of </span></b>Vogt, Bastian<br>
<b><span style='font-weight:bold'>Sent:</span></b> Monday, July 25, 2005 5:27
AM<br>
<b><span style='font-weight:bold'>To:</span></b> mpich-discuss@mcs.anl.gov<br>
<b><span style='font-weight:bold'>Subject:</span></b> [MPICH] mpich2 problem
with MCNP5</span></font><o:p></o:p></p>
</div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span style='font-size:12.0pt'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>Dear colleagues,<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>I try to do some core
calculations using the MPI parallel option of MCNP5. Therefore I have a input
file with about more or less 70.000 cells.<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>It is running without any
problems on my local machine using about 600MB of RAM. <o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>When I try to execute the
same Job with MPI on one our more machines I get the following error:<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>With mpich:<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>cp0 = 4.21<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>forrtl: severe (170):
Program Exception - stack overflow<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>Image PC
Routine Line Source <o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
005AAD1A Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
005A07DB Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
004DE9AF Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
004D2714 Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
005F7699 Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
005E9EBA Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>kernel32.dll
7C816D4F Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>Error 64, process 1, host
IKET127154:<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>
GetQueuedCompletionStatus failed for socket 0 connected to host
'141.52.127.137'<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>With mpich2:<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>cp0 = 4.23<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>forrtl: severe (170):
Program Exception - stack overflow Image PC
Routine Line Source <o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
005AAD1A Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
005A07DB Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
004DE9AF Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
004D2714 Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
005F7699 Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>MCNP5mpi.exe
005E9EBA Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>kernel32.dll
7C816D4F Unknown Unknown Unknown<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>I tried to run a smaller
job on the cluster and its working fine. So it should not be a problem with a
wrong configured MPI. All computers in the cluster have about 1GB of RAM, so it
should not be the RAM either. I don’t have any idea to overcome this
problem so I would be glad about some help!!<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'>Has anyone an idea to fix
this problem?<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=EN-GB style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt;line-height:200%'><font size=2
face=Arial><span lang=EN-GB style='font-size:10.0pt;line-height:200%;
font-family:Arial'>Thank you all in advance!!<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt;line-height:200%'><font size=2
face=Arial><span lang=DE style='font-size:10.0pt;line-height:200%;font-family:
Arial'>bastian<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>_______________________________________</span></font><span
lang=DE><o:p></o:p></span></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span lang=DE style='font-size:12.0pt'> <o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>Bastian Vogt</span></font><span
lang=DE><o:p></o:p></span></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span lang=DE style='font-size:12.0pt'> <o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>EnBW Kraftwerke AG </span></font><span
lang=DE><o:p></o:p></span></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span lang=DE style='font-size:12.0pt'> <o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>Institut für Kern- und
Energietechnik (IKET)<br>
Forschungszentrum Karlsruhe <br>
Telefon: +49-(0)7247-82-5047<br>
Fax.: +49-(0)7247-82-6323</span></font><span lang=DE><o:p></o:p></span></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>_______________________________________</span></font><span
lang=DE><o:p></o:p></span></p>
<div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span lang=DE style='font-size:12.0pt'> <o:p></o:p></span></font></p>
</div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>Bastian Vogt</span></font><span
lang=DE><o:p></o:p></span></p>
<div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span lang=DE style='font-size:12.0pt'> <o:p></o:p></span></font></p>
</div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>EnBW Kraftwerke AG </span></font><span
lang=DE><o:p></o:p></span></p>
<div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span lang=DE style='font-size:12.0pt'> <o:p></o:p></span></font></p>
</div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>Institut für Kern- und
Energietechnik (IKET)<br>
Forschungszentrum Karlsruhe <br>
Telefon: +49-(0)7247-82-5047<br>
Fax.: +49-(0)7247-82-6323</span></font><span lang=DE><o:p></o:p></span></p>
<div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span lang=DE style='font-size:12.0pt'> <o:p></o:p></span></font></p>
</div>
<p class=MsoNormal style='margin-left:35.4pt'><font size=2 face=Arial><span
lang=DE style='font-size:10.0pt;font-family:Arial'>mailto: <a
href="mailto:bastian.vogt@iket.fzk.de">bastian.vogt@iket.fzk.de</a></span></font><span
lang=DE><o:p></o:p></span></p>
<p class=MsoNormal style='margin-left:35.4pt'><font size=3
face="Times New Roman"><span lang=DE style='font-size:12.0pt'><o:p> </o:p></span></font></p>
</div>
</body>
</html>