<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:p="urn:schemas-microsoft-com:office:powerpoint" xmlns:a="urn:schemas-microsoft-com:office:access" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:s="uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" xmlns:rs="urn:schemas-microsoft-com:rowset" xmlns:z="#RowsetSchema" xmlns:b="urn:schemas-microsoft-com:office:publisher" xmlns:ss="urn:schemas-microsoft-com:office:spreadsheet" xmlns:c="urn:schemas-microsoft-com:office:component:spreadsheet" xmlns:odc="urn:schemas-microsoft-com:office:odc" xmlns:oa="urn:schemas-microsoft-com:office:activation" xmlns:html="http://www.w3.org/TR/REC-html40" xmlns:q="http://schemas.xmlsoap.org/soap/envelope/" xmlns:rtc="http://microsoft.com/officenet/conferencing" xmlns:D="DAV:" xmlns:Repl="http://schemas.microsoft.com/repl/" xmlns:mt="http://schemas.microsoft.com/sharepoint/soap/meetings/" xmlns:x2="http://schemas.microsoft.com/office/excel/2003/xml" xmlns:ppda="http://www.passport.com/NameSpace.xsd" xmlns:ois="http://schemas.microsoft.com/sharepoint/soap/ois/" xmlns:dir="http://schemas.microsoft.com/sharepoint/soap/directory/" xmlns:ds="http://www.w3.org/2000/09/xmldsig#" xmlns:dsp="http://schemas.microsoft.com/sharepoint/dsp" xmlns:udc="http://schemas.microsoft.com/data/udc" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:sub="http://schemas.microsoft.com/sharepoint/soap/2002/1/alerts/" xmlns:ec="http://www.w3.org/2001/04/xmlenc#" xmlns:sp="http://schemas.microsoft.com/sharepoint/" xmlns:sps="http://schemas.microsoft.com/sharepoint/soap/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:udcs="http://schemas.microsoft.com/data/udc/soap" xmlns:udcxf="http://schemas.microsoft.com/data/udc/xmlfile" xmlns:udcp2p="http://schemas.microsoft.com/data/udc/parttopart" xmlns:wf="http://schemas.microsoft.com/sharepoint/soap/workflow/" xmlns:dsss="http://schemas.microsoft.com/office/2006/digsig-setup" xmlns:dssi="http://schemas.microsoft.com/office/2006/digsig" xmlns:mdssi="http://schemas.openxmlformats.org/package/2006/digital-signature" xmlns:mver="http://schemas.openxmlformats.org/markup-compatibility/2006" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns:mrels="http://schemas.openxmlformats.org/package/2006/relationships" xmlns:spwp="http://microsoft.com/sharepoint/webpartpages" xmlns:ex12t="http://schemas.microsoft.com/exchange/services/2006/types" xmlns:ex12m="http://schemas.microsoft.com/exchange/services/2006/messages" xmlns:pptsl="http://schemas.microsoft.com/sharepoint/soap/SlideLibrary/" xmlns:spsl="http://microsoft.com/webservices/SharePointPortalServer/PublishedLinksService" xmlns:Z="urn:schemas-microsoft-com:" xmlns:st="" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Courier New";}
.MsoChpDefault
{mso-style-type:export-only;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=Section1><pre>Hi Dave,<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>I had 1.2.1p1 built locally. So, I tried that. It also gave me same fatal error. I will try newer version, but I am less hopeful.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><pre>I am trying to use hydra (mpiexec.hydra) with 1.2.1.p1, but getting some startup errors:<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>The authenticity of host ‘XXX' can't be established.<o:p></o:p></pre><pre>RSA key fingerprint is ed:ce:ca:7b:08:b9:49:fd:f6:af:14.<o:p></o:p></pre><pre>Are you sure you want to continue connecting (yes/no)? <o:p></o:p></pre><pre>The authenticity of host ‘XXX2' can't be established.<o:p></o:p></pre><pre>RSA key fingerprint is fb:1b:7b:0c:bb:b1:a6:b1:7d:dc:05.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Any pointers how to resolve them?<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Regards,<o:p></o:p></pre><pre>Rohit<o:p></o:p></pre><pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><pre>============================<o:p></o:p></pre><pre><o:p> </o:p></pre><pre><o:p> </o:p></pre><pre>Use a newer version of MPICH2, 1.0.6 is too old. The current release is 1.3.2p1, I would recommend that instead.<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>Also, after upgrading, use hydra instead of MPD: <a
href="http://wiki.mcs.anl.gov/mpich2/index.php/Using_the_Hydra_Process_Manager">http://wiki.mcs.anl.gov/mpich2/index.php/Using_the_Hydra_Process_Manager</a><o:p></o:p></pre><pre><o:p> </o:p></pre><pre>-Dave<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>On Feb 15, 2011, at 4:44 PM CST, Jain, Rohit wrote:<o:p></o:p></pre><pre><o:p> </o:p></pre><pre>><i> Hi,<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> I am using MPICH2 version 2-1.06 to run a parallel application on multiple Linux machines using mpd ring.<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> I created the ring on 4 machines:<o:p></o:p></i></pre><pre>><i> mpdtrace -l<o:p></o:p></i></pre><pre>><i> mach1_55761<o:p></o:p></i></pre><pre>><i> mach2_46635<o:p></o:p></i></pre><pre>><i> mach3_34866<o:p></o:p></i></pre><pre>><i> mach4_37727<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> Then I ran the application using mpiexec:<o:p></o:p></i></pre><pre>><i> mpiexec -np 1 a.exec arg1: -np 1 a.exec arg2 : -np1 a.exec arg3 : -np 1 a.exec arg4<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> Application does start and runs for a while, then it crashes in MPI_Recv with following error:<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> Fatal error in MPI_Recv: Error message texts are not available<o:p></o:p></i></pre><pre>><i> rank 2 in job 1 mach1_55761 caused collective abort of all ranks<o:p></o:p></i></pre><pre>><i> exit status of rank 2: killed by signal 9<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> On re-run, it crashes with same error, but at a different time.<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> Same environment works fine, when run on multiple cores of single SMP machine, instead of mpd ring.<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> I tried totalview, but it also exits without any useful information.<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> How do I debug/cure this problem?<o:p></o:p></i></pre><pre>><i> <o:p></o:p></i></pre><pre>><i> Regards,<o:p></o:p></i></pre><pre>><i> Rohit<o:p></o:p></i></pre>
<p class=MsoNormal><o:p> </o:p></p>
</div>
</body>
</html>