<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns="http://www.w3.org/TR/REC-html40" xmlns:v =
"urn:schemas-microsoft-com:vml" xmlns:o =
"urn:schemas-microsoft-com:office:office" xmlns:w =
"urn:schemas-microsoft-com:office:word" xmlns:m =
"http://schemas.microsoft.com/office/2004/12/omml"><HEAD><TITLE>RE: [mpich-discuss] mpich2 and IPoIB</TITLE>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.6000.16735" name=GENERATOR>
<STYLE>@font-face {
font-family: Cambria Math;
}
@font-face {
font-family: Calibri;
}
@font-face {
font-family: Tahoma;
}
@page Section1 {size: 612.0pt 792.0pt; margin: 70.85pt 3.0cm 70.85pt 3.0cm; }
P.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman","serif"
}
LI.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman","serif"
}
DIV.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman","serif"
}
A:link {
COLOR: blue; TEXT-DECORATION: underline; mso-style-priority: 99
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline; mso-style-priority: 99
}
A:visited {
COLOR: purple; TEXT-DECORATION: underline; mso-style-priority: 99
}
SPAN.MsoHyperlinkFollowed {
COLOR: purple; TEXT-DECORATION: underline; mso-style-priority: 99
}
P {
FONT-SIZE: 12pt; MARGIN-LEFT: 0cm; MARGIN-RIGHT: 0cm; FONT-FAMILY: "Times New Roman","serif"; mso-style-priority: 99; mso-margin-top-alt: auto; mso-margin-bottom-alt: auto
}
SPAN.EstiloDeEmail18 {
COLOR: #1f497d; FONT-FAMILY: "Calibri","sans-serif"; mso-style-type: personal-reply
}
.MsoChpDefault {
FONT-SIZE: 10pt; mso-style-type: export-only
}
DIV.Section1 {
page: Section1
}
</STYLE>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></HEAD>
<BODY lang=PT-BR vLink=purple link=blue>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=339334818-31102008>Hi,</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=339334818-31102008> Good to know it worked for you. Let us know if
you have any further problems.</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=339334818-31102008></SPAN></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=339334818-31102008>Regards,</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=339334818-31102008>Jayesh</SPAN></FONT></DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Fabio Motezuki
[mailto:kenji_japanese@ig.com.br] <BR><B>Sent:</B> Friday, October 31, 2008 1:12
PM<BR><B>To:</B> 'Jayesh Krishna'<BR><B>Cc:</B>
mpich-discuss@mcs.anl.gov<BR><B>Subject:</B> RE: [mpich-discuss] mpich2 and
IPoIB<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV class=Section1>
<P class=MsoNormal><SPAN
style="FONT-SIZE: 11pt; COLOR: #1f497d; FONT-FAMILY: 'Calibri','sans-serif'">Hi,<o:p></o:p></SPAN></P>
<P class=MsoNormal><SPAN
style="FONT-SIZE: 11pt; COLOR: #1f497d; FONT-FAMILY: 'Calibri','sans-serif'"><o:p> </o:p></SPAN></P>
<P class=MsoNormal><SPAN lang=EN-US
style="FONT-SIZE: 11pt; COLOR: #1f497d; FONT-FAMILY: 'Calibri','sans-serif'">We
got something here, now the communications goes through infiniband. The
machinefile for smpd is a bit different from the mpd.<o:p></o:p></SPAN></P>
<P class=MsoNormal><SPAN lang=EN-US
style="FONT-SIZE: 11pt; COLOR: #1f497d; FONT-FAMILY: 'Calibri','sans-serif'">Also
tested the machinefile with 1.0.7 and works too.<o:p></o:p></SPAN></P>
<P class=MsoNormal><SPAN lang=EN-US
style="FONT-SIZE: 11pt; COLOR: #1f497d; FONT-FAMILY: 'Calibri','sans-serif'"><o:p> </o:p></SPAN></P>
<P class=MsoNormal><SPAN lang=EN-US
style="FONT-SIZE: 11pt; COLOR: #1f497d; FONT-FAMILY: 'Calibri','sans-serif'">Fabio<o:p></o:p></SPAN></P>
<P class=MsoNormal><SPAN lang=EN-US
style="FONT-SIZE: 11pt; COLOR: #1f497d; FONT-FAMILY: 'Calibri','sans-serif'"><o:p> </o:p></SPAN></P>
<P class=MsoNormal><SPAN lang=EN-US
style="FONT-SIZE: 11pt; COLOR: #1f497d; FONT-FAMILY: 'Calibri','sans-serif'"><o:p> </o:p></SPAN></P>
<DIV
style="BORDER-RIGHT: medium none; PADDING-RIGHT: 0cm; BORDER-TOP: medium none; PADDING-LEFT: 4pt; PADDING-BOTTOM: 0cm; BORDER-LEFT: blue 1.5pt solid; PADDING-TOP: 0cm; BORDER-BOTTOM: medium none">
<DIV>
<DIV
style="BORDER-RIGHT: medium none; PADDING-RIGHT: 0cm; BORDER-TOP: #b5c4df 1pt solid; PADDING-LEFT: 0cm; PADDING-BOTTOM: 0cm; BORDER-LEFT: medium none; PADDING-TOP: 3pt; BORDER-BOTTOM: medium none">
<P class=MsoNormal><B><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Tahoma','sans-serif'">From:</SPAN></B><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Tahoma','sans-serif'"> Jayesh Krishna
[mailto:jayesh@mcs.anl.gov] <BR><B>Sent:</B> Friday, October 31, 2008 2:03
PM<BR><B>To:</B> 'Fabio Kenji'<BR><B>Cc:</B>
mpich-discuss@mcs.anl.gov<BR><B>Subject:</B> RE: [mpich-discuss] mpich2 and
IPoIB<o:p></o:p></SPAN></P></DIV></DIV>
<P class=MsoNormal><o:p> </o:p></P>
<P><SPAN style="FONT-SIZE: 10pt"> Hi,<BR> Can you try specifying
hostnames and interface ipaddresses in your machinefile (also see the difference
in the way interface ipaddr is specified)
?<BR><BR>==========================================<BR>Hostname_of_10_2_5_10
-ifhn 10.2.10.10<BR>Hostname_of_10_2_5_11 -ifhn
10.2.10.11<BR>==========================================<BR><BR>Regards,<BR>Jayesh<BR><BR>-----Original
Message-----<BR>From: Fabio Kenji [<A
href="mailto:kenji_japanese@ig.com.br">mailto:kenji_japanese@ig.com.br</A>]<BR>Sent:
Friday, October 31, 2008 6:39 AM<BR>To: Jayesh Krishna<BR>Cc:
mpich-discuss@mcs.anl.gov<BR>Subject: Re: [mpich-discuss] mpich2 and
IPoIB<BR><BR>Hi,<BR><BR>Compiled the 1.0.8 with the following
options:<BR>./configure --enable-cxx --with-pm=smpd --prefix=<path> make
&& make install<BR><BR>to started the smpd using<BR><path>smpd
-s<BR><BR>to launch the program I'm using<BR><path>mpiexec -n 4
-machinefile mf <program><BR><BR>the mf file contains:<BR>10.2.5.10
ifhn=10.2.10.10<BR>10.2.5.11 ifhn=10.2.10.11<BR><BR>where 10.2.5.xx is ethernet
and 10.2.10.xx is infiniband<BR><BR>and the communications are going through
ethernet<BR><BR>Fabio<BR><BR>2008/10/30, Jayesh Krishna
<jayesh@mcs.anl.gov>:<BR>><BR>><BR>><BR>>
Hi,<BR>> Can you try the latest stable release (1.0.8) of
MPICH2 ?<BR>> I just tried entering a non-existant
ipaddress in the machinefile using the "-ifhn" option and my program failed
(expected failure). A quick look of the smpd debug output shows that smpd is
setting the right (as per the "-ifhn" args) environment before launching the
process.<BR>> Please let us know if MPICH2 1.0.8 + smpd +
"-ifhn" option does not work for you.<BR>><BR>>
Regards,<BR>> Jayesh<BR>><BR>> -----Original
Message-----<BR>> From: Fabio Motezuki [<A
href="mailto:kenji_japanese@ig.com.br">mailto:kenji_japanese@ig.com.br</A>]<BR>>
Sent: Wednesday, October 29, 2008 8:36 PM<BR>> To: Jayesh
Krishna<BR>> Cc: mpich-discuss@mcs.anl.gov<BR>> Subject: Re:
[mpich-discuss] mpich2 and IPoIB<BR>><BR>> Returning, I compiled de
1.0.8rc1 source and using mpd the ifhn in the mpd.hosts file worked well, but
not with interface name resolution, just using ip
directly.<BR>><BR>> In 1.0.7 I tried to use ifhn in the machinefile
for smpd execution, but no effect even when using the ip address of the
infiniband interface.<BR>><BR>><BR>>
Fabio<BR>><BR>><BR>><BR>> Jayesh Krishna
escreveu:<BR>><BR>> ><BR>> > Hi,<BR>>
> Yes, you can use the "-ifhn" option in the machinefile with
smpd.<BR>> > Let us know if you have any
problems.<BR>> ><BR>> > Regards,<BR>> >
Jayesh<BR>> ><BR>> > -----Original
Message-----<BR>> > From: owner-mpich-discuss@mcs.anl.gov
><BR>> [<A
href="mailto:owner-mpich-discuss@mcs.anl.gov">mailto:owner-mpich-discuss@mcs.anl.gov</A>]
On Behalf Of Rajeev Thakur ><BR>> Sent: Monday, October 27, 2008
2:22 PM > To:<BR>> mpich-discuss@mcs.anl.gov > Subject: RE:
[mpich-discuss] mpich2 and<BR>> IPoIB > > Probably :-).
>From doing a grep in the smpd directory it<BR>> looks like it >
might accept "-ifhn hostname"<BR>> ><BR>> >
Rajeev<BR>> ><BR>> > > -----Original
Message-----<BR>> > > From: owner-mpich-discuss@mcs.anl.gov
> ><BR>> [<A
href="mailto:owner-mpich-discuss@mcs.anl.gov">mailto:owner-mpich-discuss@mcs.anl.gov</A>]
On Behalf Of Fabio Motezuki <BR>> > > Sent: Monday, October 27,
2008 2:12 PM > > To:<BR>> mpich-discuss@mcs.anl.gov >
> Subject: Re: [mpich-discuss] mpich2 and<BR>> IPoIB > >
> > Thanks Rajeev, > > > > I'll try it, perhaps is
there<BR>> any options like this for smpd?<BR>> >
><BR>> > > Fabio<BR>> > ><BR>> >
><BR>> > > Rajeev Thakur escreveu:<BR>> > >
> Try specifying the interface name using ifhn= in the >
><BR>> mpd.hosts file as > > > described in Sec 5.1.5 of
the installation<BR>> guide.<BR>> > > ><BR>> >
> <A
href="http://www.mcs.anl.gov/research/projects/mpich2/documentation/">http://www.mcs.anl.gov/research/projects/mpich2/documentation/</A><BR>>
> > files/mpich2-1<BR>> > > >
.0.8-installguide.pdf<BR>> > > ><BR>> > > >
Rajeev<BR>> > > ><BR>> > > ><BR>>
> > >> -----Original Message-----<BR>> > > >>
From: owner-mpich-discuss@mcs.anl.gov > > >><BR>> [<A
href="mailto:owner-mpich-discuss@mcs.anl.gov">mailto:owner-mpich-discuss@mcs.anl.gov</A>]
On Behalf Of > > Fabio<BR>> Motezuki > > >>
Sent: Monday, October 27, 2008 5:35 AM > > >> To:<BR>>
mpich-discuss@mcs.anl.gov > > >> Subject: [mpich-discuss]
mpich2 and<BR>> IPoIB > > >> > > >> Hi
all, > > >> > > >> I'm working on a
cluster<BR>> where each node is connected with two > > >>
networks:<BR>> > > >><BR>> > > >> eth0
- gigabit ethernet<BR>> > > >> ib0 - IP over
infiniband<BR>> > > >><BR>> > > >> I
would like to use the ib0 net for all mpi communications,<BR>> but >
> >> when I start the example cpi all comunications go through<BR>>
eth0 is > > this the > > >> expected
behavior?<BR>> > > >><BR>> > > >> I'm
launching the example program with "mpiexec > ><BR>> -machinefile
mf -n 16 > > >> ./cpi" where the file "mf" contains
the<BR>> ip address of infiniband > > >>
cards.<BR>> > > >><BR>> > > >>
Fabio<BR>> > > >><BR>> > >
>><BR>> > > >><BR>> > >
><BR>> > > ><BR>> > > ><BR>>
> ><BR>> > ><BR>>
><BR>></SPAN><o:p></o:p></P></DIV></DIV></BODY></HTML>