<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<META NAME="Generator" CONTENT="MS Exchange Server version 6.5.7036.0">
<TITLE>RE: [mpich-discuss] mpich2 and IPoIB</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/plain format -->
<P><FONT SIZE=2> Hi,<BR>
Can you try specifying hostnames and interface ipaddresses in your machinefile (also see the difference in the way interface ipaddr is specified) ?<BR>
<BR>
==========================================<BR>
Hostname_of_10_2_5_10 -ifhn 10.2.10.10<BR>
Hostname_of_10_2_5_11 -ifhn 10.2.10.11<BR>
==========================================<BR>
<BR>
Regards,<BR>
Jayesh<BR>
<BR>
-----Original Message-----<BR>
From: Fabio Kenji [<A HREF="mailto:kenji_japanese@ig.com.br">mailto:kenji_japanese@ig.com.br</A>]<BR>
Sent: Friday, October 31, 2008 6:39 AM<BR>
To: Jayesh Krishna<BR>
Cc: mpich-discuss@mcs.anl.gov<BR>
Subject: Re: [mpich-discuss] mpich2 and IPoIB<BR>
<BR>
Hi,<BR>
<BR>
Compiled the 1.0.8 with the following options:<BR>
./configure --enable-cxx --with-pm=smpd --prefix=<path> make && make install<BR>
<BR>
to started the smpd using<BR>
<path>smpd -s<BR>
<BR>
to launch the program I'm using<BR>
<path>mpiexec -n 4 -machinefile mf <program><BR>
<BR>
the mf file contains:<BR>
10.2.5.10 ifhn=10.2.10.10<BR>
10.2.5.11 ifhn=10.2.10.11<BR>
<BR>
where 10.2.5.xx is ethernet and 10.2.10.xx is infiniband<BR>
<BR>
and the communications are going through ethernet<BR>
<BR>
Fabio<BR>
<BR>
2008/10/30, Jayesh Krishna <jayesh@mcs.anl.gov>:<BR>
><BR>
><BR>
><BR>
> Hi,<BR>
> Can you try the latest stable release (1.0.8) of MPICH2 ?<BR>
> I just tried entering a non-existant ipaddress in the machinefile using the "-ifhn" option and my program failed (expected failure). A quick look of the smpd debug output shows that smpd is setting the right (as per the "-ifhn" args) environment before launching the process.<BR>
> Please let us know if MPICH2 1.0.8 + smpd + "-ifhn" option does not work for you.<BR>
><BR>
> Regards,<BR>
> Jayesh<BR>
><BR>
> -----Original Message-----<BR>
> From: Fabio Motezuki [<A HREF="mailto:kenji_japanese@ig.com.br">mailto:kenji_japanese@ig.com.br</A>]<BR>
> Sent: Wednesday, October 29, 2008 8:36 PM<BR>
> To: Jayesh Krishna<BR>
> Cc: mpich-discuss@mcs.anl.gov<BR>
> Subject: Re: [mpich-discuss] mpich2 and IPoIB<BR>
><BR>
> Returning, I compiled de 1.0.8rc1 source and using mpd the ifhn in the mpd.hosts file worked well, but not with interface name resolution, just using ip directly.<BR>
><BR>
> In 1.0.7 I tried to use ifhn in the machinefile for smpd execution, but no effect even when using the ip address of the infiniband interface.<BR>
><BR>
><BR>
> Fabio<BR>
><BR>
><BR>
><BR>
> Jayesh Krishna escreveu:<BR>
><BR>
> ><BR>
> > Hi,<BR>
> > Yes, you can use the "-ifhn" option in the machinefile with smpd.<BR>
> > Let us know if you have any problems.<BR>
> ><BR>
> > Regards,<BR>
> > Jayesh<BR>
> ><BR>
> > -----Original Message-----<BR>
> > From: owner-mpich-discuss@mcs.anl.gov ><BR>
> [<A HREF="mailto:owner-mpich-discuss@mcs.anl.gov">mailto:owner-mpich-discuss@mcs.anl.gov</A>] On Behalf Of Rajeev Thakur ><BR>
> Sent: Monday, October 27, 2008 2:22 PM > To:<BR>
> mpich-discuss@mcs.anl.gov > Subject: RE: [mpich-discuss] mpich2 and<BR>
> IPoIB > > Probably :-). From doing a grep in the smpd directory it<BR>
> looks like it > might accept "-ifhn hostname"<BR>
> ><BR>
> > Rajeev<BR>
> ><BR>
> > > -----Original Message-----<BR>
> > > From: owner-mpich-discuss@mcs.anl.gov > ><BR>
> [<A HREF="mailto:owner-mpich-discuss@mcs.anl.gov">mailto:owner-mpich-discuss@mcs.anl.gov</A>] On Behalf Of Fabio Motezuki <BR>
> > > Sent: Monday, October 27, 2008 2:12 PM > > To:<BR>
> mpich-discuss@mcs.anl.gov > > Subject: Re: [mpich-discuss] mpich2 and<BR>
> IPoIB > > > > Thanks Rajeev, > > > > I'll try it, perhaps is there<BR>
> any options like this for smpd?<BR>
> > ><BR>
> > > Fabio<BR>
> > ><BR>
> > ><BR>
> > > Rajeev Thakur escreveu:<BR>
> > > > Try specifying the interface name using ifhn= in the > ><BR>
> mpd.hosts file as > > > described in Sec 5.1.5 of the installation<BR>
> guide.<BR>
> > > ><BR>
> > > <A HREF="http://www.mcs.anl.gov/research/projects/mpich2/documentation/">http://www.mcs.anl.gov/research/projects/mpich2/documentation/</A><BR>
> > > files/mpich2-1<BR>
> > > > .0.8-installguide.pdf<BR>
> > > ><BR>
> > > > Rajeev<BR>
> > > ><BR>
> > > ><BR>
> > > >> -----Original Message-----<BR>
> > > >> From: owner-mpich-discuss@mcs.anl.gov > > >><BR>
> [<A HREF="mailto:owner-mpich-discuss@mcs.anl.gov">mailto:owner-mpich-discuss@mcs.anl.gov</A>] On Behalf Of > > Fabio<BR>
> Motezuki > > >> Sent: Monday, October 27, 2008 5:35 AM > > >> To:<BR>
> mpich-discuss@mcs.anl.gov > > >> Subject: [mpich-discuss] mpich2 and<BR>
> IPoIB > > >> > > >> Hi all, > > >> > > >> I'm working on a cluster<BR>
> where each node is connected with two > > >> networks:<BR>
> > > >><BR>
> > > >> eth0 - gigabit ethernet<BR>
> > > >> ib0 - IP over infiniband<BR>
> > > >><BR>
> > > >> I would like to use the ib0 net for all mpi communications,<BR>
> but > > >> when I start the example cpi all comunications go through<BR>
> eth0 is > > this the > > >> expected behavior?<BR>
> > > >><BR>
> > > >> I'm launching the example program with "mpiexec > ><BR>
> -machinefile mf -n 16 > > >> ./cpi" where the file "mf" contains the<BR>
> ip address of infiniband > > >> cards.<BR>
> > > >><BR>
> > > >> Fabio<BR>
> > > >><BR>
> > > >><BR>
> > > >><BR>
> > > ><BR>
> > > ><BR>
> > > ><BR>
> > ><BR>
> > ><BR>
> ><BR>
><BR>
</FONT>
</P>
</BODY>
</HTML>