<html><body><div style="color:#000; background-color:#fff; font-family:arial, helvetica, sans-serif;font-size:10pt"><div><span>I did a uname -a on the two nodes and one is 64 and the other is 32 bit. </span></div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span> </div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span>I guess I'll have to install and build mpich2 on the nodes separately, rather than have it on an nfs shared directory.</span></div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span> </div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal;
background-color: transparent;"><span>If anyone has a simpler solution please let me know.</span></div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span> </div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span>Thanks all.</span></div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span> </div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span>Martin.</span></div><div><br></div> <div style="font-family: arial, helvetica, sans-serif; font-size: 10pt;"> <div style="font-family: times new roman, new york, times, serif;
font-size: 12pt;"> <div dir="ltr"> <font size="2" face="Arial"> <div style="margin: 5px 0px; padding: 0px; border: 1px solid rgb(204, 204, 204); height: 0px; line-height: 0; font-size: 0px;" class="hr" contentEditable="false" readonly="true"></div> <b><span style="font-weight: bold;">From:</span></b> Dave Goodell <goodell@mcs.anl.gov><br> <b><span style="font-weight: bold;">To:</span></b> Martin Gilchrist <gilchrist.martin@yahoo.com>; mpich-discuss@mcs.anl.gov <br><b><span style="font-weight: bold;">Cc:</span></b> Pavan Balaji <balaji@mcs.anl.gov> <br> <b><span style="font-weight: bold;">Sent:</span></b> Friday, October 5, 2012 2:34 PM<br> <b><span style="font-weight: bold;">Subject:</span></b> Re: [mpich-discuss] hydra_pmi_proxy: No such file<br> </font> </div> <br>
What is the output of "uname -a" on each host?<br><br>-Dave<br><br>On Oct 5, 2012, at 4:04 PM CDT, Martin Gilchrist wrote:<br><br>> Hi Pavan.<br>> <br>> I've got some more information that might give some insight into what is happening on my system.<br>> <br>> When I do ldd ./cpi on the base node where nfs is installed and mpich was compiled I get some paths to libraries, but when I do it on the other node I get the message that ./cpi is not a dynamic executable.<br>> <br>> When I do mpicc ./child.c, an a.out is produced, when I do the same thing on the other node I get messages like:<br>> <br>> /usr/bin/ld: skipping incompatible /mirror/mpich2/lib/libmpich.a when searching for -lmpich.<br>> <br>> Also, a simple invocation of ./cpi on the main node works, but gives the error message: bash: ./cpi: No such file or directory when run on the other node.<br>> <br>> I have mpich
and the user mpiu installed on nfs. Could it be that the binaries compiled on one node are not compatible with the processor on the other node?<br>> <br>> Martin. <br>> <br>> From: Pavan Balaji <<a href="mailto:balaji@mcs.anl.gov" ymailto="mailto:balaji@mcs.anl.gov">balaji@mcs.anl.gov</a>><br>> To: Martin Gilchrist <<a href="mailto:gilchrist.martin@yahoo.com" ymailto="mailto:gilchrist.martin@yahoo.com">gilchrist.martin@yahoo.com</a>> <br>> Cc: <a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a> <br>> Sent: Wednesday, October 3, 2012 8:29 PM<br>> Subject: Re: [mpich-discuss] hydra_pmi_proxy: No such file<br>> <br>> <br>> This is weird. Can you run mpiexec with the -verbose option and send <br>> the output?<br>> <br>> -- Pavan<br>> <br>> On 10/03/2012 05:09 PM, Martin Gilchrist wrote:<br>> >
Yes.<br>> ><br>> > The first is the machine where nfs host machine and the second is the<br>> > other node.<br>> ><br>> ><br>> > mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ hostname<br>> > martinlaptop-HP-Pavilion-dm4-Notebook-PC<br>> > mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l<br>> > /mirror/mpich2/bin/mpiexec<br>> > lrwxrwxrwx 1 mpiu mpiu 13 2012-10-03 14:32 /mirror/mpich2/bin/mpiexec -><br>> > mpiexec.hydra<br>> > mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l<br>> > /mirror/mpich2/bin/mpiexec.hydra<br>> > -rwxr-xr-x 1 mpiu mpiu 1065207 2012-10-03 14:32<br>> > /mirror/mpich2/bin/mpiexec.hydra<br>> > mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l<br>> > /mirror/mpich2/bin/hydra_pmi_proxy<br>> > -rwxr-xr-x 1 mpiu mpiu 851803 2012-10-03 14:32<br>> > /mirror/mpich2/bin/hydra_pmi_proxy<br>> >
mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$<br>> ><br>> ><br>> ><br>> ><br>> > mpiu@martin-desktop:~$ ls -l /mirror/mpich2/bin/mpiexec<br>> > lrwxrwxrwx 1 mpiu mpiu 13 2012-10-03 14:32 /mirror/mpich2/bin/mpiexec -><br>> > mpiexec.hydra<br>> > mpiu@martin-desktop:~$ ls -lat /mirror/mpich2/bin/mpiexec.hydra<br>> > -rwxr-xr-x 1 mpiu mpiu 1065207 2012-10-03 14:32<br>> > /mirror/mpich2/bin/mpiexec.hydra<br>> > mpiu@martin-desktop:~$ ls -l /mirror/mpich2/bin/hydra_pmi_proxy<br>> > -rwxr-xr-x 1 mpiu mpiu 851803 2012-10-03 14:32<br>> > /mirror/mpich2/bin/hydra_pmi_proxy<br>> > mpiu@martin-desktop:~$<br>> ><br>> ><br>> > ------------------------------------------------------------------------<br>> > *From:* Pavan Balaji <<a href="mailto:balaji@mcs.anl.gov" ymailto="mailto:balaji@mcs.anl.gov">balaji@mcs.anl.gov</a>><br>> > *To:* Martin
Gilchrist <<a href="mailto:gilchrist.martin@yahoo.com" ymailto="mailto:gilchrist.martin@yahoo.com">gilchrist.martin@yahoo.com</a>><br>> > *Cc:* "<a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a>" <<a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a>><br>> > *Sent:* Wednesday, October 3, 2012 3:46 PM<br>> > *Subject:* Re: [mpich-discuss] hydra_pmi_proxy: No such file<br>> ><br>> > Hi Martin,<br>> ><br>> > Can you please stick to one configuration? It's hard for me to tell<br>> > when you are running in which configuration.<br>> ><br>> > Can you please run the following on each of the two machines:<br>> ><br>> > % hostname<br>> ><br>> > % ls -l /mirror/mpich2/bin/mpiexec<br>> ><br>> > % ls -l
/mirror/mpich2/bin/hydra_pmi_proxy<br>> ><br>> > -- Pavan<br>> ><br>> > On 10/03/2012 04:44 PM, Martin Gilchrist wrote:<br>> > > Yes the two are different.<br>> > > The one where the proxy is not found is produced when mpiexec is invoked<br>> > > on the main computer where I have installed nfs and done all the make<br>> > > and make install of mpich2. The one with the mpiexec not found is<br>> > > produced when mpiexec is invoked on the node.<br>> > > Martin.<br>> > ><br>> > > *From:* Pavan Balaji <<a href="mailto:balaji@mcs.anl.gov" ymailto="mailto:balaji@mcs.anl.gov">balaji@mcs.anl.gov</a> <mailto:<a href="mailto:balaji@mcs.anl.gov" ymailto="mailto:balaji@mcs.anl.gov">balaji@mcs.anl.gov</a>>><br>> > > *To:* Martin Gilchrist <<a
href="mailto:gilchrist.martin@yahoo.com" ymailto="mailto:gilchrist.martin@yahoo.com">gilchrist.martin@yahoo.com</a><br>> > <mailto:<a href="mailto:gilchrist.martin@yahoo.com" ymailto="mailto:gilchrist.martin@yahoo.com">gilchrist.martin@yahoo.com</a>>><br>> > > *Cc:* <a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a> <mailto:<a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a>>;<br>> > Anthony Chan <<a href="mailto:chan@mcs.anl.gov" ymailto="mailto:chan@mcs.anl.gov">chan@mcs.anl.gov</a> <mailto:<a href="mailto:chan@mcs.anl.gov" ymailto="mailto:chan@mcs.anl.gov">chan@mcs.anl.gov</a>>><br>> > > *Sent:* Tuesday, October 2, 2012 1:39 PM<br>> > > *Subject:* Re: [mpich-discuss] hydra_pmi_proxy: No such file<br>> > ><br>> >
><br>> > > On 10/02/2012 03:27 PM, Martin Gilchrist wrote:<br>> > > > I can ssh into the node and hydra_pmi_proxy is visible and executable.<br>> > > > And when I am logged into the node directly it is visible and<br>> > executable.<br>> > ><br>> > > Both those statement sound identical. Did you mean to add a "not"<br>> > > somewhere there?<br>> > ><br>> > > > One more thing, when I am directly logged into the node and do<br>> > > > mpiexec -n 2 -f machinefile ./cpi<br>> > > > I get the message:<br>> > > > bash:/mirror/mpich2/bin/mpiexec:No such file or directory.<br>> > > > It looks like it might be an issue with permissions since bash can't<br>> > > > find the executable,
but it is visible via which and has executable<br>> > > > permission under ls -lat.<br>> > ><br>> > > This is not an executable permission issue. It should say "Permission<br>> > > denied" for that, not "No such file or directory".<br>> > ><br>> > > Can you send me the following output?<br>> > ><br>> > > % ls -l /mirror/mpich2/bin/mpiexec<br>> > ><br>> > > % /mirror/mpich2/bin/mpiexec -n 2 -f machinefile ./cpi<br>> > ><br>> > > I'm having trouble believing that you can see the file, but are getting<br>> > > the following error, so I'd like to see that myself :-). Of course,<br>> > > it's always possible that it's some weird NFS-ness that I'm not aware of.<br>> > ><br>> > > -- Pavan<br>>
> ><br>> > > -- Pavan Balaji<br>> > > <a href="http://www.mcs.anl.gov/~balaji" target="_blank">http://www.mcs.anl.gov/~balaji</a><br>> > ><br>> > ><br>> ><br>> > --<br>> > Pavan Balaji<br>> > <a href="http://www.mcs.anl.gov/~balaji" target="_blank">http://www.mcs.anl.gov/~balaji</a> <<a href="http://www.mcs.anl.gov/~balaji" target="_blank">http://www.mcs.anl.gov/~balaji</a>><br>> ><br>> ><br>> <br>> -- <br>> Pavan Balaji<br>> <a href="http://www.mcs.anl.gov/~balaji" target="_blank">http://www.mcs.anl.gov/~balaji</a><br>> <br>> <br>> _______________________________________________<br>> mpich-discuss mailing list <a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a><br>> To manage subscription options or unsubscribe:<br>> <a
href="https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss" target="_blank">https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss</a><br><br><br><br> </div> </div> </div></body></html>