<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hi,<div><br><div><div>Am 05.10.2012 um 23:04 schrieb Martin Gilchrist:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div><div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255); font-family: arial, helvetica, sans-serif; font-size: 10pt; position: static; z-index: auto; "><div>I've got some more information that might give some insight into what is happening on my system.</div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span> </div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span>When I do l</span><span>dd ./cpi on the base node where
nfs is installed and mpich was compiled I get some paths to libraries, but when I do it on the other node I get the message that ./cpi is not a dynamic executable.</span></div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span></div></div></div></blockquote><div><br></div><div>`ldd` is a script which tries to execute the application given as argument with a set variable LD_TRACE_LOADED_OBJECTS. The error you mentioned is output under various circumstances.</div><div><br></div><div>You can use `readelf -hld cpi` directly to get more information about the file, it should output too what you found already: whether it was built for 32 or 64 bit - or even a different CPU typ.</div><div><br></div><div><br></div><blockquote type="cite"><div><div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255); font-family: arial, helvetica, sans-serif; font-size: 10pt; position: static; z-index: auto; "><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span>When I do mpicc ./child.c, an a.out is produced, when I do the same thing on the other node I get messages like:</span></div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span> </div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color:
transparent;"><span>/usr/bin/ld: skipping incompatible /mirror/mpich2/lib/libmpich.a when searching for -lmpich.</span></div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span> </div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span>Also, a simple invocation of ./cpi on the main node works, but gives the error message: bash: ./cpi: No such file or directory when run on the other node.</span></div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span></div></div></div></blockquote><div><br></div><div><div>BTW: It would also output this if the application was built on a system where it uses the LSB loader (program header section like [Requesting program interpreter: /lib64/ld-linux-x86-64.so.2] or [Requesting program interpreter: /lib64/ld-lsb-x86-64.so.3]).</div><div><br></div><div>-- Reuti</div></div><div><br></div><br><blockquote type="cite"><div><div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255); font-family: arial, helvetica, sans-serif; font-size: 10pt; position: static; z-index: auto; "><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;">I have mpich and the
user mpiu installed on nfs. Could it be that the binaries compiled on one node are not compatible with the processor on the other node?</div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span></span> </div><div style="color: rgb(0, 0, 0); font-family: arial, helvetica, sans-serif; font-size: 13.33px; font-style: normal; background-color: transparent;"><span>Martin. </span></div><div><br></div> <div style="font-family: arial, helvetica, sans-serif; font-size: 10pt;"> <div style="font-family: times new roman, new york, times, serif; font-size: 12pt;"> <div dir="ltr"> <font size="2" face="Arial"> <div style="margin: 5px 0px; padding: 0px; border: 1px solid rgb(204, 204, 204); height: 0px; line-height: 0; font-size: 0px;" class="hr" contenteditable="false" readonly="true"></div> <b><span style="font-weight:
bold;">From:</span></b> Pavan Balaji <<a href="mailto:balaji@mcs.anl.gov">balaji@mcs.anl.gov</a>><br> <b><span style="font-weight: bold;">To:</span></b> Martin Gilchrist <<a href="mailto:gilchrist.martin@yahoo.com">gilchrist.martin@yahoo.com</a>> <br><b><span style="font-weight: bold;">Cc:</span></b> <a href="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a> <br> <b><span style="font-weight: bold;">Sent:</span></b> Wednesday, October 3, 2012 8:29 PM<br> <b><span style="font-weight: bold;">Subject:</span></b> Re: [mpich-discuss] hydra_pmi_proxy: No such file<br> </font> </div> <br>
<br>This is weird. Can you run mpiexec with the -verbose option and send <br>the output?<br><br> -- Pavan<br><br>On 10/03/2012 05:09 PM, Martin Gilchrist wrote:<br>> Yes.<br>><br>> The first is the machine where nfs host machine and the second is the<br>> other node.<br>><br>><br>> mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ hostname<br>> martinlaptop-HP-Pavilion-dm4-Notebook-PC<br>> mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l<br>> /mirror/mpich2/bin/mpiexec<br>> lrwxrwxrwx 1 mpiu mpiu 13 2012-10-03 14:32 /mirror/mpich2/bin/mpiexec -><br>> mpiexec.hydra<br>> mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l<br>> /mirror/mpich2/bin/mpiexec.hydra<br>> -rwxr-xr-x 1 mpiu mpiu 1065207 2012-10-03 14:32<br>> /mirror/mpich2/bin/mpiexec.hydra<br>> mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l<br>> /mirror/mpich2/bin/hydra_pmi_proxy<br>> -rwxr-xr-x 1 mpiu mpiu
851803 2012-10-03 14:32<br>> /mirror/mpich2/bin/hydra_pmi_proxy<br>> mpiu@martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$<br>><br>><br>><br>><br>> mpiu@martin-desktop:~$ ls -l /mirror/mpich2/bin/mpiexec<br>> lrwxrwxrwx 1 mpiu mpiu 13 2012-10-03 14:32 /mirror/mpich2/bin/mpiexec -><br>> mpiexec.hydra<br>> mpiu@martin-desktop:~$ ls -lat /mirror/mpich2/bin/mpiexec.hydra<br>> -rwxr-xr-x 1 mpiu mpiu 1065207 2012-10-03 14:32<br>> /mirror/mpich2/bin/mpiexec.hydra<br>> mpiu@martin-desktop:~$ ls -l /mirror/mpich2/bin/hydra_pmi_proxy<br>> -rwxr-xr-x 1 mpiu mpiu 851803 2012-10-03 14:32<br>> /mirror/mpich2/bin/hydra_pmi_proxy<br>> mpiu@martin-desktop:~$<br>><br>><br>> ------------------------------------------------------------------------<br>> *From:* Pavan Balaji <<a href="mailto:balaji@mcs.anl.gov" ymailto="mailto:balaji@mcs.anl.gov">balaji@mcs.anl.gov</a>><br>> *To:* Martin Gilchrist <<a href="mailto:gilchrist.martin@yahoo.com" ymailto="mailto:gilchrist.martin@yahoo.com">gilchrist.martin@yahoo.com</a>><br>> *Cc:* "<a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a>" <<a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a>><br>> *Sent:* Wednesday, October 3, 2012 3:46 PM<br>> *Subject:* Re: [mpich-discuss] hydra_pmi_proxy: No such file<br>><br>> Hi Martin,<br>><br>> Can you please stick to one configuration? It's hard for me to tell<br>> when you are running in which configuration.<br>><br>> Can you please run the following on each of the two machines:<br>><br>> % hostname<br>><br>> % ls -l /mirror/mpich2/bin/mpiexec<br>><br>> % ls -l /mirror/mpich2/bin/hydra_pmi_proxy<br>><br>> -- Pavan<br>><br>> On 10/03/2012 04:44 PM, Martin
Gilchrist wrote:<br>> > Yes the two are different.<br>> > The one where the proxy is not found is produced when mpiexec is invoked<br>> > on the main computer where I have installed nfs and done all the make<br>> > and make install of mpich2. The one with the mpiexec not found is<br>> > produced when mpiexec is invoked on the node.<br>> > Martin.<br>> ><br>> > *From:* Pavan Balaji <<a href="mailto:balaji@mcs.anl.gov" ymailto="mailto:balaji@mcs.anl.gov">balaji@mcs.anl.gov</a> <mailto:<a href="mailto:balaji@mcs.anl.gov" ymailto="mailto:balaji@mcs.anl.gov">balaji@mcs.anl.gov</a>>><br>> > *To:* Martin Gilchrist <<a href="mailto:gilchrist.martin@yahoo.com" ymailto="mailto:gilchrist.martin@yahoo.com">gilchrist.martin@yahoo.com</a><br>> <mailto:<a href="mailto:gilchrist.martin@yahoo.com" ymailto="mailto:gilchrist.martin@yahoo.com">gilchrist.martin@yahoo.com</a>>><br>> > *Cc:* <a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a> <mailto:<a href="mailto:mpich-discuss@mcs.anl.gov" ymailto="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a>>;<br>> Anthony Chan <<a href="mailto:chan@mcs.anl.gov" ymailto="mailto:chan@mcs.anl.gov">chan@mcs.anl.gov</a> <mailto:<a href="mailto:chan@mcs.anl.gov" ymailto="mailto:chan@mcs.anl.gov">chan@mcs.anl.gov</a>>><br>> > *Sent:* Tuesday, October 2, 2012 1:39 PM<br>> > *Subject:* Re: [mpich-discuss] hydra_pmi_proxy: No such file<br>> ><br>> ><br>> > On 10/02/2012 03:27 PM, Martin Gilchrist wrote:<br>> > > I can ssh into the node and hydra_pmi_proxy is visible and executable.<br>> > > And when I am
logged into the node directly it is visible and<br>> executable.<br>> ><br>> > Both those statement sound identical. Did you mean to add a "not"<br>> > somewhere there?<br>> ><br>> > > One more thing, when I am directly logged into the node and do<br>> > > mpiexec -n 2 -f machinefile ./cpi<br>> > > I get the message:<br>> > > bash:/mirror/mpich2/bin/mpiexec:No such file or directory.<br>> > > It looks like it might be an issue with permissions since bash can't<br>> > > find the executable, but it is visible via which and has executable<br>> > > permission under ls -lat.<br>> ><br>> > This is not an executable permission issue. It should say "Permission<br>> > denied" for that, not "No such file or
directory".<br>> ><br>> > Can you send me the following output?<br>> ><br>> > % ls -l /mirror/mpich2/bin/mpiexec<br>> ><br>> > % /mirror/mpich2/bin/mpiexec -n 2 -f machinefile ./cpi<br>> ><br>> > I'm having trouble believing that you can see the file, but are getting<br>> > the following error, so I'd like to see that myself :-). Of course,<br>> > it's always possible that it's some weird NFS-ness that I'm not aware of.<br>> ><br>> > -- Pavan<br>> ><br>> > -- Pavan Balaji<br>> > <a href="http://www.mcs.anl.gov/~balaji" target="_blank">http://www.mcs.anl.gov/~balaji</a><br>> ><br>> ><br>><br>> --<br>> Pavan Balaji<br>> <a href="http://www.mcs.anl.gov/~balaji" target="_blank">http://www.mcs.anl.gov/~balaji</a> <<a href="http://www.mcs.anl.gov/~balaji" target="_blank">http://www.mcs.anl.gov/~balaji</a>><br>><br>><br><br>-- <br>Pavan Balaji<br><a href="http://www.mcs.anl.gov/~balaji" target="_blank">http://www.mcs.anl.gov/~balaji</a><br><br><br> </div> </div> </div></div>_______________________________________________<br>mpich-discuss mailing list <a href="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a><br>To manage subscription options or unsubscribe:<br><a href="https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss">https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss</a><br></blockquote></div><br></div></body></html>