[mpich-discuss] hydra_pmi_proxy: No such file

Reuti reuti at staff.uni-marburg.de
Mon Oct 8 05:24:46 CDT 2012 

Hi,

Am 05.10.2012 um 23:04 schrieb Martin Gilchrist:

> I've got some more information that might give some insight into what is happening on my system.
>  
> When I do ldd ./cpi on the base node where nfs is installed and mpich was compiled I get  some paths to libraries, but when I do it on the other node I get the message that ./cpi is not a dynamic executable.

`ldd` is a script which tries to execute the application given as argument with a set variable LD_TRACE_LOADED_OBJECTS. The error you mentioned is output under various circumstances.

You can use `readelf -hld cpi` directly to get more information about the file, it should output too what you found already: whether it was built for 32 or 64 bit - or even a different CPU typ.


> When I do mpicc ./child.c, an a.out is produced, when I do the same thing on the other node I get messages like:
>  
> /usr/bin/ld: skipping incompatible /mirror/mpich2/lib/libmpich.a when searching for -lmpich.
>  
> Also, a simple invocation of ./cpi on the main node works, but gives the error message: bash: ./cpi: No such file or directory when run on the other node.

BTW: It would also output this if the application was built on a system where it uses the LSB loader (program header section like [Requesting program interpreter: /lib64/ld-linux-x86-64.so.2] or [Requesting program interpreter: /lib64/ld-lsb-x86-64.so.3]).

-- Reuti


> I have mpich and the user mpiu installed on nfs.   Could it be that the binaries compiled on one node are not compatible with the processor on the other node?
>  
> Martin. 
> 
> From: Pavan Balaji <balaji at mcs.anl.gov>
> To: Martin Gilchrist <gilchrist.martin at yahoo.com> 
> Cc: mpich-discuss at mcs.anl.gov 
> Sent: Wednesday, October 3, 2012 8:29 PM
> Subject: Re: [mpich-discuss] hydra_pmi_proxy: No such file
> 
> 
> This is weird.  Can you run mpiexec with the -verbose option and send 
> the output?
> 
>   -- Pavan
> 
> On 10/03/2012 05:09 PM, Martin Gilchrist wrote:
> > Yes.
> >
> > The first is the machine where nfs host machine and the second is the
> > other node.
> >
> >
> > mpiu at martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ hostname
> > martinlaptop-HP-Pavilion-dm4-Notebook-PC
> > mpiu at martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l
> > /mirror/mpich2/bin/mpiexec
> > lrwxrwxrwx 1 mpiu mpiu 13 2012-10-03 14:32 /mirror/mpich2/bin/mpiexec ->
> > mpiexec.hydra
> > mpiu at martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l
> > /mirror/mpich2/bin/mpiexec.hydra
> > -rwxr-xr-x 1 mpiu mpiu 1065207 2012-10-03 14:32
> > /mirror/mpich2/bin/mpiexec.hydra
> > mpiu at martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$ ls -l
> > /mirror/mpich2/bin/hydra_pmi_proxy
> > -rwxr-xr-x 1 mpiu mpiu 851803 2012-10-03 14:32
> > /mirror/mpich2/bin/hydra_pmi_proxy
> > mpiu at martinlaptop-HP-Pavilion-dm4-Notebook-PC:~$
> >
> >
> >
> >
> > mpiu at martin-desktop:~$ ls -l /mirror/mpich2/bin/mpiexec
> > lrwxrwxrwx 1 mpiu mpiu 13 2012-10-03 14:32 /mirror/mpich2/bin/mpiexec ->
> > mpiexec.hydra
> > mpiu at martin-desktop:~$ ls -lat /mirror/mpich2/bin/mpiexec.hydra
> > -rwxr-xr-x 1 mpiu mpiu 1065207 2012-10-03 14:32
> > /mirror/mpich2/bin/mpiexec.hydra
> > mpiu at martin-desktop:~$ ls -l /mirror/mpich2/bin/hydra_pmi_proxy
> > -rwxr-xr-x 1 mpiu mpiu 851803 2012-10-03 14:32
> > /mirror/mpich2/bin/hydra_pmi_proxy
> > mpiu at martin-desktop:~$
> >
> >
> > ------------------------------------------------------------------------
> > *From:* Pavan Balaji <balaji at mcs.anl.gov>
> > *To:* Martin Gilchrist <gilchrist.martin at yahoo.com>
> > *Cc:* "mpich-discuss at mcs.anl.gov" <mpich-discuss at mcs.anl.gov>
> > *Sent:* Wednesday, October 3, 2012 3:46 PM
> > *Subject:* Re: [mpich-discuss] hydra_pmi_proxy: No such file
> >
> > Hi Martin,
> >
> > Can you please stick to one configuration?  It's hard for me to tell
> > when you are running in which configuration.
> >
> > Can you please run the following on each of the two machines:
> >
> > % hostname
> >
> > % ls -l /mirror/mpich2/bin/mpiexec
> >
> > % ls -l /mirror/mpich2/bin/hydra_pmi_proxy
> >
> >    -- Pavan
> >
> > On 10/03/2012 04:44 PM, Martin Gilchrist wrote:
> >  > Yes the two are different.
> >  > The one where the proxy is not found is produced when mpiexec is invoked
> >  > on the main computer where I have installed nfs and done all the make
> >  > and make install of mpich2.  The one with the mpiexec not found is
> >  > produced when mpiexec is invoked on the node.
> >  > Martin.
> >  >
> >  > *From:* Pavan Balaji <balaji at mcs.anl.gov <mailto:balaji at mcs.anl.gov>>
> >  > *To:* Martin Gilchrist <gilchrist.martin at yahoo.com
> > <mailto:gilchrist.martin at yahoo.com>>
> >  > *Cc:* mpich-discuss at mcs.anl.gov <mailto:mpich-discuss at mcs.anl.gov>;
> > Anthony Chan <chan at mcs.anl.gov <mailto:chan at mcs.anl.gov>>
> >  > *Sent:* Tuesday, October 2, 2012 1:39 PM
> >  > *Subject:* Re: [mpich-discuss] hydra_pmi_proxy: No such file
> >  >
> >  >
> >  > On 10/02/2012 03:27 PM, Martin Gilchrist wrote:
> >  >  > I can ssh into the node and hydra_pmi_proxy is visible and executable.
> >  >  > And when I am logged into the node directly it is visible and
> > executable.
> >  >
> >  > Both those statement sound identical.  Did you mean to add a "not"
> >  > somewhere there?
> >  >
> >  >  > One more thing, when I am directly logged into the node and do
> >  >  > mpiexec -n 2 -f machinefile ./cpi
> >  >  > I get the message:
> >  >  > bash:/mirror/mpich2/bin/mpiexec:No such file or directory.
> >  >  > It looks like it might be an issue with permissions since bash can't
> >  >  > find the executable, but it is visible via which and has executable
> >  >  > permission under ls -lat.
> >  >
> >  > This is not an executable permission issue.  It should say "Permission
> >  > denied" for that, not "No such file or directory".
> >  >
> >  > Can you send me the following output?
> >  >
> >  > % ls -l /mirror/mpich2/bin/mpiexec
> >  >
> >  > % /mirror/mpich2/bin/mpiexec -n 2 -f machinefile ./cpi
> >  >
> >  > I'm having trouble believing that you can see the file, but are getting
> >  > the following error, so I'd like to see that myself :-).  Of course,
> >  > it's always possible that it's some weird NFS-ness that I'm not aware of.
> >  >
> >  > -- Pavan
> >  >
> >  > -- Pavan Balaji
> >  > http://www.mcs.anl.gov/~balaji
> >  >
> >  >
> >
> > --
> > Pavan Balaji
> > http://www.mcs.anl.gov/~balaji <http://www.mcs.anl.gov/~balaji>
> >
> >
> 
> -- 
> Pavan Balaji
> http://www.mcs.anl.gov/~balaji
> 
> 
> _______________________________________________
> mpich-discuss mailing list     mpich-discuss at mcs.anl.gov
> To manage subscription options or unsubscribe:
> https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/mpich-discuss/attachments/20121008/cfa4125d/attachment.html>

More information about the mpich-discuss mailing list