I have been reading up and aware that MPICH2 is the currently used implementation. And I would have it here in our system as well, but the caveat is: we have a software named FastDL which is a parallelized version of IDL (by ITT). When it was ordered, it was compiled with MPICH1.2.7p1. Hence we had been trying to get MPICH1 up and running. It is possible to obtain the FastDL that would be compiled with MPICH2 but the problem of LSF still remains. The jobs cannot be spawned to different nodes of the cluster as a user since users cannot ssh into different nodes. They can only be spawned through LSF and the LSF here has been configured with SLURM. I have been under impression that this is particular to HP-XC clusters.<br>
<br>As far as interactive or debugging session goes, I do not know how to do srun in interactive session. How do you do that?<br clear="all"><br>Gauri.<br>---------<br>
<br><br><div class="gmail_quote">On Tue, Mar 3, 2009 at 10:37 PM, Anthony Chan <span dir="ltr"><<a href="mailto:chan@mcs.anl.gov">chan@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<br>
One advantage of MPICH2 over MPICH1 is that MPICH2 is a lot more robust<br>
in term of process management. So debugging MPICH2 app with MPICH1 is<br>
easier. Also, MPICH1 is no longer being developed, if you have any prolem<br>
with MPICH1, less people (if there is any) will be able to help you.<br>
<br>
A.Chan<br>
<div><div></div><div class="h5"><br>
----- "Gauri Kulkarni" <<a href="mailto:gaurivk@gmail.com">gaurivk@gmail.com</a>> wrote:<br>
<br>
> Thanks, Rajeev.<br>
><br>
> Is it the same case with MPICH1? The reason I need info about MPICH1<br>
> with<br>
> SLURM is because we have a software (FastDL) which has been compiled<br>
> with<br>
> MPICH1. We have asked the vendor to give us the software recompiled<br>
> with<br>
> MPICH2, but honestly, we do not know any particular advantage using<br>
> MPICH2<br>
> over MPICH1 (apart from the fact that MPICH1 isn't maintained<br>
> anymore).<br>
><br>
> On a sidenote, how do I reply to the thread? I only get the daily<br>
> digest in<br>
> mail.<br>
><br>
> -Gauri.<br>
> ----------<br>
><br>
><br>
><br>
> -------------<br>
><br>
> Message: 4<br>
> Date: Mon, 23 Feb 2009 23:38:06 -0600<br>
> From: "Rajeev Thakur" <<a href="mailto:thakur@mcs.anl.gov">thakur@mcs.anl.gov</a>><br>
> Subject: Re: [mpich-discuss] HP-XC 3000 cluster issues<br>
> To: <<a href="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a>><br>
> Message-ID: <72376B2D10EC43F9A0A433C960F951B6@thakurlaptop><br>
> Content-Type: text/plain; charset="us-ascii"<br>
><br>
> To run MPICH2 with SLURM, configure with the options<br>
> "--with-pmi=slurm<br>
> --with-pm=no" as described in the MPICH2 README file. Also see the<br>
> instructions on how to run MPICH2 with SLURM at<br>
> <a href="https://computing.llnl.gov/linux/slurm/quickstart.html" target="_blank">https://computing.llnl.gov/linux/slurm/quickstart.html</a> .<br>
><br>
> Rajeev<br>
><br>
><br>
><br>
> _____<br>
><br>
> From: <a href="mailto:mpich-discuss-bounces@mcs.anl.gov">mpich-discuss-bounces@mcs.anl.gov</a><br>
> [mailto:<a href="mailto:mpich-discuss-bounces@mcs.anl.gov">mpich-discuss-bounces@mcs.anl.gov</a>] On Behalf Of Gauri<br>
> Kulkarni<br>
> Sent: Monday, February 23, 2009 11:19 PM<br>
> To: <a href="mailto:mpich-discuss@mcs.anl.gov">mpich-discuss@mcs.anl.gov</a><br>
> Subject: [mpich-discuss] HP-XC 3000 cluster issues<br>
><br>
><br>
> Hi,<br>
><br>
> I am a newbie to the MPI in general. Currently in our institute, we<br>
> have a<br>
> cluster of 16nodes-8processors. It is an HP-XC 3000 cluster which<br>
> basically<br>
> means, it's quite proprietary. It has its own MPI implementation -<br>
> HP-MPI -<br>
> in which, the parallelization is managed by SLURM (Simple Linux<br>
> Utility for<br>
> Resource Management). There is also a batch job scheduler - LSF (Load<br>
> Sharing Facility) which works in tandem with SLURM to parallelize the<br>
> batch<br>
> jobs. We have installed both MPICH and MPICH2 and are testing it, but<br>
> we are<br>
> running into compatibility issues. For a simple helloworld.c program:<br>
> 1. For HPMPI: Compiled with mpicc of this implemetation and executed<br>
> with<br>
> its mpirun: mpirun -np 4 helloworld works correctly. For batch<br>
> scheduling,<br>
> we need to isse "bsub -n4 [other options] mpirun -srun helloworld" and<br>
> it<br>
> runs fine too. "srun" is SLURM utility that parallelizes the jobs.<br>
> 2. For MPICH and mPICH2: Again, compiled with mpicc of these<br>
> respective<br>
> implemetations and executed with their own mpirun:<br>
> i) mpirun -np 4 helloword : Works.<br>
> ii) mpirun -np 15 helloworld: The parallelization is limited to just<br>
> a<br>
> single node - that is 8 processes run first on 8 processors of a<br>
> single node<br>
> and then remaining ones.<br>
> iii) bsub -n4 [options] mpirun -srun hellowrold: Job terminated.<br>
> srun<br>
> option not recognized.<br>
> iv) bsub [options] mpirun -np 4 helloworld: Works<br>
> V) bsub [options] mpirun -np 15 helloworld: (Same as iii)<br>
><br>
> Anybody aware of HP cluster issues with MPICH? Am I misinterpreting?<br>
> Any<br>
> help is appreciated.<br>
><br>
> Gauri.<br>
> ---------<br>
</div></div></blockquote></div><br>