[mpich-discuss] Problem running mpiexec within a queue (LSF)

Peer-Joachim Koch pkoch at bgc-jena.mpg.de
Wed Mar 7 11:45:44 CST 2012


Hi,

now I'm using my normal shell.
For the queue I use

bsub -q SLES -a mpich2pgi12 -n 8 mpich2pgi12.lsf  ./MPI2hello
                 ^^^^^^^^^^^      ^^^^^^^^^^^^^^
                 which wrapper should be used
                                    a modified "mpirun.lsf"

I'm using those scripts on the old system. I just changed the env,
so that the current paths are used.
Is some environment variable missing ?

Bye, Peer



Am 07.03.2012 17:57, schrieb Pavan Balaji:
>
> By cli, are you creating an interactive session with LSF and then
> running the job?
>
> For the non-interactive version, can you send the content of your bsub
> file?
>
> -- Pavan
>
> On 03/07/2012 04:15 AM, Dr.Peer-Joachim Koch wrote:
>> Hi,
>>
>> we are currently replacing the OS of our HPC cluster.
>> So I have updated the compiler and also mpich2 to the latest
>> stable release 1.4.1p1.
>>
>> All test are fine. Also running mpi jobs from the cli is no problem and
>> working.
>>
>> Using our LSF queue fails. I get the following error.
>> Could somebody please explain, what's missing or wrong ?
>>
>>
>> ####output from LSF ###
>> .
>> .
>>
>> The output (if any) follows:
>>
>> [mpiexec at io4] HYD_pmcd_pmi_alloc_pg_scratch
>> (./pm/pmiserv/pmiserv_utils.c:595): assert (pg->pg_process_count *
>> sizeof(struct HYD_pmcd_pmi_ecount)) failed
>> [mpiexec at io4] HYD_pmci_launch_procs (./pm/pmiserv/pmiserv_pmci.c:103):
>> error allocating pg scratch space
>> [mpiexec at io4] main (./ui/mpich/mpiexec.c:401): process manager returned
>> error launching processes
>> Job
>> /usr/local/apps/lsf/7.0/linux2.6-glibc2.3-x86_64/bin/mpich2pgi12_wrapper
>> ./MPI2hello
>>
>>
>>
>> ###
>>
>> running the mpiexec -np 8 ./MPI2hello or mpirun -np 8
>> ./MPI2hello will work.
>>
>>
>> Any hint ?
>>
>>
>>
>>
>> _______________________________________________
>> mpich-discuss mailing list mpich-discuss at mcs.anl.gov
>> To manage subscription options or unsubscribe:
>> https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss
>


-- 
Mit freundlichem Gruß
     Peer-Joachim Koch
_________________________________________________________
Max-Planck-Institut fuer Biogeochemie
Dr. Peer-Joachim Koch
Hans-Knöll Str.10             Telefon: ++49 3641 57-6705
D-07745 Jena                  Telefax: ++49 3641 57-7705

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4599 bytes
Desc: S/MIME Kryptografische Unterschrift
URL: <http://lists.mcs.anl.gov/pipermail/mpich-discuss/attachments/20120307/1c82540a/attachment.bin>


More information about the mpich-discuss mailing list