[mpich-discuss] Sorting nodes by CPUs with -ppn (1.4 and r9834)

Pavan Balaji balaji at mcs.anl.gov
Tue May 8 17:25:00 CDT 2012


The -ppn setting was always to specify how many cores you want Hydra to 
consider on each node (we can call it -cpn for cores per node, if it 
makes it clearer).  This is needed, if you have more processes than the 
number of nodes either at the start, or through dynamic processes, when 
we might have to wrap back to first node.

Also, if you are creating threads based on the number of cores 
available, don't you already know the number of cores on each node?  If 
yes, why not just create a new communicator with the ranks reordered?

  -- Pavan

On 05/08/2012 05:09 PM, Yauheni Zelenko wrote:
> Hi!
>
> Hydra assumes number of processes per node as number of cores (in 1.4 and r9834) when -ppn specified.
>
> In this case -order-nodes behaves inconsistently with -ppn (order from command line) and without (nodes are sorted).
>
> Our application could use mixed MPI/multi-threads mode. In this case with use -ppn 1, but still sorting nodes by number of CPUs make sense for us to run master process (rank 0) on host with most CPUs.
>
> This is especially useful in farm environment like LSF/SGE/etc when CPUs on hosts may be allocated randomly.
>
> Eugene.
> _______________________________________________
> mpich-discuss mailing list     mpich-discuss at mcs.anl.gov
> To manage subscription options or unsubscribe:
> https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss

-- 
Pavan Balaji
http://www.mcs.anl.gov/~balaji


More information about the mpich-discuss mailing list