[mpich-discuss] MPI_TYPE_MAX limit using MPT

Rob Ross rross at mcs.anl.gov
Fri Oct 15 09:17:23 CDT 2010


Is this a global table in the sense of every process contributing to a single table? Does everyone have a copy, or is it partitioned between processes?

-- Rob

On Oct 15, 2010, at 6:50 AM, Michael Raymond <mraymond at sgi.com> wrote:

>  That's correct.  In MPT every element of a complex type like a struct
> or indexed type ends up taking up a type in the global table.  There are
> good speed reasons for this but the downside is that you sometimes need
> to preallocate a ton of space for datatypes.  This is remedied to some
> extent in MPT 2.03.  If you have any more questions about MPT you can
> contact me directly.
> 
> Wei-keng Liao wrote:
>> Hi, Max,
>> 
>> I am cc this to mpich discuss group. Hope people there can provide more thorough
>> answers. 
>> 
>> I have not run jobs on a SGI machine for a long time, but I remember I have to
>> increase MPI_TYPE_MAX in order to run an MPI-IO job. In collective I/O, ROMIO
>> uses MPI derived data type for exchanging I/O requests among processes. So,
>> the more processes a job runs, the bigger number MPI_TYPE_MAX should be set.
>> 
>> Wei-keng
>> 
>> On Oct 6, 2010, at 11:29 AM, Maxwell Kelley wrote:
>> 
>>> Hello,
>>> 
>>> When running some I/O tests using MPT 1.25, I get the error
>>> 
>>> MPI has run out of internal datatype entries.
>>> Please set the environment variable MPI_TYPE_MAX for additional space.
>>> The current value of MPI_TYPE_MAX is 8192
>>> 
>>> Is this normal?  Setting MPI_TYPE_MAX to 65536 simply allowed more I/O to be performed before the error appears. The limit is reached more quickly using more processors.  Assuming that this is a case of types not being freed after use, should I just set this limit high enough that it will never be exceeded during a 12-hour batch job?
>>> 
>>> -Max
>>> 
>> 
>> _______________________________________________
>> mpich-discuss mailing list
>> mpich-discuss at mcs.anl.gov
>> https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss
> 
> -- 
> Michael A. Raymond
> Message Passing Toolkit Team
> Silicon Graphics Inc
> (651) 683-3434
> 


More information about the parallel-netcdf mailing list