CFIO: i/o forwarding with pnetcdf

Rajeev Thakur thakur at mcs.anl.gov
Mon Sep 23 12:49:42 CDT 2013


See also http://www.geosci-model-dev-discuss.net/6/4775/2013/gmdd-6-4775-2013.html. PDF link is at the right.

On Sep 18, 2013, at 10:39 AM, Rob Latham wrote:

> A group in China has developed a climate-oriented I/O library called
> CFIO.  It has the two interesting design properties that it sits on
> top of pnetcdf and it forwards I/O to "server" processes. 
> 
> https://github.com/CFIO/CFIO/wiki/CFIO-Design
> 
> all processes start out in MPI_COMM_WORLD, but some user-specified
> ratio determines which clients end up in a server group and which ones
> end up in a client group.   
> 
> Clients send to servers with simple point to point operations. 
> 
> Pthreads are used to get the clients sending data to servers in the
> background.
> 
> ==rob
> 
> -- 
> Rob Latham
> Mathematics and Computer Science Division
> Argonne National Lab, IL USA



More information about the parallel-netcdf mailing list