[mpich-discuss] Parallel File System

[Hiatt, Dave M]

Thanks Rob and John.  I'll take a look at this PLFS idea.  For the immediate I'm in fact messaging results back to Node 0 and writing.

-----Original Message-----
From: mpich-discuss-bounces at mcs.anl.gov [mailto:mpich-discuss-bounces at mcs.anl.gov] On Behalf Of John Bent
Sent: Wednesday, February 16, 2011 4:22 PM
To: mpich-discuss
Subject: Re: [mpich-discuss] Parallel File System

Excerpts from Rob Ross's message of Wed Feb 16 15:02:31 -0700 2011:
> Hi,
> 
> Real parallel I/O requires a parallel file system underneath, you 
> can't just bake it into the app. You can use MPI-IO on NFS (with a 
> list of caveats as long as my arm), but you really want a PFS.
> Otherwise you might as well write independent files or write only from 
> rank 0.
> 
If you want to be a very ambitious guinea pig and your workload is not O_RDWR, you could try using PLFS which converts your shared file workload into an independent file workload.  It should give the appearance of a parallel file system and hopefully the performance as well without requiring a real parallel file system.  Having said this, this is something that the PLFS team plans to investigate in the future but that we haven't yet done so I really don't know just how ambitious this would be.  Also, it would probably be much easier to just install PVFS which would definitely accomplish the same thing.
--
Thanks,

John
_______________________________________________
mpich-discuss mailing list
mpich-discuss at mcs.anl.gov
https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss