Looking for good benchmark to test filesystem performance

[Jim Edwards]

Hi Craig,

In more recent version of wrf there is a pio option that should improve
pnetcdf io performance.  Also in the pio distribution is a performance tool
that can measure io performance based on the data decomposition you are
using in wrf.  https://github.com/NCAR/ParallelIO

On Fri, Feb 12, 2016 at 3:34 PM, Craig Tierney - NOAA Affiliate <
craig.tierney at noaa.gov> wrote:

> Hello All,
>
> I have a user complaining about poor IO performance from WRF when using
> pnetcdf 1.6.1.  While I am waiting on real data from the user, I want to
> test the filesystem and see what it does to determine if it is WRF or
> something else.  I found the list of benchmarks on the website, but there
> are many to choose from!  Can someone recommend a single benchmark I should
> try?
>
> I have tried the BTIO pnetcdf benchmark.  What I see is that the Lustre
> ADIO is no faster than the NFS ADIO when using Intel 15.0.3 and Intel
> IMPI.  I have set the variables that Intel MPI requires
> (I_MPI_EXTRA_FILESYSTEM and I_MPI_EXTRA_FILESYSTEM_LIST) and the benchmark
> is reporting that it is using Lustre.  I am getting 60 MB/s whether I use
> 1, 4 or 16 cores.   I would expect the results to be faster.  I want to see
> if there is a better benchmark and if so how the result compares to BTIO.
>
> Thanks,
> Craig
>



-- 
Jim Edwards

CESM Software Engineer
National Center for Atmospheric Research
Boulder, CO
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/parallel-netcdf/attachments/20160212/a3512dc1/attachment.html>