Looking for good benchmark to test filesystem performance

[Craig Tierney - NOAA Affiliate]

Jim,

My users aren't using the latest WRF.  Also, we have had a bad experience
trying to build PIO on NOAA systems.  It has been a challenge and it isn't
a direction these users want to go at this time.

Craig

On Fri, Feb 12, 2016 at 3:56 PM, Jim Edwards <jedwards at ucar.edu> wrote:

> Hi Craig,
>
> In more recent version of wrf there is a pio option that should improve
> pnetcdf io performance.  Also in the pio distribution is a performance tool
> that can measure io performance based on the data decomposition you are
> using in wrf.  https://github.com/NCAR/ParallelIO
>
> On Fri, Feb 12, 2016 at 3:34 PM, Craig Tierney - NOAA Affiliate <
> craig.tierney at noaa.gov> wrote:
>
>> Hello All,
>>
>> I have a user complaining about poor IO performance from WRF when using
>> pnetcdf 1.6.1.  While I am waiting on real data from the user, I want to
>> test the filesystem and see what it does to determine if it is WRF or
>> something else.  I found the list of benchmarks on the website, but there
>> are many to choose from!  Can someone recommend a single benchmark I should
>> try?
>>
>> I have tried the BTIO pnetcdf benchmark.  What I see is that the Lustre
>> ADIO is no faster than the NFS ADIO when using Intel 15.0.3 and Intel
>> IMPI.  I have set the variables that Intel MPI requires
>> (I_MPI_EXTRA_FILESYSTEM and I_MPI_EXTRA_FILESYSTEM_LIST) and the benchmark
>> is reporting that it is using Lustre.  I am getting 60 MB/s whether I use
>> 1, 4 or 16 cores.   I would expect the results to be faster.  I want to see
>> if there is a better benchmark and if so how the result compares to BTIO.
>>
>> Thanks,
>> Craig
>>
>
>
>
> --
> Jim Edwards
>
> CESM Software Engineer
> National Center for Atmospheric Research
> Boulder, CO
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/parallel-netcdf/attachments/20160212/70ec717c/attachment.html>