Looking for good benchmark to test filesystem performance

Craig Tierney - NOAA Affiliate craig.tierney at noaa.gov
Fri Feb 12 16:34:08 CST 2016


Hello All,

I have a user complaining about poor IO performance from WRF when using
pnetcdf 1.6.1.  While I am waiting on real data from the user, I want to
test the filesystem and see what it does to determine if it is WRF or
something else.  I found the list of benchmarks on the website, but there
are many to choose from!  Can someone recommend a single benchmark I should
try?

I have tried the BTIO pnetcdf benchmark.  What I see is that the Lustre
ADIO is no faster than the NFS ADIO when using Intel 15.0.3 and Intel
IMPI.  I have set the variables that Intel MPI requires
(I_MPI_EXTRA_FILESYSTEM and I_MPI_EXTRA_FILESYSTEM_LIST) and the benchmark
is reporting that it is using Lustre.  I am getting 60 MB/s whether I use
1, 4 or 16 cores.   I would expect the results to be faster.  I want to see
if there is a better benchmark and if so how the result compares to BTIO.

Thanks,
Craig
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/parallel-netcdf/attachments/20160212/5eb139b2/attachment.html>


More information about the parallel-netcdf mailing list