benchmark program question
Richard Hedges
richard-hedges at llnl.gov
Tue Feb 26 12:41:55 CST 2008
Hi Marty,
Have you looked at the parallel NetCDF version of the IOR benchmark?
- Richard
At 9:22 AM -0700 2/26/08, Marty Barnaby wrote:
>I'm new to the parallel NetCDF interface, and I don't have much
>experience with NetCDF either. Because of new interest on our part,
>we would like to have a straightforward, benchmark program to get
>byte-rate metrics for writing to a Posix FS (chiefly, some large
>Lustre deployments). I've had some reasonable experiences in this at
>the MPI-IO level, achieving a sustained, average rate of 26 GB/s;
>this writing to a single, shared file with an LFS stripe-count of
>160. If anyone is interested, I could provide them with more
>specifics.
>
>I can't find the benchmark-type code that I really need, though I've
>been looking at the material under /test like
>/test_double/test_write.c
>This I've compiled and executed successfully at the appropriate -np 4 level.
>
>There are three dynamics I would like to have that I can't see how to get.
>
> 1. Run on any number of processors. I'm sure this is simple, but I want to
> know where the failure is when I attempt it.
>
> 2. Set the number of bytes appended to an open file in a single, atomic,
> collective write operation. In my MPI-IO benchmark program I merely
> got this number by having a buffer size on each processor, and the total
> was the product of this times the number of processors. At the higher
> level of PNetCDF I'm not sure which value I'm getting in the def_var
> and put_var.
>
> 3. Be able to perform any number of equivalent, collective write operations,
> appending to the same, open file. Simply a:
>
> for ( i = 0; i < NUMRECS; i++ )
>
> concept. This is basically what our scientific, simulation
>applications do in their 'dump' mode.
>
>
>Thanks,
>Marty Barnaby
--
====================================================
Richard Hedges
Customer Support and Test - File Systems Project
Development Environment Group - Livermore Computing
Lawrence Livermore National Laboratory
7000 East Avenue, MS L-557
Livermore, CA 94551
v: (925) 423-2699
f: (925) 423-6961
E: richard-hedges at llnl.gov
More information about the parallel-netcdf
mailing list