performance issue

[Wei-Keng Liao]

Hi, Jim

FYI. Darshan now can capture the I/O activities of PnetCDF,
in addition to the already MPI-IO and POSIX-IO.

Wei-keng

On Aug 9, 2023, at 6:22 PM, Wei-Keng Liao <wkliao at northwestern.edu> wrote:

In that case, I have the E3SM-IO benchmark that has a fairly complicate I/O
partitioning pattern. It used the decomposition maps generated from PIO.
https://github.com/Parallel-NetCDF/E3SM-IO<https://urldefense.com/v3/__https://github.com/Parallel-NetCDF/E3SM-IO__;!!Dq0X2DkFhyF93HkjWTBQKhk!UJAnknjDPQWY43szbAutlokjDrSHyBOcTlhEOChqYtThxnr812hxwvb8aSmHcEPiNOxNdOUHZi9Z2fyXbg2j6JH1HTo$>

Wei-keng

On Aug 9, 2023, at 6:17 PM, Jim Edwards <jedwards at ucar.edu> wrote:

I think that your example case is too simple - it's doing a simple block decomposition.
In order to get the performance difference I am observing I need to do a more complicated
mapping.   I will work on a program that reproduces the problem without pio but it may take a
while.



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/parallel-netcdf/attachments/20230810/a40ebc04/attachment.html>