LUSTRE. ADIOI_Set_lock:: Function not implemented
Jim Edwards
jedwards at ucar.edu
Thu Aug 9 09:10:12 CDT 2012
Hi David,
These are the settings we use in PIO to avoid this error:
ccsm.log.120807-081659: Setting mpi info: romio_ds_write=disable
ccsm.log.120807-081659: Setting mpi info: romio_ds_read=disable
Not sure if the settings you are using are doing the same thing, but if I
don't set these for lustre I get the same error you are seeing.
Jim
On Thu, Aug 9, 2012 at 5:57 AM, David Ayuso <davidayuso at live.com> wrote:
> We have problem running a MPI program in a LUSTRE machine (the same
> program works perfectly in an IBM machine). When calling:
>
>
> CALL MPI_FILE_WRITE_AT_ALL (IHT, MOFF, BT, LDI*LDJ, &
>
> & MPI_DOUBLE_PRECISION, MPI_STATUS_IGNORE, IERR)
>
>
> The program stops with the following error message:
>
>
> File locking failed in ADIOI_Set_lock(fd 13,cmd F_SETLKW/7,type
> F_WRLCK/1,whence 0) with return value FFFFFFFF and errno 26.
>
> - If the file system is NFS, you need to use NFS version 3, ensure that
> the lockd daemon is running on all the machines, and mount the directory
> with the 'noac' option (no attribute caching).
>
> - If the file system is LUSTRE, ensure that the directory is mounted with
> the 'flock' option.
>
> ADIOI_Set_lock:: Function not implemented
>
> ADIOI_Set_lock:offset 0, length 76236552
>
>
> We have tried to solve it by calling MPI_INFO_SET to try to
> enable/disable the file locking:
>
>
> call mpi_info_create(info, ierr)
>
> !call mpi_info_set(info, "romio_ds_write", "disable", ierr)
>
> !call mpi_info_set(info, "romio_cb_write", "enable", ierr)
>
> call mpi_info_set(info,"romio_lustre_ds_in_coll","disable",ierr)
>
>
> Nothing works! The program keeps stopping with the very same error
> message! :-(
>
>
> Help please!!!
>
>
--
Jim Edwards
CESM Software Engineering Group
National Center for Atmospheric Research
Boulder, CO
303-497-1842
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/parallel-netcdf/attachments/20120809/18feb734/attachment.html>
More information about the parallel-netcdf
mailing list