Warning: no access to tty (Bad file descriptor). Thus no job control in this shell. Module PGI 10.9 Loaded. Module OFED 1.5.2 loaded Module mvapich2 1.5.1p1 Loaded. Module netcdf 4.1.1 Loaded. Module hdf5 1.8.5 patch 1 Loaded. Module Jasper 1.900.1 Loaded Module udunits 1.12.11 loaded Module netCDF Operators 4.0.6 Loaded NCL (and NCAR Graphics) 5.2.1 loaded (testing, with udunits). Module PGI 10.9 Loaded. Module OFED 1.5.2 loaded Module mvapich2 1.5.1p1 Loaded. Module netcdf 4.1.1 Loaded. Module hdf5 1.8.5 patch 1 Loaded. Module Jasper 1.900.1 Loaded Module udunits 1.12.11 loaded Module netCDF Operators 4.0.6 Loaded Module PGI 10.9 Loaded. Module OFED 1.5.2 loaded Module mpich2 1.3.2p1 Loaded. Module netcdf 4.1.1 Loaded. Module hdf5 1.8.5 patch 1 Loaded. aqua01 4 aqua@aqua01 UNDEFINED LIMIT----- cputime unlimited filesize unlimited datasize unlimited stacksize unlimited coredumpsize unlimited memoryuse unlimited vmemoryuse unlimited descriptors 1024 memorylocked 64 kbytes maxproc unlimited ENDLIMIT----- setting variables 1 cd to rundir, linking stuff ln: creating symbolic link `./met_em.d01.2001-01-01_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-01_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-01_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-01_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-01_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-01_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-01_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-01_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-02_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-02_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-02_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-02_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-02_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-02_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-02_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-02_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-03_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-03_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-03_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-03_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-03_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-03_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-03_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-03_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-04_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-04_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-04_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-04_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-04_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-04_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-04_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-04_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-05_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-05_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-05_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-05_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-05_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-05_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-05_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-05_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-06_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-06_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-06_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-06_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-06_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-06_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-06_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-06_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-07_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-07_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-07_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-07_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-07_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-07_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-07_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-07_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-08_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-08_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-08_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-08_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-08_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-08_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-08_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-08_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-09_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-09_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-09_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-09_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-09_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-09_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-09_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-09_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-10_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-10_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-10_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-10_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-10_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-10_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-10_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-10_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-11_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-11_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-11_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-11_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-11_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-11_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-11_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-11_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-12_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-12_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-12_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-12_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-12_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-12_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-12_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-12_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-13_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-13_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-13_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-13_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-13_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-13_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-13_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-13_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-14_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-14_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-14_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-14_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-14_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-14_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-14_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-14_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-15_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-15_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-15_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-15_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-15_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-15_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-15_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-15_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-16_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-16_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-16_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-16_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-16_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-16_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-16_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-16_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-17_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-17_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-17_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-17_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-17_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-17_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-17_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-17_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-18_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-18_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-18_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-18_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-18_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-18_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-18_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-18_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-19_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-19_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-19_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-19_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-19_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-19_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-19_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-19_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-20_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-20_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-20_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-20_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-20_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-20_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-20_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-20_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-21_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-21_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-21_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-21_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-21_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-21_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-21_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-21_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-22_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-22_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-22_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-22_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-22_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-22_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-22_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-22_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-23_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-23_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-23_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-23_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-23_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-23_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-23_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-23_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-24_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-24_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-24_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-24_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-24_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-24_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-24_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-24_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-25_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-25_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-25_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-25_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-25_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-25_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-25_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-25_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-26_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-26_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-26_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-26_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-26_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-26_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-26_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-26_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-27_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-27_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-27_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-27_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-27_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-27_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-27_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-27_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-28_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-28_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-28_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-28_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-28_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-28_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-28_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-28_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-29_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-29_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-29_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-29_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-29_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-29_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-29_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-29_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-30_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-30_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-30_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-30_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-30_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-30_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-30_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-30_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-31_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-31_03:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-31_06:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-31_09:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-31_12:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-31_15:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-31_18:00:00.nc': File exists ln: creating symbolic link `./met_em.d01.2001-01-31_21:00:00.nc': File exists ln: creating symbolic link `./met_em.d02.2001-01-01_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d02.2001-01-31_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d03.2001-01-01_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d03.2001-01-31_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d04.2001-01-01_00:00:00.nc': File exists ln: creating symbolic link `./met_em.d04.2001-01-31_00:00:00.nc': File exists writing namelist Before running WRF /admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/bin/mpiexec ================================================================================================== mpiexec options: ---------------- Base path: /admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/bin/ Launcher: (null) Debug level: 1 Enable X: -1 Global environment: ------------------- TERM=(null) LANG=en_US.UTF-8 PWD=/cluster/home/lxu/WRF/WRF_co4/WRF_acasa_ready/run SGE_EXECD_PIDFILE=/var/run/gridengine-execd.pid REQNAME=WRF-co4-job SGE_ACCOUNT=sge SGE_CWD_PATH=/cluster/home/lxu/WRF/WRF_co4/WRF_acasa_Richard/run HOSTTYPE=x86_64-linux VENDOR=unknown OSTYPE=linux MACHTYPE=x86_64 SHLVL=1 GROUP=chen HOST=aqua01 REMOTEHOST=(null) MODULE_VERSION=3.2.8 MODULE_VERSION_STACK=3.2.8 MODULESHOME=/admin/software/lucid/modules-3.2.8a/Modules/3.2.8 MODULEPATH=/admin/software/lucid/modules-3.2.8a/Modules/versions:/admin/software/lucid/modules-3.2.8a/Modules/$MODULE_VERSION/modulefiles:/admin/software/lucid/modules-3.2.8a/Modules/modulefiles MANPATH=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/man:/admin/software/lucid/pgi-10.9/netcdf-4.1.1/man:/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/man:/admin/software/lucid/ofed-1.5.2/man:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/man:/usr/share/man CC=pgcc CXX=pgCC F77=pgf77 F90=pgf90 FC=pgf77 HDF5_LIB_DIR=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/lib HDF5_ROOT=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1 LD_LIBRARY_PATH=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/lib:/admin/software/lucid/pgi-10.9/netcdf-4.1.1/lib:/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/lib:/admin/software/lucid/ofed-1.5.2/lib:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/libso:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/lib LOADEDMODULES=pgi-10.9/linux86-64:ofed-1.5.2:pgi-10.9/mpich2-1.3.2p1:pgi-10.9/netcdf-4.1.1:pgi-10.9/hdf5-1.8.5-patch1:wrf-mpich2-new MPICH2_ROOT=/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1 NETCDF=/admin/software/lucid/pgi-10.9/netcdf-4.1.1 NETCDF4_ROOT=/admin/software/lucid/pgi-10.9/netcdf-4.1.1 OFEDROOT=/admin/software/lucid/ofed-1.5.2 PGI=/admin/software/lucid/pgi-10.9/pgi/ PGIROOT=/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9 PGI_VERSION=10.9 _LMFILES_=/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/linux86-64:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/ofed-1.5.2:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/mpich2-1.3.2p1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/netcdf-4.1.1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/hdf5-1.8.5-patch1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/wrf-mpich2-new Hydra internal environment: --------------------------- GFORTRAN_UNBUFFERED_PRECONNECTED=y Proxy information: ********************* Proxy ID: 1 ----------------- Proxy name: aqua01 Process count: 4 Start PID: 0 Proxy exec list: .................... Exec: ./real.exe; Process count: 4 ================================================================================================== [mpiexec@aqua01] Timeout set to -1 (-1 means infinite) [mpiexec@aqua01] Got a control port string of aqua01:49407 Proxy launch args: /admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/bin/hydra_pmi_proxy --control-port aqua01:49407 --debug --demux poll --pgid 0 --proxy-id [mpiexec@aqua01] PMI FD: (null); PMI PORT: (null); PMI ID/RANK: -1 Arguments being passed to proxy 0: --version 1.3.2p1 --interface-env-name MPICH_INTERFACE_HOSTNAME --hostname aqua01 --global-core-count 4 --global-process-count 4 --auto-cleanup 1 --pmi-rank -1 --pmi-kvsname kvs_11136_0 --pmi-process-mapping (vector,(0,1,4)) --ckpoint-num -1 --global-inherited-env 37 'TERM=' 'LANG=en_US.UTF-8' 'PWD=/cluster/home/lxu/WRF/WRF_co4/WRF_acasa_ready/run' 'SGE_EXECD_PIDFILE=/var/run/gridengine-execd.pid' 'REQNAME=WRF-co4-job' 'SGE_ACCOUNT=sge' 'SGE_CWD_PATH=/cluster/home/lxu/WRF/WRF_co4/WRF_acasa_Richard/run' 'HOSTTYPE=x86_64-linux' 'VENDOR=unknown' 'OSTYPE=linux' 'MACHTYPE=x86_64' 'SHLVL=1' 'GROUP=chen' 'HOST=aqua01' 'REMOTEHOST=' 'MODULE_VERSION=3.2.8' 'MODULE_VERSION_STACK=3.2.8' 'MODULESHOME=/admin/software/lucid/modules-3.2.8a/Modules/3.2.8' 'MODULEPATH=/admin/software/lucid/modules-3.2.8a/Modules/versions:/admin/software/lucid/modules-3.2.8a/Modules/$MODULE_VERSION/modulefiles:/admin/software/lucid/modules-3.2.8a/Modules/modulefiles' 'MANPATH=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/man:/admin/software/lucid/pgi-10.9/netcdf-4.1.1/man:/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/man:/admin/software/lucid/ofed-1.5.2/man:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/man:/usr/share/man' 'CC=pgcc' 'CXX=pgCC' 'F77=pgf77' 'F90=pgf90' 'FC=pgf77' 'HDF5_LIB_DIR=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/lib' 'HDF5_ROOT=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1' 'LD_LIBRARY_PATH=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/lib:/admin/software/lucid/pgi-10.9/netcdf-4.1.1/lib:/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/lib:/admin/software/lucid/ofed-1.5.2/lib:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/libso:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/lib' 'LOADEDMODULES=pgi-10.9/linux86-64:ofed-1.5.2:pgi-10.9/mpich2-1.3.2p1:pgi-10.9/netcdf-4.1.1:pgi-10.9/hdf5-1.8.5-patch1:wrf-mpich2-new' 'MPICH2_ROOT=/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1' 'NETCDF=/admin/software/lucid/pgi-10.9/netcdf-4.1.1' 'NETCDF4_ROOT=/admin/software/lucid/pgi-10.9/netcdf-4.1.1' 'OFEDROOT=/admin/software/lucid/ofed-1.5.2' 'PGI=/admin/software/lucid/pgi-10.9/pgi/' 'PGIROOT=/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9' 'PGI_VERSION=10.9' '_LMFILES_=/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/linux86-64:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/ofed-1.5.2:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/mpich2-1.3.2p1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/netcdf-4.1.1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/hdf5-1.8.5-patch1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/wrf-mpich2-new' --global-user-env 0 --global-system-env 1 'GFORTRAN_UNBUFFERED_PRECONNECTED=y' --start-pid 0 --proxy-core-count 4 --exec --exec-appnum 0 --exec-proc-count 4 --exec-local-env 0 --exec-wdir /cluster/home/lxu/WRF/WRF_co4/WRF_acasa_ready/run --exec-args 1 ./real.exe [mpiexec@aqua01] Launch arguments: /admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/bin/hydra_pmi_proxy --control-port aqua01:49407 --debug --demux poll --pgid 0 --proxy-id 0 [proxy:0:0@aqua01] got pmi command (from 6): init pmi_version=1 pmi_subversion=1 [proxy:0:0@aqua01] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0 [proxy:0:0@aqua01] got pmi command (from 6): get_maxes [proxy:0:0@aqua01] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024 [proxy:0:0@aqua01] got pmi command (from 6): get_appnum [proxy:0:0@aqua01] PMI response: cmd=appnum appnum=0 [proxy:0:0@aqua01] got pmi command (from 6): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11136_0 [proxy:0:0@aqua01] got pmi command (from 6): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11136_0 [proxy:0:0@aqua01] got pmi command (from 6): get kvsname=kvs_11136_0 key=PMI_process_mapping [proxy:0:0@aqua01] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,1,4)) [proxy:0:0@aqua01] got pmi command (from 15): init pmi_version=1 pmi_subversion=1 [proxy:0:0@aqua01] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0 [proxy:0:0@aqua01] got pmi command (from 15): get_maxes [proxy:0:0@aqua01] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024 [proxy:0:0@aqua01] got pmi command (from 15): get_appnum [proxy:0:0@aqua01] PMI response: cmd=appnum appnum=0 [proxy:0:0@aqua01] got pmi command (from 15): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11136_0 [proxy:0:0@aqua01] got pmi command (from 15): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11136_0 [proxy:0:0@aqua01] got pmi command (from 15): get kvsname=kvs_11136_0 key=PMI_process_mapping [proxy:0:0@aqua01] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,1,4)) [proxy:0:0@aqua01] got pmi command (from 8): init pmi_version=1 pmi_subversion=1 [proxy:0:0@aqua01] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0 [proxy:0:0@aqua01] got pmi command (from 8): get_maxes [proxy:0:0@aqua01] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024 [proxy:0:0@aqua01] got pmi command (from 8): get_appnum [proxy:0:0@aqua01] PMI response: cmd=appnum appnum=0 [proxy:0:0@aqua01] got pmi command (from 8): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11136_0 [proxy:0:0@aqua01] got pmi command (from 8): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11136_0 [proxy:0:0@aqua01] got pmi command (from 8): get kvsname=kvs_11136_0 key=PMI_process_mapping [proxy:0:0@aqua01] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,1,4)) [proxy:0:0@aqua01] got pmi command (from 0): init pmi_version=1 pmi_subversion=1 [proxy:0:0@aqua01] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0 [proxy:0:0@aqua01] got pmi command (from 0): get_maxes [proxy:0:0@aqua01] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024 [proxy:0:0@aqua01] got pmi command (from 0): get_appnum [proxy:0:0@aqua01] PMI response: cmd=appnum appnum=0 [proxy:0:0@aqua01] got pmi command (from 0): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11136_0 [proxy:0:0@aqua01] got pmi command (from 0): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11136_0 [proxy:0:0@aqua01] got pmi command (from 0): get kvsname=kvs_11136_0 key=PMI_process_mapping [proxy:0:0@aqua01] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,1,4)) Fatal error in MPI_Init: Other MPI error, error stack: MPIR_Init_thread(414): Initialization failed (unknown)(): Other MPI error Fatal error in MPI_Init: Other MPI error, error stack: MPIR_Init_thread(414): Initialization failed (unknown)(): Other MPI error [mpiexec@aqua01] ONE OF THE PROCESSES TERMINATED BADLY: CLEANING UP APPLICATION TERMINATED WITH THE EXIT STRING: Terminated (signal 15) rm: No match. ================================================================================================== mpiexec options: ---------------- Base path: /admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/bin/ Launcher: (null) Debug level: 1 Enable X: -1 Global environment: ------------------- TERM=(null) LANG=en_US.UTF-8 PWD=/cluster/home/lxu/WRF/WRF_co4/WRF_acasa_ready/run SGE_EXECD_PIDFILE=/var/run/gridengine-execd.pid REQNAME=WRF-co4-job SGE_ACCOUNT=sge SGE_CWD_PATH=/cluster/home/lxu/WRF/WRF_co4/WRF_acasa_Richard/run HOSTTYPE=x86_64-linux VENDOR=unknown OSTYPE=linux MACHTYPE=x86_64 SHLVL=1 GROUP=chen HOST=aqua01 REMOTEHOST=(null) MODULE_VERSION=3.2.8 MODULE_VERSION_STACK=3.2.8 MODULESHOME=/admin/software/lucid/modules-3.2.8a/Modules/3.2.8 MODULEPATH=/admin/software/lucid/modules-3.2.8a/Modules/versions:/admin/software/lucid/modules-3.2.8a/Modules/$MODULE_VERSION/modulefiles:/admin/software/lucid/modules-3.2.8a/Modules/modulefiles MANPATH=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/man:/admin/software/lucid/pgi-10.9/netcdf-4.1.1/man:/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/man:/admin/software/lucid/ofed-1.5.2/man:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/man:/usr/share/man CC=pgcc CXX=pgCC F77=pgf77 F90=pgf90 FC=pgf77 HDF5_LIB_DIR=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/lib HDF5_ROOT=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1 LD_LIBRARY_PATH=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/lib:/admin/software/lucid/pgi-10.9/netcdf-4.1.1/lib:/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/lib:/admin/software/lucid/ofed-1.5.2/lib:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/libso:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/lib LOADEDMODULES=pgi-10.9/linux86-64:ofed-1.5.2:pgi-10.9/mpich2-1.3.2p1:pgi-10.9/netcdf-4.1.1:pgi-10.9/hdf5-1.8.5-patch1:wrf-mpich2-new MPICH2_ROOT=/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1 NETCDF=/admin/software/lucid/pgi-10.9/netcdf-4.1.1 NETCDF4_ROOT=/admin/software/lucid/pgi-10.9/netcdf-4.1.1 OFEDROOT=/admin/software/lucid/ofed-1.5.2 PGI=/admin/software/lucid/pgi-10.9/pgi/ PGIROOT=/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9 PGI_VERSION=10.9 _LMFILES_=/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/linux86-64:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/ofed-1.5.2:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/mpich2-1.3.2p1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/netcdf-4.1.1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/hdf5-1.8.5-patch1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/wrf-mpich2-new Hydra internal environment: --------------------------- GFORTRAN_UNBUFFERED_PRECONNECTED=y Proxy information: ********************* Proxy ID: 1 ----------------- Proxy name: aqua01 Process count: 4 Start PID: 0 Proxy exec list: .................... Exec: ./wrf.exe; Process count: 4 ================================================================================================== [mpiexec@aqua01] Timeout set to -1 (-1 means infinite) [mpiexec@aqua01] Got a control port string of aqua01:48004 Proxy launch args: /admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/bin/hydra_pmi_proxy --control-port aqua01:48004 --debug --demux poll --pgid 0 --proxy-id [mpiexec@aqua01] PMI FD: (null); PMI PORT: (null); PMI ID/RANK: -1 Arguments being passed to proxy 0: --version 1.3.2p1 --interface-env-name MPICH_INTERFACE_HOSTNAME --hostname aqua01 --global-core-count 4 --global-process-count 4 --auto-cleanup 1 --pmi-rank -1 --pmi-kvsname kvs_11143_0 --pmi-process-mapping (vector,(0,1,4)) --ckpoint-num -1 --global-inherited-env 37 'TERM=' 'LANG=en_US.UTF-8' 'PWD=/cluster/home/lxu/WRF/WRF_co4/WRF_acasa_ready/run' 'SGE_EXECD_PIDFILE=/var/run/gridengine-execd.pid' 'REQNAME=WRF-co4-job' 'SGE_ACCOUNT=sge' 'SGE_CWD_PATH=/cluster/home/lxu/WRF/WRF_co4/WRF_acasa_Richard/run' 'HOSTTYPE=x86_64-linux' 'VENDOR=unknown' 'OSTYPE=linux' 'MACHTYPE=x86_64' 'SHLVL=1' 'GROUP=chen' 'HOST=aqua01' 'REMOTEHOST=' 'MODULE_VERSION=3.2.8' 'MODULE_VERSION_STACK=3.2.8' 'MODULESHOME=/admin/software/lucid/modules-3.2.8a/Modules/3.2.8' 'MODULEPATH=/admin/software/lucid/modules-3.2.8a/Modules/versions:/admin/software/lucid/modules-3.2.8a/Modules/$MODULE_VERSION/modulefiles:/admin/software/lucid/modules-3.2.8a/Modules/modulefiles' 'MANPATH=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/man:/admin/software/lucid/pgi-10.9/netcdf-4.1.1/man:/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/man:/admin/software/lucid/ofed-1.5.2/man:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/man:/usr/share/man' 'CC=pgcc' 'CXX=pgCC' 'F77=pgf77' 'F90=pgf90' 'FC=pgf77' 'HDF5_LIB_DIR=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/lib' 'HDF5_ROOT=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1' 'LD_LIBRARY_PATH=/admin/software/lucid/pgi-10.9/hdf5-1.8.5-patch1/lib:/admin/software/lucid/pgi-10.9/netcdf-4.1.1/lib:/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/lib:/admin/software/lucid/ofed-1.5.2/lib:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/libso:/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9/lib' 'LOADEDMODULES=pgi-10.9/linux86-64:ofed-1.5.2:pgi-10.9/mpich2-1.3.2p1:pgi-10.9/netcdf-4.1.1:pgi-10.9/hdf5-1.8.5-patch1:wrf-mpich2-new' 'MPICH2_ROOT=/admin/software/lucid/pgi-10.9/mpich2-1.3.2p1' 'NETCDF=/admin/software/lucid/pgi-10.9/netcdf-4.1.1' 'NETCDF4_ROOT=/admin/software/lucid/pgi-10.9/netcdf-4.1.1' 'OFEDROOT=/admin/software/lucid/ofed-1.5.2' 'PGI=/admin/software/lucid/pgi-10.9/pgi/' 'PGIROOT=/admin/software/lucid/pgi-10.9/pgi/linux86-64/10.9' 'PGI_VERSION=10.9' '_LMFILES_=/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/linux86-64:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/ofed-1.5.2:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/mpich2-1.3.2p1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/netcdf-4.1.1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/pgi-10.9/hdf5-1.8.5-patch1:/admin/software/lucid/modules-3.2.8a/Modules/3.2.8/modulefiles/wrf-mpich2-new' --global-user-env 0 --global-system-env 1 'GFORTRAN_UNBUFFERED_PRECONNECTED=y' --start-pid 0 --proxy-core-count 4 --exec --exec-appnum 0 --exec-proc-count 4 --exec-local-env 0 --exec-wdir /cluster/home/lxu/WRF/WRF_co4/WRF_acasa_ready/run --exec-args 1 ./wrf.exe [mpiexec@aqua01] Launch arguments: /admin/software/lucid/pgi-10.9/mpich2-1.3.2p1/bin/hydra_pmi_proxy --control-port aqua01:48004 --debug --demux poll --pgid 0 --proxy-id 0 [proxy:0:0@aqua01] got pmi command (from 8): init pmi_version=1 pmi_subversion=1 [proxy:0:0@aqua01] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0 [proxy:0:0@aqua01] got pmi command (from 15): init pmi_version=1 pmi_subversion=1 [proxy:0:0@aqua01] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0 [proxy:0:0@aqua01] got pmi command (from 8): get_maxes [proxy:0:0@aqua01] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024 [proxy:0:0@aqua01] got pmi command (from 15): get_maxes [proxy:0:0@aqua01] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024 [proxy:0:0@aqua01] got pmi command (from 8): get_appnum [proxy:0:0@aqua01] PMI response: cmd=appnum appnum=0 [proxy:0:0@aqua01] got pmi command (from 15): get_appnum [proxy:0:0@aqua01] PMI response: cmd=appnum appnum=0 [proxy:0:0@aqua01] got pmi command (from 6): init pmi_version=1 pmi_subversion=1 [proxy:0:0@aqua01] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0 [proxy:0:0@aqua01] got pmi command (from 8): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11143_0 [proxy:0:0@aqua01] got pmi command (from 6): get_maxes [proxy:0:0@aqua01] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024 [proxy:0:0@aqua01] got pmi command (from 15): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11143_0 [proxy:0:0@aqua01] got pmi command (from 6): get_appnum [proxy:0:0@aqua01] PMI response: cmd=appnum appnum=0 [proxy:0:0@aqua01] got pmi command (from 15): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11143_0 [proxy:0:0@aqua01] got pmi command (from 8): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11143_0 [proxy:0:0@aqua01] got pmi command (from 6): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11143_0 [proxy:0:0@aqua01] got pmi command (from 15): get kvsname=kvs_11143_0 key=PMI_process_mapping [proxy:0:0@aqua01] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,1,4)) [proxy:0:0@aqua01] got pmi command (from 6): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11143_0 [proxy:0:0@aqua01] got pmi command (from 8): get kvsname=kvs_11143_0 key=PMI_process_mapping [proxy:0:0@aqua01] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,1,4)) [proxy:0:0@aqua01] got pmi command (from 6): get kvsname=kvs_11143_0 key=PMI_process_mapping [proxy:0:0@aqua01] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,1,4)) [proxy:0:0@aqua01] got pmi command (from 0): init pmi_version=1 pmi_subversion=1 [proxy:0:0@aqua01] PMI response: cmd=response_to_init pmi_version=1 pmi_subversion=1 rc=0 [proxy:0:0@aqua01] got pmi command (from 0): get_maxes [proxy:0:0@aqua01] PMI response: cmd=maxes kvsname_max=256 keylen_max=64 vallen_max=1024 [proxy:0:0@aqua01] got pmi command (from 0): get_appnum [proxy:0:0@aqua01] PMI response: cmd=appnum appnum=0 [proxy:0:0@aqua01] got pmi command (from 0): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11143_0 [proxy:0:0@aqua01] got pmi command (from 0): get_my_kvsname [proxy:0:0@aqua01] PMI response: cmd=my_kvsname kvsname=kvs_11143_0 [proxy:0:0@aqua01] got pmi command (from 0): get kvsname=kvs_11143_0 key=PMI_process_mapping [proxy:0:0@aqua01] PMI response: cmd=get_result rc=0 msg=success value=(vector,(0,1,4)) Fatal error in MPI_Init: Other MPI error, error stack: MPIR_Init_thread(414): Initialization failed (unknown)(): Other MPI error [mpiexec@aqua01] ONE OF THE PROCESSES TERMINATED BADLY: CLEANING UP APPLICATION TERMINATED WITH THE EXIT STRING: Terminated (signal 15)