tput: No value for $TERM and no -T specified Rank 8 [Thu Jun 15 10:14:16 2017] [c3-0c2s9n1] Fatal error in MPI_Allreduce: Message truncated, error stack: MPI_Allreduce(1000)...............: MPI_Allreduce(sbuf=0x49bf660, rbuf=0x48bb220, count=102, MPI_DOUBLE, MPI_SUM, comm=0x84000002) failed MPIR_Allreduce_impl(843)..........: MPIR_Allreduce_intra(272).........: MPIR_Reduce_impl(1200)............: MPIR_Reduce_intra(996)............: MPIR_Reduce_binomial(233).........: MPIDI_CH3U_Receive_data_found(144): Message from rank 12 and tag 11 truncated; 824 bytes received but buffer size is 816 MPIR_Allreduce_intra(302).........: MPIR_Bcast_impl(1454).............: MPIR_CRAY_Bcast(1220).............: MPIR_CRAY_Bcast_Tree(382).........: MPIDI_CH3U_Receive_data_found(144): Message from rank 0 and tag 2 truncated; 824 bytes received but buffer size is 816 Rank 2 [Thu Jun 15 10:14:16 2017] [c3-0c2s9n1] Fatal error in MPI_Allreduce: Message truncated, error stack: MPI_Allreduce(1000)...............: MPI_Allreduce(sbuf=0x48a5060, rbuf=0x48982c0, count=102, MPI_DOUBLE, MPI_SUM, comm=0x84000002) failed MPIR_Allreduce_impl(843)..........: MPIR_Allreduce_intra(272).........: MPIR_Reduce_impl(1200)............: MPIR_Reduce_intra(996)............: MPIR_Reduce_binomial(233).........: MPIDI_CH3U_Receive_data_found(144): Message from rank 3 and tag 11 truncated; 824 bytes received but buffer size is 816 MPIR_Allreduce_intra(302).........: MPIR_Bcast_impl(1454).............: MPIR_CRAY_Bcast(1220).............: MPIR_CRAY_Bcast_Tree(382).........: MPIDI_CH3U_Receive_data_found(144): Message from rank 0 and tag 2 truncated; 824 bytes received but buffer size is 816 Rank 1 [Thu Jun 15 10:14:16 2017] [c3-0c2s9n1] Fatal error in MPI_Allreduce: Message truncated, error stack: MPI_Allreduce(1000)...............: MPI_Allreduce(sbuf=0x49bc590, rbuf=0x49b9e80, count=102, MPI_DOUBLE, MPI_SUM, comm=0x84000002) failed MPIR_Allreduce_impl(843)..........: MPIR_Allreduce_intra(302).........: MPIR_Bcast_impl(1454).............: MPIR_CRAY_Bcast(1220).............: MPIR_CRAY_Bcast_Tree(382).........: MPIDI_CH3U_Receive_data_found(144): Message from rank 0 and tag 2 truncated; 824 bytes received but buffer size is 816 Rank 4 [Thu Jun 15 10:14:16 2017] [c3-0c2s9n1] Fatal error in MPI_Allreduce: Message truncated, error stack: MPI_Allreduce(1000)...............: MPI_Allreduce(sbuf=0x49c4bf0, rbuf=0x49c24e0, count=102, MPI_DOUBLE, MPI_SUM, comm=0x84000002) failed MPIR_Allreduce_impl(843)..........: MPIR_Allreduce_intra(302).........: MPIR_Bcast_impl(1454).............: MPIR_CRAY_Bcast(1220).............: MPIR_CRAY_Bcast_Tree(382).........: MPIDI_CH3U_Receive_data_found(144): Message from rank 0 and tag 2 truncated; 824 bytes received but buffer size is 816 _pmiu_daemon(SIGCHLD): [NID 00741] [c3-0c2s9n1] [Thu Jun 15 10:14:16 2017] PE RANK 8 exit signal Aborted [NID 00741] 2017-06-15 10:14:16 Apid 3590530: initiated application termination