[ExM Users] UNFILLED CONTAINER SUBSCRIBE

[Ozik, Jonathan]

Hello all,

I’m getting UNFILLED CONTAINER SUBSCRIBE messages when running my script. Based on the error output below, is there a (relatively) easy way to track this down that you’d recommend?

Jonathan

WAITING WORK: 34
	      {16} params_to_priors-foreach-wait3  (/<37>:upf_lines (aidi_EnKF:params_to_priors():46:4)/)
	      {17} params_to_priors-foreach-wait5  (/<38>:aggNewIs (aidi_EnKF:params_to_priors():59:4)/)
	      {18} params_to_priors-call-size0  (/<39>:ens_priors_transposed[0] (aidi_EnKF:params_to_priors():77:4)/)
	      {19} params_to_priors-call_foreign-size-1  (/<39>:ens_priors_transposed (aidi_EnKF:params_to_priors():77:4)/)
	      {22} posteriors_to_params-call-size0  (/<27>:__t:67[0] (aidi_EnKF:main():186:5)/)
	      {27} priors_to_posteriors-call-size0  (/<25>:__t:61[0] (aidi_EnKF:main():184:8)/)
	      {28} priors_to_posteriors-call_foreign-size-1  (/<25>:__t:61 (aidi_EnKF:main():184:8)/)
	      {29} priors_to_posteriors-call_sync-blob_from_floats  (/<46>:one_dim_ens_priors (aidi_EnKF:priors_to_posteriors():123:1)/)
	      {30} shape_one_dim-async_op-minus_int  (/<44>:rows (aidi_EnKF:priors_to_posteriors():121:3)/)
	      {31} shape_one_dim-async_op-minus_int-1  (/<45>:cols (aidi_EnKF:priors_to_posteriors():122:1)/)
	      {32} flatten_two_dim-call-size0  (/<25>:__t:61[0] (aidi_EnKF:main():184:8)/)
	      {33} flatten_two_dim-call_foreign-size-1  (/<25>:__t:61 (aidi_EnKF:main():184:8)/)
	      {34} posteriors_to_params-wait-range3  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {36} posteriors_to_params-wait-range3  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {44} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {45} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {46} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {47} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {48} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {49} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {50} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {51} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {52} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {53} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {54} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {55} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {56} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	      {57} posteriors_to_params-wait-range1  (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
	     {535} params_to_priors-call_sync-string_join  (/<215>:ips (aidi_EnKF:params_to_priors():48:8)/)
	     {538} params_to_priors-call_sync-string_join  (/<217>:ips (aidi_EnKF:params_to_priors():48:8)/)
	     {551} params_to_priors-async_op-plus_int  (<218>:offset (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-14] (aidi_EnKF:main():169:4)/)
	     {552} params_to_priors-async_op-plus_int  (<218>:offset (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-13] (aidi_EnKF:main():169:4)/)
	     {553} params_to_priors-async_op-plus_int  (<216>:offset (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-14] (aidi_EnKF:main():169:4)/)
	     {554} params_to_priors-async_op-plus_int  (<216>:offset (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-13] (aidi_EnKF:main():169:4)/)
UNFILLED CONTAINER SUBSCRIBE <27>:__t:67[0] (aidi_EnKF:main():186:5) rank: 2 work_type: 0
UNFILLED CONTAINER SUBSCRIBE <14>:float_var_names[-13] (aidi_EnKF:main():169:4) rank: 2 work_type: 0
UNFILLED CONTAINER SUBSCRIBE <25>:__t:61[0] (aidi_EnKF:main():184:8) rank: 2 work_type: 0
UNFILLED CONTAINER SUBSCRIBE <14>:float_var_names[-14] (aidi_EnKF:main():169:4) rank: 2 work_type: 0
UNFILLED CONTAINER SUBSCRIBE <39>:ens_priors_transposed[0] (aidi_EnKF:params_to_priors():77:4) rank: 2 work_type: 0
FAILED: EXIT(1)

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 66444 RUNNING AT XioMBP.local
=   EXIT CODE: 1
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================