[ExM Users] UNFILLED CONTAINER SUBSCRIBE

Sun Sep 28 15:55:50 CDT 2014

The unfilled subscribe message occurs when there's an unfilled dependency
on an array entry, e.g. if X[0] is read but not written.

The debug output has the logical names and array keys, e.g.
"ens_priors_transposed[0]", along with the source file/line number, e.g.
"aidi_EnKF:main():169:4".  Those are the ones to look at:

On Sun, Sep 28, 2014 at 2:01 PM, Ozik, Jonathan <jozik at anl.gov> wrote:

> Hello all,
>
> I’m getting UNFILLED CONTAINER SUBSCRIBE messages when running my script.
> Based on the error output below, is there a (relatively) easy way to track
> this down that you’d recommend?
>
> Jonathan
>
> WAITING WORK: 34
>               {16} params_to_priors-foreach-wait3  (/<37>:upf_lines
> (aidi_EnKF:params_to_priors():46:4)/)
>               {17} params_to_priors-foreach-wait5  (/<38>:aggNewIs
> (aidi_EnKF:params_to_priors():59:4)/)
>               {18} params_to_priors-call-size0
> (/<39>:ens_priors_transposed[0] (aidi_EnKF:params_to_priors():77:4)/)
>               {19} params_to_priors-call_foreign-size-1
> (/<39>:ens_priors_transposed (aidi_EnKF:params_to_priors():77:4)/)
>               {22} posteriors_to_params-call-size0  (/<27>:__t:67[0]
> (aidi_EnKF:main():186:5)/)
>               {27} priors_to_posteriors-call-size0  (/<25>:__t:61[0]
> (aidi_EnKF:main():184:8)/)
>               {28} priors_to_posteriors-call_foreign-size-1  (/<25>:__t:61
> (aidi_EnKF:main():184:8)/)
>               {29} priors_to_posteriors-call_sync-blob_from_floats
> (/<46>:one_dim_ens_priors (aidi_EnKF:priors_to_posteriors():123:1)/)
>               {30} shape_one_dim-async_op-minus_int  (/<44>:rows
> (aidi_EnKF:priors_to_posteriors():121:3)/)
>               {31} shape_one_dim-async_op-minus_int-1  (/<45>:cols
> (aidi_EnKF:priors_to_posteriors():122:1)/)
>               {32} flatten_two_dim-call-size0  (/<25>:__t:61[0]
> (aidi_EnKF:main():184:8)/)
>               {33} flatten_two_dim-call_foreign-size-1  (/<25>:__t:61
> (aidi_EnKF:main():184:8)/)
>               {34} posteriors_to_params-wait-range3  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {36} posteriors_to_params-wait-range3  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {44} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {45} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {46} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {47} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {48} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {49} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {50} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {51} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {52} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {53} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {54} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {55} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {56} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>               {57} posteriors_to_params-wait-range1  (/<43>:__t:6
> (aidi_EnKF:posteriors_to_params():138:30)/)
>              {535} params_to_priors-call_sync-string_join  (/<215>:ips
> (aidi_EnKF:params_to_priors():48:8)/)
>              {538} params_to_priors-call_sync-string_join  (/<217>:ips
> (aidi_EnKF:params_to_priors():48:8)/)
>              {551} params_to_priors-async_op-plus_int  (<218>:offset
> (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-14]
> (aidi_EnKF:main():169:4)/)
>              {552} params_to_priors-async_op-plus_int  (<218>:offset
> (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-13]
> (aidi_EnKF:main():169:4)/)
>              {553} params_to_priors-async_op-plus_int  (<216>:offset
> (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-14]
> (aidi_EnKF:main():169:4)/)
>              {554} params_to_priors-async_op-plus_int  (<216>:offset
> (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-13]
> (aidi_EnKF:main():169:4)/)
> UNFILLED CONTAINER SUBSCRIBE <27>:__t:67[0] (aidi_EnKF:main():186:5) rank:
> 2 work_type: 0
> UNFILLED CONTAINER SUBSCRIBE <14>:float_var_names[-13]
> (aidi_EnKF:main():169:4) rank: 2 work_type: 0
> UNFILLED CONTAINER SUBSCRIBE <25>:__t:61[0] (aidi_EnKF:main():184:8) rank:
> 2 work_type: 0
> UNFILLED CONTAINER SUBSCRIBE <14>:float_var_names[-14]
> (aidi_EnKF:main():169:4) rank: 2 work_type: 0
> UNFILLED CONTAINER SUBSCRIBE <39>:ens_priors_transposed[0]
> (aidi_EnKF:params_to_priors():77:4) rank: 2 work_type: 0
> FAILED: EXIT(1)
>
>
> ===================================================================================
> =   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
> =   PID 66444 RUNNING AT XioMBP.local
> =   EXIT CODE: 1
> =   CLEANING UP REMAINING PROCESSES
> =   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
>
> ===================================================================================
> _______________________________________________
> ExM-user mailing list
> ExM-user at lists.mcs.anl.gov
> https://lists.mcs.anl.gov/mailman/listinfo/exm-user
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/exm-user/attachments/20140928/caacd6d6/attachment.html>