[ExM Users] UNFILLED CONTAINER SUBSCRIBE
Ozik, Jonathan
jozik at anl.gov
Mon Sep 29 09:39:56 CDT 2014
Thanks Tim. I was able to track down the issue.
Jonathan
On Sep 28, 2014, at 3:58 PM, Tim Armstrong <tim.g.armstrong at gmail.com<mailto:tim.g.armstrong at gmail.com>> wrote:
Sorry, original response was cut short.
The unfilled subscribe message occurs when there's an unfilled dependency on an array entry, e.g. if X[0] is read but not written.
The debug output has the logical names and array keys, e.g. "ens_priors_transposed[0]", along with the source file/line number, e.g. "aidi_EnKF:main():169:4". Variables with names like __t:61 are compiler-generated temporary variables that store an intermediate result. The line number can help narrow down the location.
So I'd start with investigating why these array keys aren't assigned:
float_var_names[-13] (aidi_EnKF:main():169:4)
loat_var_names[-14] (aidi_EnKF:main():169:4)
ens_priors_transposed[0] (aidi_EnKF:params_to_priors():77:4)
- Tim
On Sun, Sep 28, 2014 at 3:55 PM, Tim Armstrong <tim.g.armstrong at gmail.com<mailto:tim.g.armstrong at gmail.com>> wrote:
The unfilled subscribe message occurs when there's an unfilled dependency on an array entry, e.g. if X[0] is read but not written.
The debug output has the logical names and array keys, e.g. "ens_priors_transposed[0]", along with the source file/line number, e.g. "aidi_EnKF:main():169:4". Those are the ones to look at:
On Sun, Sep 28, 2014 at 2:01 PM, Ozik, Jonathan <jozik at anl.gov<mailto:jozik at anl.gov>> wrote:
Hello all,
I’m getting UNFILLED CONTAINER SUBSCRIBE messages when running my script. Based on the error output below, is there a (relatively) easy way to track this down that you’d recommend?
Jonathan
WAITING WORK: 34
{16} params_to_priors-foreach-wait3 (/<37>:upf_lines (aidi_EnKF:params_to_priors():46:4)/)
{17} params_to_priors-foreach-wait5 (/<38>:aggNewIs (aidi_EnKF:params_to_priors():59:4)/)
{18} params_to_priors-call-size0 (/<39>:ens_priors_transposed[0] (aidi_EnKF:params_to_priors():77:4)/)
{19} params_to_priors-call_foreign-size-1 (/<39>:ens_priors_transposed (aidi_EnKF:params_to_priors():77:4)/)
{22} posteriors_to_params-call-size0 (/<27>:__t:67[0] (aidi_EnKF:main():186:5)/)
{27} priors_to_posteriors-call-size0 (/<25>:__t:61[0] (aidi_EnKF:main():184:8)/)
{28} priors_to_posteriors-call_foreign-size-1 (/<25>:__t:61 (aidi_EnKF:main():184:8)/)
{29} priors_to_posteriors-call_sync-blob_from_floats (/<46>:one_dim_ens_priors (aidi_EnKF:priors_to_posteriors():123:1)/)
{30} shape_one_dim-async_op-minus_int (/<44>:rows (aidi_EnKF:priors_to_posteriors():121:3)/)
{31} shape_one_dim-async_op-minus_int-1 (/<45>:cols (aidi_EnKF:priors_to_posteriors():122:1)/)
{32} flatten_two_dim-call-size0 (/<25>:__t:61[0] (aidi_EnKF:main():184:8)/)
{33} flatten_two_dim-call_foreign-size-1 (/<25>:__t:61 (aidi_EnKF:main():184:8)/)
{34} posteriors_to_params-wait-range3 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{36} posteriors_to_params-wait-range3 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{44} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{45} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{46} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{47} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{48} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{49} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{50} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{51} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{52} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{53} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{54} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{55} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{56} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{57} posteriors_to_params-wait-range1 (/<43>:__t:6 (aidi_EnKF:posteriors_to_params():138:30)/)
{535} params_to_priors-call_sync-string_join (/<215>:ips (aidi_EnKF:params_to_priors():48:8)/)
{538} params_to_priors-call_sync-string_join (/<217>:ips (aidi_EnKF:params_to_priors():48:8)/)
{551} params_to_priors-async_op-plus_int (<218>:offset (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-14] (aidi_EnKF:main():169:4)/)
{552} params_to_priors-async_op-plus_int (<218>:offset (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-13] (aidi_EnKF:main():169:4)/)
{553} params_to_priors-async_op-plus_int (<216>:offset (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-14] (aidi_EnKF:main():169:4)/)
{554} params_to_priors-async_op-plus_int (<216>:offset (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-13] (aidi_EnKF:main():169:4)/)
UNFILLED CONTAINER SUBSCRIBE <27>:__t:67[0] (aidi_EnKF:main():186:5) rank: 2 work_type: 0
UNFILLED CONTAINER SUBSCRIBE <14>:float_var_names[-13] (aidi_EnKF:main():169:4) rank: 2 work_type: 0
UNFILLED CONTAINER SUBSCRIBE <25>:__t:61[0] (aidi_EnKF:main():184:8) rank: 2 work_type: 0
UNFILLED CONTAINER SUBSCRIBE <14>:float_var_names[-14] (aidi_EnKF:main():169:4) rank: 2 work_type: 0
UNFILLED CONTAINER SUBSCRIBE <39>:ens_priors_transposed[0] (aidi_EnKF:params_to_priors():77:4) rank: 2 work_type: 0
FAILED: EXIT(1)
===================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= PID 66444 RUNNING AT XioMBP.local
= EXIT CODE: 1
= CLEANING UP REMAINING PROCESSES
= YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
_______________________________________________
ExM-user mailing list
ExM-user at lists.mcs.anl.gov<mailto:ExM-user at lists.mcs.anl.gov>
https://lists.mcs.anl.gov/mailman/listinfo/exm-user
_______________________________________________
ExM-user mailing list
ExM-user at lists.mcs.anl.gov<mailto:ExM-user at lists.mcs.anl.gov>
https://lists.mcs.anl.gov/mailman/listinfo/exm-user
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/exm-user/attachments/20140929/100f99fa/attachment.html>
More information about the ExM-user
mailing list