[ExM Users] UNFILLED CONTAINER SUBSCRIBE
Tim Armstrong
tim.g.armstrong at gmail.com
Sun Sep 28 15:58:53 CDT 2014
Sorry, original response was cut short.
The unfilled subscribe message occurs when there's an unfilled dependency
on an array entry, e.g. if X[0] is read but not written.
The debug output has the logical names and array keys, e.g.
"ens_priors_transposed[0]", along with the source file/line number, e.g.
"aidi_EnKF:main():169:4". Variables with names like __t:61 are
compiler-generated temporary variables that store an intermediate result.
The line number can help narrow down the location.
So I'd start with investigating why these array keys aren't assigned:
float_var_names[-13] (aidi_EnKF:main():169:4)
loat_var_names[-14] (aidi_EnKF:main():169:4)
ens_priors_transposed[0] (aidi_EnKF:params_to_priors():77:4)
- Tim
On Sun, Sep 28, 2014 at 3:55 PM, Tim Armstrong <tim.g.armstrong at gmail.com>
wrote:
> The unfilled subscribe message occurs when there's an unfilled dependency
> on an array entry, e.g. if X[0] is read but not written.
>
> The debug output has the logical names and array keys, e.g.
> "ens_priors_transposed[0]", along with the source file/line number, e.g.
> "aidi_EnKF:main():169:4". Those are the ones to look at:
>
>
> On Sun, Sep 28, 2014 at 2:01 PM, Ozik, Jonathan <jozik at anl.gov> wrote:
>
>> Hello all,
>>
>> I’m getting UNFILLED CONTAINER SUBSCRIBE messages when running my script.
>> Based on the error output below, is there a (relatively) easy way to track
>> this down that you’d recommend?
>>
>> Jonathan
>>
>> WAITING WORK: 34
>> {16} params_to_priors-foreach-wait3 (/<37>:upf_lines
>> (aidi_EnKF:params_to_priors():46:4)/)
>> {17} params_to_priors-foreach-wait5 (/<38>:aggNewIs
>> (aidi_EnKF:params_to_priors():59:4)/)
>> {18} params_to_priors-call-size0
>> (/<39>:ens_priors_transposed[0] (aidi_EnKF:params_to_priors():77:4)/)
>> {19} params_to_priors-call_foreign-size-1
>> (/<39>:ens_priors_transposed (aidi_EnKF:params_to_priors():77:4)/)
>> {22} posteriors_to_params-call-size0 (/<27>:__t:67[0]
>> (aidi_EnKF:main():186:5)/)
>> {27} priors_to_posteriors-call-size0 (/<25>:__t:61[0]
>> (aidi_EnKF:main():184:8)/)
>> {28} priors_to_posteriors-call_foreign-size-1
>> (/<25>:__t:61 (aidi_EnKF:main():184:8)/)
>> {29} priors_to_posteriors-call_sync-blob_from_floats
>> (/<46>:one_dim_ens_priors (aidi_EnKF:priors_to_posteriors():123:1)/)
>> {30} shape_one_dim-async_op-minus_int (/<44>:rows
>> (aidi_EnKF:priors_to_posteriors():121:3)/)
>> {31} shape_one_dim-async_op-minus_int-1 (/<45>:cols
>> (aidi_EnKF:priors_to_posteriors():122:1)/)
>> {32} flatten_two_dim-call-size0 (/<25>:__t:61[0]
>> (aidi_EnKF:main():184:8)/)
>> {33} flatten_two_dim-call_foreign-size-1 (/<25>:__t:61
>> (aidi_EnKF:main():184:8)/)
>> {34} posteriors_to_params-wait-range3 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {36} posteriors_to_params-wait-range3 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {44} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {45} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {46} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {47} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {48} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {49} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {50} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {51} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {52} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {53} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {54} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {55} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {56} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {57} posteriors_to_params-wait-range1 (/<43>:__t:6
>> (aidi_EnKF:posteriors_to_params():138:30)/)
>> {535} params_to_priors-call_sync-string_join (/<215>:ips
>> (aidi_EnKF:params_to_priors():48:8)/)
>> {538} params_to_priors-call_sync-string_join (/<217>:ips
>> (aidi_EnKF:params_to_priors():48:8)/)
>> {551} params_to_priors-async_op-plus_int (<218>:offset
>> (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-14]
>> (aidi_EnKF:main():169:4)/)
>> {552} params_to_priors-async_op-plus_int (<218>:offset
>> (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-13]
>> (aidi_EnKF:main():169:4)/)
>> {553} params_to_priors-async_op-plus_int (<216>:offset
>> (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-14]
>> (aidi_EnKF:main():169:4)/)
>> {554} params_to_priors-async_op-plus_int (<216>:offset
>> (aidi_EnKF:params_to_priors():52:8) /<14>:float_var_names[-13]
>> (aidi_EnKF:main():169:4)/)
>> UNFILLED CONTAINER SUBSCRIBE <27>:__t:67[0] (aidi_EnKF:main():186:5)
>> rank: 2 work_type: 0
>> UNFILLED CONTAINER SUBSCRIBE <14>:float_var_names[-13]
>> (aidi_EnKF:main():169:4) rank: 2 work_type: 0
>> UNFILLED CONTAINER SUBSCRIBE <25>:__t:61[0] (aidi_EnKF:main():184:8)
>> rank: 2 work_type: 0
>> UNFILLED CONTAINER SUBSCRIBE <14>:float_var_names[-14]
>> (aidi_EnKF:main():169:4) rank: 2 work_type: 0
>> UNFILLED CONTAINER SUBSCRIBE <39>:ens_priors_transposed[0]
>> (aidi_EnKF:params_to_priors():77:4) rank: 2 work_type: 0
>> FAILED: EXIT(1)
>>
>>
>> ===================================================================================
>> = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
>> = PID 66444 RUNNING AT XioMBP.local
>> = EXIT CODE: 1
>> = CLEANING UP REMAINING PROCESSES
>> = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
>>
>> ===================================================================================
>> _______________________________________________
>> ExM-user mailing list
>> ExM-user at lists.mcs.anl.gov
>> https://lists.mcs.anl.gov/mailman/listinfo/exm-user
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/exm-user/attachments/20140928/a8c19a78/attachment-0001.html>
More information about the ExM-user
mailing list