[Swift-devel] hanging problem
Jonathan Monette
jon.monette at gmail.com
Sun Mar 27 20:59:01 CDT 2011
By simply changing foreach img, i in stats to foreach img, i in diff_imgs I
get the output below.
RunID: 20110327-2014-gnzxh45g
(input): found 10 files
Progress: time:0
original callback URI is http://169.254.95.119:44421
callback URI has been overridden to http://192.5.86.6:44421
Adjusting buffer size to 786432
Adjusting buffer size to 524288
Adjusting buffer size to 314368
Progress: time:6284 Submitted:9 Active:1
Adjusting buffer size to 224256
Progress: time:7346 Submitted:2 Active:8
Adjusting buffer size to 156672
Progress: time:8894 Active:2 Checking status:1 Finished successfully:7
Progress: time:9907 Submitted:16 Active:2 Finished successfully:12
[org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000630 type Status with no value at
dataset=stats path=[0] (not closed),org.griphyn.vdl.mapping.DataNode
identifier dataset:20110327-2014-u3tv8xt3:720000000636 type Status with no
value at dataset=stats path=[1] (not
closed),org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000621 type Status with no value at
dataset=stats path=[2] (not closed),org.griphyn.vdl.mapping.DataNode
identifier dataset:20110327-2014-u3tv8xt3:720000000600 type Status with no
value at dataset=stats path=[3] (not
closed),org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000606 type Status with no value at
dataset=stats path=[4] (not closed),org.griphyn.vdl.mapping.DataNode
identifier dataset:20110327-2014-u3tv8xt3:720000000609 type Status with no
value at dataset=stats path=[5] (not
closed),org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000603 type Status with no value at
dataset=stats path=[6] (not closed),org.griphyn.vdl.mapping.DataNode
identifier dataset:20110327-2014-u3tv8xt3:720000000618 type Status with no
value at dataset=stats path=[7] (not
closed),org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000627 type Status with no value at
dataset=stats path=[8] (not closed),org.griphyn.vdl.mapping.DataNode
identifier dataset:20110327-2014-u3tv8xt3:720000000639 type Status with no
value at dataset=stats path=[9] (not
closed),org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000643 type Status with no value at
dataset=stats path=[10] (not closed),org.griphyn.vdl.mapping.DataNode
identifier dataset:20110327-2014-u3tv8xt3:720000000597 type Status with no
value at dataset=stats path=[11] (not
closed),org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000642 type Status with no value at
dataset=stats path=[12] (not closed),org.griphyn.vdl.mapping.DataNode
identifier dataset:20110327-2014-u3tv8xt3:720000000624 type Status with no
value at dataset=stats path=[13] (not
closed),org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000633 type Status with no value at
dataset=stats path=[14] (not closed),org.griphyn.vdl.mapping.DataNode
identifier dataset:20110327-2014-u3tv8xt3:720000000612 type Status with no
value at dataset=stats path=[15] (not
closed),org.griphyn.vdl.mapping.DataNode identifier
dataset:20110327-2014-u3tv8xt3:720000000615 type Status with no value at
dataset=stats path=[16] (not closed)]
Progress: time:11194 Submitted:24 Active:9 Checking status:1 Finished
successfully:30
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000005.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000007.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000002.000007.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000007.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000001.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000006.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000001.000002.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000004.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000007.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000004.000005.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000007.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000002.000007.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000003.000004.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000001.000008.fits.
Progress: time:12197 Stage in:1 Submitted:10 Active:6 Finished
successfully:46 Failed but can retry:1
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000001.000002.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000004.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000006.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000007.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000007.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000004.000005.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000002.000007.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000001.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000003.000004.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000001.000002.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000004.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000006.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000002.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000004.000005.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000008.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000002.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000003.000004.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000003.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000005.000006.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000005.fits.
Progress: time:13207 Submitted:1 Active:6 Checking status:1 Finished
successfully:47 Failed but can retry:9
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000002.000008.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000008.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000006.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000005.000006.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000003.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000005.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000008.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000003.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000000.000009.fits.
The cache already contains
pads:m101_montage-20110327-2014-gnzxh45g/shared/stat_dir/stat.diff.000005.000006.fits.
No events in 10s.
Badness
Registered futures:
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
Table corrections_tbl - Open, 1 listeners
Image diff_img - Closed, no listeners
Image[] corrected_images Open, 1 listeners
Table fits_images_tbl - Open, 1 listeners
Table difference_tbl - Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
Image proj_img - Closed, no listeners
Image proj_img - Closed, no listeners
BackgroundStruct[] back_struct Open, 0 elements, 1 listeners
Status stats - Closed, no listeners
Status[] stats Closed, no listeners
Image[] projected_images Closed, no listeners
Image proj_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image[] difference_images Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image corrected_mos - Open, 1 listeners
Table status_tbl - Closed, no listeners
Image diff_img - Closed, no listeners
Table back_list - Open, 1 listeners
Image proj_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
DiffStruct[] diffs Closed, 17 elements, 0 listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
string swift#mapper#17028 Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
Image proj_1 - Closed, no listeners
Table images_tbl - Closed, no listeners
----
Waiting threads:
0-8-1
0-6-3
0-9
0-8-2
0-10
0-8-0
0-7
0-5-2
----
Progress: time:30007 Finished successfully:47 Failed but can retry:17
No events in 10s.
Badness
Registered futures:
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
Table corrections_tbl - Open, 1 listeners
Image diff_img - Closed, no listeners
Image[] corrected_images Open, 1 listeners
Table fits_images_tbl - Open, 1 listeners
Table difference_tbl - Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
Image proj_img - Closed, no listeners
Image proj_img - Closed, no listeners
BackgroundStruct[] back_struct Open, 0 elements, 1 listeners
Status stats - Closed, no listeners
Status[] stats Closed, no listeners
Image[] projected_images Closed, no listeners
Image proj_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image[] difference_images Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image corrected_mos - Open, 1 listeners
Table status_tbl - Closed, no listeners
Image diff_img - Closed, no listeners
Table back_list - Open, 1 listeners
Image proj_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
DiffStruct[] diffs Closed, 17 elements, 0 listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
string swift#mapper#17028 Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image diff_img - Closed, no listeners
Image proj_img - Closed, no listeners
Image proj_1 - Closed, no listeners
Table images_tbl - Closed, no listeners
----
Waiting threads:
0-8-1
0-6-3
0-9
0-8-2
0-10
0-8-0
0-7
0-5-2
----
What does it mean that something is in the cache?
On Sun, Mar 27, 2011 at 8:16 PM, Jonathan Monette <jon.monette at gmail.com>wrote:
> Ok. I understand.
>
>
> On Sun, Mar 27, 2011 at 8:13 PM, Mihael Hategan <hategan at mcs.anl.gov>wrote:
>
>> Let me be clear. I don't think that's your problem. That is simply a
>> matter of, perhaps, style. I found it unclear. It doesn't say what it
>> does.
>>
>> On Sun, 2011-03-27 at 20:10 -0500, Jonathan Monette wrote:
>> > This makes sense syntactically but I am guessing the internal logic
>> > does not like this so is this something that Swift shouldn't do or
>> > something that Swift should do but is just broken?
>> >
>> > On Sun, Mar 27, 2011 at 8:05 PM, Jonathan Monette
>> > <jon.monette at gmail.com> wrote:
>> > Yea. I use the foreach loop because I need to iterate through
>> > the diff_imgs array and run an app on each of the entries.
>> > The loop runs and completes and all the files in stats are
>> > mapped and have data they are just not being closed. So is
>> > there a better way of accomplishing what I am doing in Swift?
>> >
>> >
>> >
>> >
>> > On Sun, Mar 27, 2011 at 8:02 PM, Daniel S. Katz
>> > <dsk at ci.uchicago.edu> wrote:
>> > Can you suggest how this should be done?
>> >
>> > Dan
>> >
>> >
>> >
>> > On Mar 27, 2011, at 8:00 PM, Mihael Hategan wrote:
>> >
>> > > Well, you seem to be iterating over an array that
>> > you are trying to
>> > > build inside the iteration, and you are not doing a
>> > fold. It's somewhat
>> > > coincidental that it works, probably because stats
>> > is mapped by a static
>> > > mapper and you don't actually use the value ("img").
>> > >
>> > > Though I see what you are trying to do. And it
>> > should either work or
>> > > fail nicely. So I'll see if I can make a simple test
>> > case out of this.
>> > >
>> > > Mihael
>> > >
>> > > On Sun, 2011-03-27 at 19:43 -0500, Jonathan Monette
>> > wrote:
>> > >> stats is an array mapped to several files in a
>> > directory of metadata
>> > >> generated by mFitplane. I need to pass all these
>> > files and another
>> > >> metadata file to mConcatFit which is the app after
>> > this foreach loop.
>> > >> I need to wait for the foreach loop to be complete
>> > before mConcatFit
>> > >> can run.
>> > >>
>> > >> On Sun, Mar 27, 2011 at 7:41 PM, Mihael Hategan
>> > <hategan at mcs.anl.gov>
>> > >> wrote:
>> > >> You have:
>> > >> foreach img, i in stats
>> > >> {
>> > >> stats[ i ] = mFitplane
>> > ( diff_imgs[i] );
>> > >> }
>> > >>
>> > >>
>> > >> What is it that you are trying to do there?
>> > >>
>> > >> Mihael
>> > >>
>> > >>
>> > >> On Sun, 2011-03-27 at 15:54 -0500, Jonathan
>> > Monette wrote:
>> > >>> here is my entire script
>> > >>>
>> > >>> On Sun, Mar 27, 2011 at 3:45 PM, Mihael Hategan
>> > >> <hategan at mcs.anl.gov>
>> > >>> wrote:
>> > >>> On Wed, 2011-03-23 at 16:31 -0500, Jonathan
>> > Monette
>> > >> wrote:
>> > >>>
>> > >>>> How can the array be closed but all of its values
>> > >> not be?
>> > >>>
>> > >>>
>> > >>> The array being closed simply means that
>> > its size is
>> > >> known,
>> > >>> but not
>> > >>> necessarily that its elements have all been
>> > >> computed.
>> > >>>
>> > >>> I'll look at the log, but I'd also like the
>> > entire
>> > >> script.
>> > >>>
>> > >>> Mihael
>> > >>>
>> > >>>
>> > >>>
>> > >>>
>> > >>>
>> > >>> --
>> > >>> Any intelligent fool can make things bigger and
>> > more
>> > >> complex... It
>> > >>> takes a touch of genius - and a lot of courage to
>> > move in
>> > >> the opposite
>> > >>> direction.
>> > >>> - Albert Einstein
>> > >>>
>> > >>>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >>
>> > >> --
>> > >> Any intelligent fool can make things bigger and
>> > more complex... It
>> > >> takes a touch of genius - and a lot of courage to
>> > move in the opposite
>> > >> direction.
>> > >> - Albert Einstein
>> > >>
>> > >>
>> > >
>> > >
>> >
>> > > _______________________________________________
>> > > Swift-devel mailing list
>> > > Swift-devel at ci.uchicago.edu
>> > >
>> >
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>> >
>> > --
>> > Daniel S. Katz
>> > University of Chicago
>> > (773) 834-7186 (voice)
>> > (773) 834-3700 (fax)
>> > d.katz at ieee.org or dsk at ci.uchicago.edu
>> > http://www.ci.uchicago.edu/~dsk/
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > --
>> >
>> > Any intelligent fool can make things bigger and more
>> > complex... It takes a touch of genius - and a lot of courage
>> > to move in the opposite direction.
>> > - Albert Einstein
>> >
>> >
>> >
>> >
>> >
>> >
>> > --
>> > Any intelligent fool can make things bigger and more complex... It
>> > takes a touch of genius - and a lot of courage to move in the opposite
>> > direction.
>> > - Albert Einstein
>> >
>> >
>>
>>
>>
>
>
> --
> Any intelligent fool can make things bigger and more complex... It takes a
> touch of genius - and a lot of courage to move in the opposite direction.
> - Albert Einstein
>
>
>
--
Any intelligent fool can make things bigger and more complex... It takes a
touch of genius - and a lot of courage to move in the opposite direction.
- Albert Einstein
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110327/38737936/attachment.html>
More information about the Swift-devel
mailing list