[Swift-devel] Re: Heap space being exhausted

Mihael Hategan hategan at mcs.anl.gov
Wed Jun 2 19:27:24 CDT 2010


On Wed, 2010-06-02 at 19:03 -0500, Allan Espinosa wrote:
> My Cybershake workflow.  its basically a 2 level for loop with varying
> inner  loop sizes.
> 
> foreach i in (~4k elements) {
>   x = f();
>   foreach (20-2k elements) {
>      ...
>  }
> }

Yep. You have a winner. Max threads = 1024 * 1024.

You should adjust that parameter accordingly. I.e. foreach.max.threads =
sqrt(maxTotalThreads).

> 
> 2010/6/2 Mihael Hategan <hategan at mcs.anl.gov>:
> > On Wed, 2010-06-02 at 18:40 -0500, Allan Espinosa wrote:
> >> I tried a HEAPMAX of 4GB.
> >>
> >> No memory problems so far :)
> >
> > Still odd. What's the swift script?
> >
> > I'm asking because foreach.max.threads should work, but it applies to
> > each individual foreach rather than globally.
> >
> >>
> >> 2010/6/2 Mihael Hategan <hategan at mcs.anl.gov>:
> >> > On Wed, 2010-06-02 at 17:47 -0500, Mihael Hategan wrote:
> >> >> On Wed, 2010-06-02 at 17:32 -0500, Allan Espinosa wrote:
> >> >> > btw
> >> >> >
> >> >> > foreach.maxthreads=1024
> >> >>
> >> >> or more heapmax.
> >> >
> >> > Ehm, I though you found a solution :)
> >> >
> >> > What's the swift script?
> >





More information about the Swift-devel mailing list