[Swift-user] throttling mapping threads

[Allan Espinosa]

Aha!  I just delegated my mapper to an app function + readdata
incantation.  Hopefully this will work

-Allan

On Lun, 2010-04-12 at 16:11 -0500, Allan Espinosa wrote:
> I have tried caching queries and still had problems.  I just made a C
> version of my mapper because i thought invoking the interpreter might be
> too much; still had problems. 
> 
> I guess i'll now limit the foreach.max.threads then...
> -Allan
> 
> On Sab, 2010-04-10 at 00:45 -0500, Allan Espinosa wrote:
> > Oh well...
> > 
> > Yeah, I'm actually working on caching the queries somewhere (via memcache)
> > 
> > Thanks!
> > -Allan
> > 
> > 2010/4/10 Mihael Hategan <hategan at mcs.anl.gov>:
> > > On Sat, 2010-04-10 at 00:30 -0500, Allan Espinosa wrote:
> > >> Hi,
> > >>
> > >> How do you throttle the number of mapping threads like
> > >> foreach.max.threads ?  I have this workflow whose mapper accesses a
> > >> mysql database that makes a 400+ access at a time.
> > >
> > > There is no throttling for those unfortunately.
> > >
> > > Any way you can bulk the mapping invocations?