[Swift-user] throttling mapping threads

Allan Espinosa aespinosa at cs.uchicago.edu
Mon Apr 12 16:11:01 CDT 2010


I have tried caching queries and still had problems.  I just made a C
version of my mapper because i thought invoking the interpreter might be
too much; still had problems. 

I guess i'll now limit the foreach.max.threads then...
-Allan

On Sab, 2010-04-10 at 00:45 -0500, Allan Espinosa wrote:
> Oh well...
> 
> Yeah, I'm actually working on caching the queries somewhere (via memcache)
> 
> Thanks!
> -Allan
> 
> 2010/4/10 Mihael Hategan <hategan at mcs.anl.gov>:
> > On Sat, 2010-04-10 at 00:30 -0500, Allan Espinosa wrote:
> >> Hi,
> >>
> >> How do you throttle the number of mapping threads like
> >> foreach.max.threads ?  I have this workflow whose mapper accesses a
> >> mysql database that makes a 400+ access at a time.
> >
> > There is no throttling for those unfortunately.
> >
> > Any way you can bulk the mapping invocations?
> >
> >
> >





More information about the Swift-user mailing list