[Swift-user] throttling mapping threads
Allan Espinosa
aespinosa at cs.uchicago.edu
Mon Apr 12 16:11:01 CDT 2010
I have tried caching queries and still had problems. I just made a C
version of my mapper because i thought invoking the interpreter might be
too much; still had problems.
I guess i'll now limit the foreach.max.threads then...
-Allan
On Sab, 2010-04-10 at 00:45 -0500, Allan Espinosa wrote:
> Oh well...
>
> Yeah, I'm actually working on caching the queries somewhere (via memcache)
>
> Thanks!
> -Allan
>
> 2010/4/10 Mihael Hategan <hategan at mcs.anl.gov>:
> > On Sat, 2010-04-10 at 00:30 -0500, Allan Espinosa wrote:
> >> Hi,
> >>
> >> How do you throttle the number of mapping threads like
> >> foreach.max.threads ? I have this workflow whose mapper accesses a
> >> mysql database that makes a 400+ access at a time.
> >
> > There is no throttling for those unfortunately.
> >
> > Any way you can bulk the mapping invocations?
> >
> >
> >
More information about the Swift-user
mailing list