[Swift-devel] Concurrent dostagein calls limited to 8 ?

[Michael Wilde]

Justin pointed me at the function vdl:getprofile, but this does not seem to contain the same attributes as the pool entry. WHen I call:

  vdl:siteprofile(desthost,"workdirectory")

I get:

Execution failed:
        Exception in cp:
Arguments: [etc/group, home/wilde/godata/gridoutput.txt]
Host: localhost
Directory: gcat-20101115-2005-kh054dx8/jobs/1/cp-1uu8rn1k
stderr.txt:

stdout.txt:

----

Caused by:
        Missing profile: workdirectory
login1$ cat sites.xml

<!-- Local execution in the given workspace -->

<config>

  <pool handle="localhost" sysinfo="INTEL32::LINUX">
    <gridftp url="local://localhost" />
    <execution provider="local" url="none" />
    <workdirectory>/home/wilde/swift/lab/go/work</workdirectory>
  </pool>

</config>

--- Mike


----- Original Message -----
> > >...do you have anything "quick and easy" in mind there?
> >
> > Yep. Say task:execute(script, args) in vdl-int instead.
> 
> OK, that looks very promising and works for me in simple .k tests.
> 
> Can you tell me how to pluck the workdir out of the host description
> from within vdl-int.k?
> 
> (I will hunt for this but clues are welcome :)
> 
> Thanks,
> 
> - Mike
> 
> 
> ----- Original Message -----
> > On Sun, 2010-11-14 at 23:24 -0600, Michael Wilde wrote:
> > > That explains a lot - the limited number of Karajan threads
> > > probably
> > > explains why coasters goes haywire in the larger tests as well.
> > >
> > > Clearly this should be done as full fledged provider. But that
> > > will
> > > take a fair bit more work.
> > >
> > > Would there be any ill effects from bumping up the number of
> > > karajan
> > > threads to see if I can make this demo work? WHere is that set?
> >
> > There will be the ill effect of wasting memory to wait for stuff.
> > It's
> > set in EventBus.java.
> >
> > >
> > > Also, when you say "use the local provider or
> > > > some other scheme that can free the workers while the
> > > > sub-processes
> > > > run." - do you have anything "quick and easy" in mind there?
> >
> > Yep. Say task:execute(script, args) in vdl-int instead.
> >
> > Mihael
> 
> --
> Michael Wilde
> Computation Institute, University of Chicago
> Mathematics and Computer Science Division
> Argonne National Laboratory
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory