[Swift-devel] Concurrent dostagein calls limited to 8 ?

Mihael Hategan hategan at mcs.anl.gov
Sun Nov 14 17:45:36 CST 2010


On Sun, 2010-11-14 at 17:23 -0600, Michael Wilde wrote:
> Some answers from my handheld:
> - foreach loop has 317 files so ample parallelism

I would have assumed it's > 8. But I suspect, given one of the answers
below, that it does not matter.

> - throttle in sites entry set to .63 to run 64 jobs at once
> - the "active" external.sh is called from end of dostagein and
> dostageout in vdl-int.k (after all files for the job were put in a
> list by prior calls to externa.sh from within those functions

How is this call actually implemented. I.e. can you post the respective
snippet of vdl-int?

> - the actual staging op by globusonline take 30-60 seconds, sometimes
> more. I batch them up.





More information about the Swift-devel mailing list