[Swift-devel] block allocation
Zhao Zhang
zhaozhang at uchicago.edu
Tue May 26 14:05:00 CDT 2009
Hi, Mihael
I read through the new content about coaster in user guide. Here I got
several questions:
Given the following case: we have 100 jobs, 5 worker nodes, and each
worker node has 4 cores, which means
we have 4 workers on each node.
The profile key "Slot", it is defined as "How many maximum LRM
jobs/worker blocks are allowed".
Correct me if my understanding is incorrect. In the above case, 100
jobs/5 nodes/4 workers=5 jobs/worker
So if we set "Slot" to 4, this above test case won't finish because 5 is
going out of the bound 4. Is this correct?
Also, could you point me to a sites.xml definition you used for the
local test? That will be helpful for me to get
the ideas. Thanks.
best wishes
zhao
Mihael Hategan wrote:
> I committed the block allocation code I had. Here's a quick status:
>
> - I tested it locally, alone, and with swift.
> - Not tested on a cluster (my jobs just sat in the queue on TP and TGUC,
> so I got bored and killed it).
> - I updated the documentation on the profile entries, but there are
> permission problems when I try to deploy it.
> - I don't think jobs are cleaned properly if an early abort is done, so
> be sure to check the queue and manually clean up if needed.
> - Exercise caution in general. It's new stuff, and things may go bad. So
> please keep an eye on the resources used and report misbehavior.
> - There is no mechanism to specify a static allocation. This is due to
> me giving it a low priority for this particular iteration of the code,
> and not because I hate globus.
>
> Mihael
>
> PS: On the topic of static allocations, in people's experience, how does
> one specify reservations on various resources?
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>
>
More information about the Swift-devel
mailing list