[Swift-devel] scheduling

[Vipul Kumar Singh]

We can use Size of data on which job is dependent to determine if it is data
incentive, and instead of having a fixed Size to determine we can make it
adapt based on the situations like.. in case rate of jobs being submitted is
increasing but so is the idle resource pool then the Size limit has to be
raised so that jobs are assigned to new resources and if in case rate of job
submission is going down but idle resource pool is decreasing or remains
constant the Size can be increased... or we can monitor the data transfers
if they are above some threshold Size can be decreased and vice-versa ...

On Sat, Mar 20, 2010 at 2:16 AM, Ioan Raicu <iraicu at cs.uchicago.edu> wrote:

>  For data intensive workloads, it usually is. The question is how do you
> determine "overloaded", and "data-intensive"?
>
> Ioan
>
> Mihael Hategan wrote:
>
> On Sat, 2010-03-20 at 01:57 +0530, Vipul Kumar Singh wrote:
>
>
>                 (iii) When scheduling new jobs, the scheduler looks
> through the hash and schedules new job to the resource that has data
> on which new job is dependent (If the resource is not already
> overloaded).
>
>
>  Is that always the best choice?
>
> Mihael
>
> _______________________________________________
> Swift-devel mailing listSwift-devel at ci.uchicago.eduhttp://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>
>
> --
> =================================================================
> Ioan Raicu, Ph.D.
> NSF/CRA Computing Innovation Fellow
> =================================================================
> Center for Ultra-scale Computing and Information Security (CUCIS)
> Department of Electrical Engineering and Computer Science
> Northwestern University
> 2145 Sheridan Rd, Tech M384
> Evanston, IL 60208-3118
> =================================================================
> Cel:   1-847-722-0876
> Tel:   1-847-491-8163
> Email: iraicu at eecs.northwestern.edu
> Web:   http://www.eecs.northwestern.edu/~iraicu/ <http://www.eecs.northwestern.edu/%7Eiraicu/>
>        https://wiki.cucis.eecs.northwestern.edu/
> =================================================================
> =================================================================
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20100320/c05f7247/attachment.html>