[Swift-devel] scheduling
Vipul Kumar Singh
vipulkrsingh at gmail.com
Fri Mar 19 15:27:05 CDT 2010
Sir,
I am interested in working on the data-aware features in swift on two major
points
1) For jobs dependent on same data, scheduler tries to schedule them to same
resources.
(i) The scheduler maintains a hash containing information
about (a) data files, (b) jobs dependent on that data and (c) resources
that are executing (or scheduled to execute) those jobs.
(ii) The information will be updated every time a job is
finished (on success/failure).
(iii) When scheduling new jobs, the scheduler looks through
the hash and schedules new job to the resource that has data on which new
job is dependent (If the resource is not already overloaded).
2) Combining the tasks together that are dependent on same data files,
before scheduling. And i believe this can be added quickly using coasters (
or is the feature already there... ).
Currently i have setup some machines with globus and swift but am not able
to get swift submit jobs through gram4.....
Vipul Kumar Singh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20100320/2edae999/attachment.html>
More information about the Swift-devel
mailing list