[Swift-devel] Data-aware scheduling in Swift ?

[Justin M Wozniak]

Right, this feature would require changes to Coasters.

In the Coasters internal abstraction, a worker Cpu requests work from the 
queue manager.  Coasters currently only uses two criteria to select the 
job: wall time and, if MPI is used, the MPI process count.  For this task, 
we would add in a selector based on information about file locations.

Do we have scripts/numbers for the difference between a local MosaStore 
access and a remote access?

 	Justin

On Thu, 29 Mar 2012, Jonathan Monette wrote:

> I believe that Swift will schedule true work on any node that becomes 
> available for work. It does not give preference to a node for to take 
> advantage of data locality.
>
> As far as I know there is no way to configure Swift to use data aware 
> scheduling. This is Swift's default behavior.
>
> On Mar 29, 2012, at 10:59, Emalayan Vairavanathan <svemalayan at yahoo.com> wrote:
>
>> Hi All,
>>
>> I have a question about how swift schedules computations.
>>
>> Suppose there are two computation stages namely Stage-A and Stage-B in 
>> an application. Stage-A produces the data and Stage-B consumes the data 
>> . Could you please tell me how swift schedules these computations? Does 
>> it schedules Stage-A and Stage-B on the same node or on multiple nodes? 
>> Is it possible to configure the swift to schedules these computations 
>> on the same node (or is this the default behavior of swift ) ?
>>
>>
>> Thank you
>> Emalayan
>>
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>

-- 
Justin M Wozniak