[Swift-devel] How does swift know if a task is successful

Zhao Zhang zhaozhang at uchicago.edu
Wed Mar 18 09:59:53 CDT 2009


Oh, you want the wrapper.sh working with P2P data transfer? It is not 
implemented yet. I am still working on
basic APT for this wrapper.sh.

zhao

Ben Clifford wrote:
> On Wed, 18 Mar 2009, Zhao Zhang wrote:
>
>   
>> To solve this problem, we built a P2P data network on BGP over torus network.
>> So the basic logic for this is
>> that if a wrapper.sh found a piece of intermediate data, it registered this
>> data with (name, rank of the CN) to a
>> Centralized Hash Table(CHT). Next time, when a job needs this data, first it
>> looks this data up in CHT, gets
>> the rank of the remote node, convert the RANK to IP, fetch the data directly.
>>     
>
> I don't see any of that in the wrapper.sh that you just sent me. I see 
> input and output files moved around with cp and dd using posix fs access.
>
>   



More information about the Swift-devel mailing list