[Swift-devel] How does swift know if a task is successful
Ben Clifford
benc at hawaga.org.uk
Wed Mar 18 09:37:01 CDT 2009
On Wed, 18 Mar 2009, Zhao Zhang wrote:
> To solve this problem, we built a P2P data network on BGP over torus network.
> So the basic logic for this is
> that if a wrapper.sh found a piece of intermediate data, it registered this
> data with (name, rank of the CN) to a
> Centralized Hash Table(CHT). Next time, when a job needs this data, first it
> looks this data up in CHT, gets
> the rank of the remote node, convert the RANK to IP, fetch the data directly.
I don't see any of that in the wrapper.sh that you just sent me. I see
input and output files moved around with cp and dd using posix fs access.
--
More information about the Swift-devel
mailing list