[Swift-devel] Swift data distribution strategy

[Allan Espinosa]

Hi Zhao,

the input files are copies on demand as jobs get dispatched.  (i think)

-Allan

On Thu, Feb 12, 2009 at 1:23 PM, Zhao Zhang <zhaozhang at uchicago.edu> wrote:
> Hi,
>
> I got a problem when I do a 512-compute node scale test.
> There are 15351 input files for this computation, and there are 8 sites.
> The question is: when I start swift, are all 15351 input files be copied to
> each of the 8 sites?
>
> By by test, it is yes. Does swift has an option so that only on demand input
> files are copied?
>
> best wishes
> zhangzhao