[Swift-devel] replication comment

Mihael Hategan hategan at mcs.anl.gov
Wed Aug 25 14:45:39 CDT 2010


Right. The replication scheme right now is completely independent of the
site information.

On Wed, 2010-08-25 at 14:42 -0400, Glen Hocky wrote:
> Further comment:
> trying 2 sites with replication limit=3 for 30 jobs resulted in 90
> jobs in the queue after (when none were starting for some reason)
> 
> 
> so there's a pigeonhole problem here somewhere since (i would think)
> for N sites you would want no more than N-1 replicas, one for each
> other site
> 
> On Wed, Aug 25, 2010 at 10:52 AM, Michael Wilde <wilde at mcs.anl.gov>
> wrote:
>         Thanks, Glen. I would think that when Swift is running with
>         only a single site, replication should essentially be a no-op
>         and disable itself. If thats what is already happening, we
>         should state that in the userguide and swift.properties file.
>         
>         We might be able to tell form the full log if its really
>         replicating or not.
>         
>         This is a minor issue since it can  be addressed with
>         documentation (ie "dont turn on replication with only 1 site")
>         even if the code is not already doing that.
>         
>         - Mike
>         
>         
>         
>         ----- "Glen Hocky" <hockyg at uchicago.edu> wrote:
>         
>         > I'm doing a test run on 1 osg site replication is turned on.
>         Since
>         > nothing is happening on the site i see
>         >
>         >
>         >
>         >
>         > Progress: Submitted:6 Finished successfully:2
>         >
>         > Progress: Submitted:6 Finished successfully:2
>         >
>         > Progress: Submitted:6 Finished successfully:2
>         >
>         > Progress: Submitted:5 Replicating:1 Finished successfully:2
>         >
>         > Progress: Submitted:6 Finished successfully:2
>         >
>         > Progress: Submitted:6 Finished successfully:2
>         >
>         >
>         > Not sure what happens when a job is replicated on one site
>         but I
>         > thought you might like to know...
>         >
>         >
>         
>         > _______________________________________________
>         > Swift-devel mailing list
>         > Swift-devel at ci.uchicago.edu
>         > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>         
>         --
>         Michael Wilde
>         Computation Institute, University of Chicago
>         Mathematics and Computer Science Division
>         Argonne National Laboratory
>         
> 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel





More information about the Swift-devel mailing list