[Swift-devel] CDM

[Tim Armstrong]

Yes, I'm just starting to think about how best to implement swiftExport()
now that I'm staging the shared data files through Swift.  I wasn't sure for
what systems CDM was implemented. I can see that it would be handy on Beagle
if there are large shared data sets

- Tim

On Thu, May 5, 2011 at 10:34 AM, Michael Wilde <wilde at mcs.anl.gov> wrote:

> We should in the interim work up a cookbook entry for CDM.
>
> I suspect we can start with the example of how we use cdm DIRECT for
> modftdock on beagle.  I suspect thats what you want, Tim?
>
> For this, we used following rule in file "cdm":
>
> rule .* DIRECT /lustre/beagle/wilde/mp/run04
>
> ...and added the option "-fs.file cdm" to the swift command line.
>
> (where run04 was the directory I ran the swift command from, and below
> which the scripts input and output files resided. The files were mapped to
> relative paths, and the DIRECT rule instructed swift to bypass staging of
> files to/from the work directory.
>
> - Mike
>
>
> ----- Original Message -----
> > Hi Tim
> > I'm out of town today and tomorrow but I'll check on this when I'm
> > back. CDM broadcast is only designed for the BG/P, but we could plug
> > in
> > support for other systems if there is an available broadcast
> > mechanism.
> > Justin
> >
> > On Thu, 5 May 2011, Tim Armstrong wrote:
> >
> > > Hi All,
> > >  I'm looking at trying to use collective data management to
> > >  broadcast some
> > > shared data files for SwiftR. I have found the CDM section in the
> > > swift
> > > user guide, but are there any additional resources to help me
> > > understand how
> > > CDM in swift works?
> > >
> > > - Tim
> > >
> >
> > --
> > Justin M Wozniak
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>
> --
> Michael Wilde
> Computation Institute, University of Chicago
> Mathematics and Computer Science Division
> Argonne National Laboratory
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110505/7d8541bb/attachment.html>