[Swift-user] handling prestaged data on multiple sites
Allan Espinosa
aespinosa at cs.uchicago.edu
Tue May 4 10:45:41 CDT 2010
Hi Justin,
I used globus.org's data movement service.
Right now I have the dataset on these OSG sites:
ff-grid.unl.edu:/panfs/panasas/CMS/data/scec/RuptureVariations/*
tuscany.med.harvard.edu:/osg/storage/data/engage/scec/RuptureVariations/*
On Mar, 2010-05-04 at 10:20 -0500, Justin Wozniak wrote:
>
> This is probably a good use case for CDM. How did you prestage the
> files?
>
>
>
> ______________________________________________________________________
> Allan Espinosa wrote:
>
> Hi,
>
> I prestaged 11k small files (total ~2GB) to two sites. if I were just
> computing on 1 site, i can just place hardwired strings of absolute
> pathnames to disable staging. I was originally thinking of passing
> '$OSG_DATA' variable names since the app functions wraps to bash
> shell
> scripts. this backfired because swift passes these string args
> literally.
>
> any other recommended approaches?
>
> thanks!
> -Allan
More information about the Swift-user
mailing list