[Swift-user] handling prestaged data on multiple sites

Allan Espinosa aespinosa at cs.uchicago.edu
Tue May 4 10:45:41 CDT 2010


Hi Justin,

I used globus.org's data movement service.  

Right now I have the dataset on these OSG sites:

ff-grid.unl.edu:/panfs/panasas/CMS/data/scec/RuptureVariations/*
tuscany.med.harvard.edu:/osg/storage/data/engage/scec/RuptureVariations/*

On Mar, 2010-05-04 at 10:20 -0500, Justin Wozniak wrote:
> 
> This is probably a good use case for CDM.  How did you prestage the
> files?
> 
> 
> 
> ______________________________________________________________________
> Allan Espinosa wrote:
> 
> Hi, 
> 
> I prestaged 11k small files (total ~2GB) to two sites. if I were just 
> computing on 1 site, i can just place hardwired strings of absolute 
> pathnames to disable staging. I was originally thinking of passing 
> '$OSG_DATA' variable names since the app functions wraps to bash
> shell 
> scripts. this backfired because swift passes these string args 
> literally. 
> 
> any other recommended approaches? 
> 
> thanks! 
> -Allan 





More information about the Swift-user mailing list