[Swift-user] handling prestaged data on multiple sites
Ian Foster
foster at anl.gov
Tue May 4 11:09:48 CDT 2010
What is CDM?
Ian
On May 4, 2010, at 10:45 AM, Allan Espinosa wrote:
> Hi Justin,
>
> I used globus.org's data movement service.
>
> Right now I have the dataset on these OSG sites:
>
> ff-grid.unl.edu:/panfs/panasas/CMS/data/scec/RuptureVariations/*
> tuscany.med.harvard.edu:/osg/storage/data/engage/scec/RuptureVariations/*
>
> On Mar, 2010-05-04 at 10:20 -0500, Justin Wozniak wrote:
>>
>> This is probably a good use case for CDM. How did you prestage the
>> files?
>>
>>
>>
>> ______________________________________________________________________
>> Allan Espinosa wrote:
>>
>> Hi,
>>
>> I prestaged 11k small files (total ~2GB) to two sites. if I were just
>> computing on 1 site, i can just place hardwired strings of absolute
>> pathnames to disable staging. I was originally thinking of passing
>> '$OSG_DATA' variable names since the app functions wraps to bash
>> shell
>> scripts. this backfired because swift passes these string args
>> literally.
>>
>> any other recommended approaches?
>>
>> thanks!
>> -Allan
>
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
More information about the Swift-user
mailing list