[Swift-devel] Swift + Condor-G

[Michael Wilde]

I was pondering whether this would work with coasters, but then realized 
some of the complexities.

0.9 user guide would be a good place to document which coaster job 
manager configurations work, what scaling/throttling limits to be aware 
of, how/when to use the new condor-g capability, and what coasters 
entries work best where (eg, gt2:gt2:pbs, gt2:pbs, etc)

Users today need to navigate through a tricky sites.xml config process 
constrained by limits that are hard to understand and deal with:

- throttle to limit jobs sent under GT2 GRAM to < 40
- how to avoid exceeding this with coasters
- what LRM is on each site
- what providers are available (eg pbs and condor but not sge)
- what coaster combinations work and dont, from where

Some way of making this as clear as possible in the users guide or 
through some set of preconfigured sites files would be very helpful.

Right now, users "trade" sites.xml entries like recipes for secret 
sauces, and it would be good to provide them a cookbook or some better 
process.

On 4/23/09 1:05 PM, Michael Wilde wrote:
> This sounds great - I missed this note.
> 
> Zhao, this is worth testing as well.
> 
> Glen, if this works well it opens the door to broader OOPS runs on OSG 
> and TG.
> 
> Ben: in this profile item:
> 
>  >     <profile namespace="globus" key="gridResource">gt2
>  > belhaven-1.renci.org/jobmanager-fork</profile>
> 
> is the format gt2[space][contact-string]? (it wrapped in my email)
> 
> On 4/15/09 3:17 AM, Ben Clifford wrote:
>> CoG svn r2388 and Swift r2846 contain the ability to submit Swift jobs 
>> to gt2 sites via Condor-G.
>>
>> Below is a site definition that I have used to submit to an OSG site 
>> at RENCI.
>>
>> I would appreciate feedback from anyone who tests this successfully or 
>> unsuccessfully.
>>
>> As previously mentioned, this is not intended to replace the existing 
>> gram2 submisssion mechanisms; it provides a way to submit to OSG sites 
>> where plain gram2 is (to a greater or lesser extent) discouraged or 
>> disallowed or dysfunctional. It requires a local condor installation 
>> (which is a strong argument against using this if you do not already 
>> have such in place - this was one of the traumatic parts of getting 
>> VDS running)
>>
>>   <pool handle="localhost">
>>     <gridftp  url="gsiftp://belhaven-1.renci.org" />
>>     <execution provider="condor" />
>>     <workdirectory >/nfs/home/osgedu/benc</workdirectory>
>>     <profile namespace="globus" key="jobType">grid</profile>
>>     <profile namespace="globus" key="gridResource">gt2 
>> belhaven-1.renci.org/jobmanager-fork</profile>
>>   </pool>
>>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel