[Swift-user] Re: [Swift-devel] burnin' up ranger w/the latest coasters

skenny at uchicago.edu skenny at uchicago.edu
Wed Oct 14 15:39:15 CDT 2009


for those interested, here are the config files used for this run:

swift.properties:

sites.file=config/coaster_ranger.xml
tc.file=/ci/projects/cnari/config/tc.data
lazy.errors=false
caching.algorithm=LRU
pgraph=false
pgraph.graph.options=splines="compound", rankdir="TB"
pgraph.node.options=color="seagreen", style="filled"
clustering.enabled=false
clustering.queue.delay=4
clustering.min.time=60
kickstart.enabled=maybe
kickstart.always.transfer=false
wrapperlog.always.transfer=false
throttle.submit=3
throttle.host.submit=8
throttle.score.job.factor=64
throttle.transfers=16
throttle.file.operations=16
sitedir.keep=false
execution.retries=3
replication.enabled=false
replication.min.queue.time=60
replication.limit=3
foreach.max.threads=16384

coaster_ranger.xml:

<config>
 <import file="sys.xml"/>
<import file="vdl-lib.xml"/>
<set name="username">
  <arg><vdl:new type="string" value="user"/></arg>
</set>
<pool handle="RANGER">
    <profile namespace="karajan"
key="jobThrottle">1000.0</profile>
    <filesystem provider="coaster"
url="gt2://gatekeeper.ranger.tacc.teragrid.org"/>
    <profile namespace="globus" key="queue">normal</profile>
    <profile namespace="globus" key="workersPerNode">32</profile>
    <profile namespace="globus" key="nodeGranularity">1</profile>
    <profile namespace="globus" key="slots">16</profile>
    <profile namespace="globus" key="maxNodes">8192</profile>
    <profile namespace="globus" key="maxTime">72000</profile>
    <profile namespace="globus"
key="project">TG-DBS080004N</profile>
    <execution provider="coaster"
url="gatekeeper.ranger.tacc.teragrid.org"
jobManager="gt2:gt2:SGE"/>
    <!--
workdirectory>/work/00043/tg457040/sidgrid_out/{username}</workdirectory
-->
   
<workdirectory>/work/00926/tg459516/sidgrid_out/{username}</workdirectory>
  </pool>
</config>



---- Original message ----
>Date: Tue, 13 Oct 2009 11:14:17 -0500 (CDT)
>From: <skenny at uchicago.edu>  
>Subject: [Swift-devel] burnin' up ranger w/the latest coasters  
>To: swift-devel at ci.uchicago.edu
>
>Final status:  Finished successfully:131072 
>
>re-running some of the workflows from our recent SEM
>paper with the latest swift...sadly, queue time on ranger has
>only gone up since those initial runs...but luckily coasters
>has speeded things up, so it ends up evening out for time to
>solution :)
>
>not sure i fully understand the plot:
>
>http://www.ci.uchicago.edu/~skenny/workflows/sem_131k/
>
>log is here:
>
>/ci/projects/cnari/logs/skenny/4reg_2cond-20091012-1607-ugidm2s2.log
>_______________________________________________
>Swift-devel mailing list
>Swift-devel at ci.uchicago.edu
>http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel



More information about the Swift-user mailing list