[Swift-user] max number of jobs?

Glen Hocky hockyg at uchicago.edu
Thu Apr 23 14:45:55 CDT 2009


ranger.data
> #sitename       transformation  path    INSTALLED       
> platform        profiles
> localhost       echo            /bin/echo       INSTALLED       
> INTEL32::LINUX  null
> localhost       cat             /bin/cat        INSTALLED       
> INTEL32::LINUX  null
> localhost       ls              /bin/ls         INSTALLED       
> INTEL32::LINUX  null
> localhost       grep            /bin/grep       INSTALLED       
> INTEL32::LINUX  null
> localhost       sort            /bin/sort       INSTALLED       
> INTEL32::LINUX  null
> localhost       paste           /bin/paste      INSTALLED       
> INTEL32::LINUX  null
> localhost       sed             /bin/sed        INSTALLED       
> INTEL32::LINUX  null
> localhost       cp              /bin/cp         INSTALLED       
> INTEL32::LINUX  null
> localhost       sumarizeStudy   
> /home/hockyg/oops/swift/genPlotFiles.py INSTALLED       INTEL32::LINUX 
> null
>
>
> ranger    runoops    
> /share/home/01021/hockyg/oops/trunk/bin/runoops.sh      
> INSTALLED       INTEL32::LINUX  null
> ranger    runrama    
> /share/home/01021/hockyg/oops/trunk/bin/runrama.sh      
> INSTALLED       INTEL32::LINUX  null
> ranger    runramaSpeed            
> /share/home/01021/hockyg/oops/trunk/bin/runramaSpeed.sh   
> INSTALLED       INTEL32::LINUX  null
> ranger    analyze_round_dir    
> /share/home/01021/hockyg/oops/trunk/bin/analyze_round_dir.sh      
> INSTALLED       INTEL32::LINUX  null


ranger.xml

> <config>
>  <pool handle="localhost" sysinfo="INTEL32::LINUX">
>     <gridftp url="local://localhost" />
>     <execution provider="local" url="none" />
>     <workdirectory>/home/hockyg/swiftwork</workdirectory>
>   </pool>
>
>   <pool handle="ranger">
>     <execution provider="coaster" 
> url="gatekeeper.ranger.tacc.teragrid.org" jobManager="gt2:gt2:SGE"/>
>     <!--<filesystem provider="coaster" 
> url="gt2://gatekeeper.ranger.tacc.teragrid.org"/>-->
>     <gridftp url="gsiftp://gridftp.ranger.tacc.teragrid.org:2811/" />
>     <profile namespace="env" 
> key="SWIFT_JOBDIR_PATH">/tmp/hockyg/jobdir</profile>
>     <profile namespace="globus" key="project">TG-MCB080099N</profile>
>     <profile namespace="globus" key="coastersPerNode">16</profile>
>     <profile namespace="globus" 
> key="coasterWorkerMaxwalltime">05:00:00</profile>
>     <profile namespace="globus" key="maxwalltime">60</profile>
>     <profile namespace="karajan" key="initialScore">50</profile>
>     <profile namespace="karajan" key="jobThrottle">10</profile>
>     <workdirectory>/share/home/01021/hockyg/swiftwork</workdirectory>
>   </pool>
> </config>


> [hockyg at communicado rangeroutdir.1002]$ less 
> /home/hockyg/.swift/swift.properties
> sitedir.keep=true
> lazy.errors=false
> #execution.retries=0
> status.mode=provider

Michael Wilde wrote:
> Glen, can you post your sites.xml, tc.data and swift.properties files?
>
> On 4/23/09 2:21 PM, Glen Hocky wrote:
>> Hi everyone.
>> I was wondering if there is a cap on number of coasters or jobs in 
>> the queue on some machines. I've had a lot of success running on 
>> Ranger but I've never had more than 256 active jobs (i.e. 16x16) even 
>> with very high initial score and throttle settings.
>>
>> Glen
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user




More information about the Swift-user mailing list