[Swift-user] question about xsede

[Yadu Nand]

Hi Justin,

Here are some tested configs and a small README from running the sanity
test on Blacklight:
http://users.rcc.uchicago.edu/~yadunand/blacklight-sanity/

There's an example each of configs for Swift 0.94, Swift 0.95 and the
configs we would use going
forward (Swift 0.96 and current trunk) in that folder.

In the example, I've used ppn=16 (or any multiple of 16) which seems to
work as a substitute for ncpus.

Hope that helps!

-Yadu


On Tue, Sep 23, 2014 at 5:30 PM, Michael Wilde <wilde at anl.gov> wrote:

>  Justin,
>
> Blacklight is an SGI machine, and thus a more standard PBS machine to
> which the Cray-specific sites file settings do not apply.
>
> It does seem to have a few quirks, though, as describe at:
>   https://portal.xsede.org/psc-blacklight#running
>
> In particular, the page above suggests using "-l ncpus=N" where N is the
> number of CPUS desired and a multiple of 16.  But by default Swift will
> generate "-l nodes=n" where n is the number of nodes.
>
> So we'll need to either do some testing (once we get on the machine) or
> send you our best guess of the right sites settings and work with you to
> test them for us.
>
> We'll look into this further and report back.
>
> - Mike
>
>
> On 9/23/14, 5:22 PM, Justin bbt wrote:
>
> Thank you very much.
>
> I am actually using the Blacklight, which I guess is PBS based.
>  So, should I use the Crays tutorial and setting ?
> http://swift-lang.org/tutorials/cray/tutorial.html
>
> On Tue, Sep 23, 2014 at 10:31 AM, Ketan Maheshwari <ketan at mcs.anl.gov>
> wrote:
>
>> Hi Justin,
>>
>>  If you are using xsede Stampede regular nodes (non xeon phi), here is a
>> site configuration that has worked for me in the past, connecting over ssh
>> to slurm:
>>
>>  <?xml version="1.0" encoding="UTF-8"?>
>> <config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
>>  <pool handle="stampede">
>>    <execution provider="coaster" jobmanager="ssh-cl:slurm" url="
>> stampede.tacc.utexas.edu"/>
>>    <filesystem provider="local" />
>>    <profile namespace="globus"  key="jobsPerNode">1</profile>
>>    <profile namespace="globus"  key="ppn">1</profile>
>>    <profile namespace="globus"  key="maxTime">7500</profile>
>>    <profile namespace="globus"  key="maxwalltime">00:10:00</profile>
>>    <profile namespace="globus"  key="lowOverallocation">100</profile>
>>    <profile namespace="globus"  key="highOverallocation">100</profile>
>>    <profile namespace="globus"  key="queue">normal</profile>
>>    <profile namespace="globus"  key="nodeGranularity">1</profile>
>>    <profile namespace="globus"  key="maxNodes">1</profile>
>>    <profile namespace="globus" key="slots">1</profile>
>>    <profile namespace="globus"  key="project">TG-EAR130015</profile>
>>    <profile namespace="karajan" key="jobThrottle">.3199</profile>
>>    <profile namespace="karajan" key="initialScore">10000</profile>
>>    <workdirectory>/tmp/{env.USER}/swift.work</workdirectory>
>>   </pool>
>> </config>
>>
>>  You will need to replace project id with yours.
>>
>>  Thanks,
>> Ketan
>>
>>  On Mon, Sep 22, 2014 at 8:32 PM, Justin bbt <justinbbt at gmail.com> wrote:
>>
>>>  Hi
>>>
>>>  If I want to use resources on the xsede
>>> https://www.xsede.org/overview
>>>  which site config should I use ?
>>>
>>>
>>>  _______________________________________________
>>> Swift-user mailing list
>>> Swift-user at ci.uchicago.edu
>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>>>
>>
>>
>
>
> _______________________________________________
> Swift-user mailing listSwift-user at ci.uchicago.eduhttps://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>
>
> --
> Michael Wilde
> Mathematics and Computer Science          Computation Institute
> Argonne National Laboratory               The University of Chicago
>
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>



-- 
​​
Yadu Nand B
​​
​​
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140925/b607d8b5/attachment.html>