<br><br><div class="gmail_quote">On Sun, Oct 16, 2011 at 11:15 AM, Michael Wilde <span dir="ltr"><<a href="mailto:wilde@mcs.anl.gov" target="_blank">wilde@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
David, Ketan,<br>
<br>
I need to run some things on Beagle, asap.<br>
<br>
Ketan, where is the latest and best documentation for this? I see your edits below to the 0.93 Site Guide. But I dont see that online where I would expect it:<br>
<br>
<a href="http://www.ci.uchicago.edu/swift/wwwdev/guides/release-0.93/siteguide/siteguide.html#_beagle" target="_blank">http://www.ci.uchicago.edu/swift/wwwdev/guides/release-0.93/siteguide/siteguide.html#_beagle</a><br>
<br>
David, is it just that this document is not being correctly pushed to the wwwdev site on a nightly basis?<br></blockquote><div><br></div><div>That seems to be the case. I have committed a little change just now, may be that will trigger a doc build. The link you mentioned is not the latest for Swift on Beagle. See this one which has documentation for scaling up runs on Beagle:</div>
<div><br></div><div><a href="http://www.ci.uchicago.edu/~ketan/swift-docs/release-0.93/siteguide/siteguide.html#_beagle" target="_blank">http://www.ci.uchicago.edu/~ketan/swift-docs/release-0.93/siteguide/siteguide.html#_beagle</a></div>
<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Ketan, is the latest info on running Swift on Beagle now all in the siteguide? Is the info you were putting in the cookbook (I see many commits there) now all consolidated into the Site Guide? And is there a difference in sites.xml settings between 0.93 and trunk? Lastly, which release works best?<br>
</blockquote><div><br></div><div>Yes, the sitesguide for release-0.93 is the latest on Swift Beagle documentation. My cookbook info is all consolidated on sitesguide. </div><div>There is no difference between sites file for 0.93 and trunk.</div>
<div><br></div><div>Regards,</div><div>Ketan</div><div><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Second question: I need to run a script that executes many 24-core OpenMP apps. Is the necessary support for this in 0.93? What if any declarations do I need other than to say jobsPerNode=1? Glen, are you running OpenMP on Beagle and if so what release and sites file are you using?<br>
<br>
Im assuming Justin's latest changes to sites.xml are in trunk but not 0.93? If that is correct, is there a corresponding site site for Beagle for trunk?<br>
<br>
Thanks,<br>
<br>
- Mike<br>
<br>
<br>
----- Forwarded Message -----<br>
From: <a href="mailto:ketan@ci.uchicago.edu" target="_blank">ketan@ci.uchicago.edu</a><br>
To: <a href="mailto:swift-commit@ci.uchicago.edu" target="_blank">swift-commit@ci.uchicago.edu</a><br>
Sent: Sunday, September 18, 2011 10:14:10 PM<br>
Subject: [Swift-commit] r5126 - branches/release-0.93/docs/siteguide<br>
<br>
Author: ketan<br>
Date: 2011-09-18 22:14:10 -0500 (Sun, 18 Sep 2011)<br>
New Revision: 5126<br>
<br>
Modified:<br>
branches/release-0.93/docs/siteguide/beagle<br>
Log:<br>
added content to beagle siteguide<br>
<br>
Modified: branches/release-0.93/docs/siteguide/beagle<br>
===================================================================<br>
--- branches/release-0.93/docs/siteguide/beagle 2011-09-19 02:41:02 UTC (rev 5125)<br>
+++ branches/release-0.93/docs/siteguide/beagle 2011-09-19 03:14:10 UTC (rev 5126)<br>
@@ -52,9 +52,38 @@<br>
A key factor in scaling up Swift runs on Beagle is to setup the sites.xml parameters.<br>
The following sites.xml parameters must be set to scale that is intended for a large run:<br>
<br>
- * walltime: The expected walltime for completion of your run. This parameter is accepted in seconds.<br>
- * slots: Number of qsub jobs needs to be submitted by swift. This number will determine how many qsubs swift will submit for your run. Typical values range between 40 and 80 for large runs.<br>
- * nodegranularity: Determines the number of nodes per job. Total nodes will thus be slots times nodegranularity. This may vary for advanced configurations though.<br>
- * maxnodes: Determines the maximum number of nodes a job must pack into its qsub. This parameter determines the largest single job that your run will submit.<br>
+ * *maxTime* : The expected walltime for completion of your run. This parameter is accepted in seconds.<br>
+ * *slots* : Number of qsub jobs needs to be submitted by swift. This number will determine how many qsubs swift will submit for your run. Typical values range between 40 and 80 for large runs.<br>
+ * *nodeGranularity* : Determines the number of nodes per job. Total nodes will thus be slots times nodegranularity. This may vary for advanced configurations though.<br>
+ * *maxNodes* : Determines the maximum number of nodes a job must pack into its qsub. This parameter determines the largest single job that your run will submit.<br>
+ * *jobThrottle* : A factor that determines the number of tasks dispatched simultaneously. The intended number of simultaneous tasks must match the number of cores targeted. The number of tasks is calculated from the jobThrottle factor is as follows:<br>
<br>
+----<br>
+Number of Tasks = (JobThrottle x 100) + 1<br>
+----<br>
<br>
+Following is an example sites.xml for a 50 slots run with each slot occupying 4 nodes (thus, a 200 node run):<br>
+<br>
+-----<br>
+<config><br>
+ <pool handle="pbs"><br>
+ <execution provider="coaster" jobmanager="local:pbs"/><br>
+ <profile namespace="globus" key="project">CI-CCR000013</profile><br>
+<br>
+ <profile namespace="globus" key="ppn">24:cray:pack</profile><br>
+<br>
+ <profile namespace="globus" key="jobsPerNode">24</profile><br>
+ <profile namespace="globus" key="maxTime">50000</profile><br>
+ <profile namespace="globus" key="slots">50</profile><br>
+ <profile namespace="globus" key="nodeGranularity">4</profile><br>
+ <profile namespace="globus" key="maxNodes">4</profile><br>
+<br>
+ <profile namespace="karajan" key="jobThrottle">48.00</profile><br>
+ <profile namespace="karajan" key="initialScore">10000</profile><br>
+<br>
+ <filesystem provider="local"/><br>
+ <workdirectory >/lustre/beagle/ketan/swift.workdir</workdirectory><br>
+ </pool><br>
+</config><br>
+-----<br>
+<br>
<br>
_______________________________________________<br>
Swift-commit mailing list<br>
<a href="mailto:Swift-commit@ci.uchicago.edu" target="_blank">Swift-commit@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-commit" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-commit</a><br>
<font color="#888888"><br>
--<br>
Michael Wilde<br>
Computation Institute, University of Chicago<br>
Mathematics and Computer Science Division<br>
Argonne National Laboratory<br>
<br>
</font></blockquote></div><br><br clear="all"><div><br></div>-- <br>Ketan<br><br><br>