<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi Matthew,<br>
<br>
I am in the middle of updating our MPI documentation, and I think it
would be best to<br>
address this question through a generalized example. Here's what I
have in mind :<br>
<br>
You have hosts, node001...008, that you have password-less ssh
access to.<br>
<br>
1. Set hosts to node001...node008, and hostcount to N.<br>
<br>
2. A script similar to start-coaster-service accesses the above
variables and creates <br>
partitions with hostcount number of hosts. The script then
starts the swift worker<br>
on the first node in each partition of hosts, and sets a node
list environment variable.<br>
Eg. you have node001 ... node008 and hostcount = 4<br>
Each worker(of 2) gets a portion of the nodes, the worker on
node001 gets <br>
NODE_LIST=[node001 node002 node003 node4]<br>
<br>
3. Tasks submitted to the worker can use mpirun --host
<NODE_LIST> to start<br>
mpi tasks with hostcount number of nodes.<br>
<br>
4. Run mpi tasks to check if the ranks are on the right nodes. <br>
<br>
Does this sound reasonable ? <br>
<br>
Thanks,<br>
Yadu<br>
<br>
<br>
<div class="moz-cite-prefix">On 02/25/2015 10:12 AM, Matthew Shaxted
wrote:<br>
</div>
<blockquote
cite="mid:E606D0858F0AB941B6A9EB52730031F6BB8AD4F5EA@CCRD007.mail.lan"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal">Hi all, <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">A few questions about Swift’s interaction
with MPI – specifically related to OpenFoam CFD:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">To date, we are running OpenFoam CFD jobs
on a single machine at the moment, but are looking to scale up
computation by way of OpenFoam’s MPI support. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We discussed a strategy of enabling Lustre
or a similar file system across our internal resources,
connecting our worker nodes to the head node via an MPI
listener, and submitting/running the jobs via OpenFoam’s MPI
run command.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Does Swift support a connection via MPI?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Perhaps Swift can help manage setting up
the in the same way a worker.pl is setup for coaster-service?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks for any insights.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Matthew<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"
style="margin-bottom:14.0pt;line-height:13.0pt"><span
style="font-size:9.0pt;font-family:"Arial","sans-serif";color:#EF2B2D">MATTHEW
SHAXTED<o:p></o:p></span></p>
<p class="MsoNormal"
style="margin-bottom:14.0pt;line-height:13.0pt"><span
style="font-size:9.0pt;font-family:"Arial","sans-serif";color:gray">SKIDMORE,
OWINGS & MERRILL LLP<br>
224 SOUTH MICHIGAN AVENUE<br>
CHICAGO, IL 60604<br>
T (312) 360-4368<br>
<a moz-do-not-send="true"
href="mailto:MATTHEW.SHAXTED@SOM.COM"><span
style="color:blue">MATTHEW.SHAXTED@SOM.COM</span></a><o:p></o:p></span></p>
<p class="MsoNormal"
style="margin-bottom:14.0pt;line-height:13.0pt"><span
style="font-family:"Arial","sans-serif";color:gray"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-bottom:14.0pt"><a
moz-do-not-send="true" href="http://www.som.com/"><span
style="font-family:"Arial","sans-serif";color:black;text-decoration:none"><img
id="Picture_x0020_1"
src="cid:part2.07060200.09050503@uchicago.edu"
alt="cid:image001.png@01CF9071.6FB46030" border="0"
height="45" width="123"></span></a><a
moz-do-not-send="true" name="_GoBack"></a><span
style="font-family:"Arial","sans-serif";color:black"><o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:12.0pt"><span
style="font-size:8.0pt;font-family:"Arial","sans-serif";color:gray">The
information contained in this communication may be
confidential, is intended only for the use of the
recipient(s) named above, and may be legally privileged. If
the reader of this message is not the intended recipient,
you are hereby notified that any dissemination,
distribution, or copying of this communication, or any of
its contents, is strictly prohibited and may be unlawful. If
you have received this communication in error, please return
it to the sender immediately and delete the original
message and any copy of it from your computer system. If you
have any questions concerning this message, please contact
the sender.</span><span
style="font-family:"Arial","sans-serif";color:gray"><o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span
style="font-size:12.0pt;font-family:"Verdana","sans-serif";color:black"><img
id="Picture_x0020_2"
src="cid:part5.06010601.08090400@uchicago.edu"
alt="http://intranet.som.com/common/admin/file.cfm?f=%2Fresources%2Fcontent%2F5%2F0%2F4%2F4%2F6%2F4%2F0%2F3%2Fdocuments%2Fimagea560bf%2Egif%406e10073b%2E30854c37"
border="0" height="19" width="393"></span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Swift-user mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Swift-user@ci.uchicago.edu">Swift-user@ci.uchicago.edu</a>
<a class="moz-txt-link-freetext" href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
</blockquote>
<br>
</body>
</html>