<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-CA link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Jon, <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>I wanted to thank you for your huge effort making this work. For us this is big progress – we can start thinking about the experiments we’d like to have for the SC paper.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>-Matei <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span lang=EN-US style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> mosastore@googlegroups.com [mailto:mosastore@googlegroups.com] <b>On Behalf Of </b>Emalayan Vairavanathan<br><b>Sent:</b> March-15-12 10:30 AM<br><b>To:</b> swift-devel@ci.uchicago.edu Devel; Jonathan Monette<br><b>Cc:</b> MosaStore; Michael Wilde; matei<br><b>Subject:</b> Re: [Swift-devel] Mosaswift update<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal style='background:white'><span style='color:black'>Hi Jon and All,<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>MosaStore+Swift integration is done successfully. This is really a great news.<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>I successfully ran the setup provided by Jon with MosaStore+Swift on Surveyor (on 1, 3 , 5 and 64 nodes with different number of jobs varying from 1 to 1024).<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>Jon and Mike thank you again for your time in helping me to get this far.<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><b><span style='color:black'>A quick question:</span></b><span style='color:black'> The setup creates the swift working directory in GPFS but stores the intermediate files in MosaStore. Where should we actually have the swift-working directory (in GPFS / Mosa)? and Does this matter at all in case if I am going to use Mosa as an intermediate storage? <o:p></o:p></span></p></div><p class=MsoNormal style='background:white'><span style='color:black'><br>(As a next step I will be scripting our pipeline benchmark on swift and run at large scale to get some initial performance numbers. Also I will be parallely working to get Montage and ModFTDock running on BG/P with swift-CDM and MosaStore.)<br><br>Regards<br>Emalayan<o:p></o:p></span></p><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><div><div><div class=MsoNormal align=center style='text-align:center;background:white'><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'><hr size=1 width="100%" align=center></span></div><p class=MsoNormal style='background:white'><b><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'>From:</span></b><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'> Jonathan Monette <<a href="mailto:jonmon@mcs.anl.gov">jonmon@mcs.anl.gov</a>><br><b>To:</b> Emalayan Vairavanathan <<a href="mailto:svemalayan@yahoo.com">svemalayan@yahoo.com</a>> <br><b>Cc:</b> "<a href="mailto:mosastore@googlegroups.com">mosastore@googlegroups.com</a>" <<a href="mailto:mosastore@googlegroups.com">mosastore@googlegroups.com</a>>; Justin M Wozniak <<a href="mailto:wozniak@mcs.anl.gov">wozniak@mcs.anl.gov</a>>; "<a href="mailto:swift-devel@ci.uchicago.edu%20Devel">swift-devel@ci.uchicago.edu Devel</a>" <<a href="mailto:swift-devel@ci.uchicago.edu">swift-devel@ci.uchicago.edu</a>> <br><b>Sent:</b> Wednesday, 14 March 2012 2:29 PM<br><b>Subject:</b> Re: [Swift-devel] Mosaswift update</span><span style='color:black'><o:p></o:p></span></p></div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p><div id=yiv1518615791><div><p class=MsoNormal style='background:white'><span style='color:black'>The working example is located in /home/jonmon/Workspace/Swift/mosaswift-test<o:p></o:p></span></p><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>There is a README there that provides a little bit of information.<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>Quick version to run it:<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>1) start your workers<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>2) ./setup.sh<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>3) ./run.sh<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>The directory final will have 5 files if it completed without error. The content of the files will look like:<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>Hello world<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>Hello from <number><o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p><div><div><p class=MsoNormal style='background:white'><span style='color:black'>On Mar 14, 2012, at 4:03 PM, Emalayan Vairavanathan wrote:<o:p></o:p></span></p></div><p class=MsoNormal style='background:white'><span style='color:black'><br><br><o:p></o:p></span></p><div><div><div><p class=MsoNormal style='background:white'><span style='color:black'>Hi Jon,<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>Great, Thank you very much. Could you please send me the setup ? <o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>Thank you<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'>Emalayan<o:p></o:p></span></p></div><div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div><div><div><div><div class=MsoNormal align=center style='text-align:center;background:white'><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'><hr size=1 width="100%" align=center></span></div><p class=MsoNormal style='background:white'><b><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'>From:</span></b><span style='font-size:10.0pt;font-family:"Arial","sans-serif";color:black'> Jonathan Monette <<a href="mailto:jonmon@mcs.anl.gov" target="_blank">jonmon@mcs.anl.gov</a>><br><b>To:</b> Justin M Wozniak <<a href="mailto:wozniak@mcs.anl.gov" target="_blank">wozniak@mcs.anl.gov</a>> <br><b>Cc:</b> "<a href="mailto:swift-devel@ci.uchicago.edu" target="_blank">swift-devel@ci.uchicago.edu</a> Devel" <<a href="mailto:swift-devel@ci.uchicago.edu" target="_blank">swift-devel@ci.uchicago.edu</a>>; MosaStore <<a href="mailto:mosastore@googlegroups.com" target="_blank">mosastore@googlegroups.com</a>> <br><b>Sent:</b> Wednesday, 14 March 2012 2:00 PM<br><b>Subject:</b> Re: [Swift-devel] Mosaswift update</span><span style='color:black'><o:p></o:p></span></p></div><p class=MsoNormal style='margin-bottom:12.0pt;background:white'><span style='color:black'><br>So that actually fixed the issue. So we have a working example of using CDM and intermediate file storage that Emalayan can use for testing his mosa store set up.<br><br>On Mar 14, 2012, at 3:05 PM, Jonathan Monette wrote:<br><br>> Oh, thanks, didn't catch that. Trying another run right now but I think someone is using all of surveyor right now, but manual coaster service job is stuck in the queue state.<br>> <br>> <br>> On Mar 14, 2012, at 3:02 PM, Justin M Wozniak wrote:<br>> <br>>> <br>>> Ok, then it's a typo on readlinE .<br>>> <br>>> On Wed, 14 Mar 2012, Jonathan Monette wrote:<br>>> <br>>>> I am not sure. I thought readlink returned the absolute path of the link which is what I wanted to use. I am not sure how readlink behaves on the compute nodes. This was my first attempt at getting around the link but I do not think this is working.<br>>>> <br>>>> On Mar 14, 2012, at 2:43 PM, Justin M Wozniak wrote:<br>>>> <br>>>>> On Wed, 14 Mar 2012, Jonathan Monette wrote:<br>>>>> <br>>>>>> I say semi working because I intended the script to build up output during the stages on the swift run and the final output would show that it was stored temporarily in /tmp. This is not happening as the final output for the file contains only the last line(a Hello from <id> line). I believe this is due to how CDM using symlinks for the files that is matched, so a symlink is being overwritten instead of at the file it points to. I ran into this problem in the past(but this is documented in the user guide) and just need verify that this is indeed the issue.<br>>>>> <br>>>>> In the past, the application unlinked the link. It looks like you are appending to the link.<br>>>>> <br>>>>> infile=`readlink $1`<br>>>>> outfile=`readline $2`<br>>>>> cat $infile >> $outfile<br>>>>> <br>>>>> Is there a case in which the readlink affects the behavior of this sequence?<br>>>>> <br>>>>> Does readline work correctly on the BG/P compute node?<br>>>>> <br>>>>> Justin<br>>>>> <br>>>>> --<br>>>>> Justin M Wozniak<br>>>> <br>>>> <br>>> <br>>> -- <br>>> Justin M Wozniak<br>> <br>> _______________________________________________<br>> Swift-devel mailing list<br>> <a href="mailto:Swift-devel@ci.uchicago.edu" target="_blank">Swift-devel@ci.uchicago.edu</a><br>> <a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br><br>-- <br>You received this message because you are subscribed to the Google Groups "MosaStore" group.<br>To post to this group, send email to <a href="mailto:mosastore@googlegroups.com" target="_blank">mosastore@googlegroups.com</a>.<br>To unsubscribe from this group, send email to mosastore+<a href="mailto:unsubscribe@googlegroups.com" target="_blank">unsubscribe@googlegroups.com</a>.<br>For more options, visit this group at <a href="http://groups.google.com/group/mosastore?hl=en" target="_blank">http://groups.google.com/group/mosastore?hl=en</a>.<br><br><br><o:p></o:p></span></p></div></div></div></div><p class=MsoNormal style='background:white'><span style='color:black'>_______________________________________________<br>Swift-devel mailing list<br><a href="mailto:Swift-devel@ci.uchicago.edu" target="_blank">Swift-devel@ci.uchicago.edu</a><br><a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><o:p></o:p></span></p></div><p class=MsoNormal style='background:white'><span style='color:black'><o:p> </o:p></span></p></div></div><p class=MsoNormal style='background:white'><span style='color:black'>-- <br>You received this message because you are subscribed to the Google Groups "MosaStore" group.<br>To post to this group, send email to <a href="mailto:mosastore@googlegroups.com">mosastore@googlegroups.com</a>.<br>To unsubscribe from this group, send email to <a href="mailto:mosastore+unsubscribe@googlegroups.com">mosastore+unsubscribe@googlegroups.com</a>.<br>For more options, visit this group at <a href="http://groups.google.com/group/mosastore?hl=en">http://groups.google.com/group/mosastore?hl=en</a>.<o:p></o:p></span></p></div><p class=MsoNormal style='margin-bottom:12.0pt;background:white'><span style='color:black'><o:p> </o:p></span></p></div></div></div><p class=MsoNormal>-- <br>You received this message because you are subscribed to the Google Groups "MosaStore" group.<br>To post to this group, send email to <a href="mailto:mosastore@googlegroups.com">mosastore@googlegroups.com</a>.<br>To unsubscribe from this group, send email to <a href="mailto:mosastore+unsubscribe@googlegroups.com">mosastore+unsubscribe@googlegroups.com</a>.<br>For more options, visit this group at <a href="http://groups.google.com/group/mosastore?hl=en">http://groups.google.com/group/mosastore?hl=en</a>.<o:p></o:p></p></div></body></html>