<div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Hi Khawar,</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">
Could you copy the /etc/sites/persistent-coasters file in your swift installation to your $HOME/.swift/sites folder ?</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">As you noted earlier, the apps file from part04 onwards should reference "persistent-coasters" as defined in the</div>
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif">sites.xml instead of "cloud". </div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">
So, the apps file should look like this :</div><div class="gmail_default"><font face="arial, helvetica, sans-serif">persistent-coasters sh /bin/bash</font><br></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><br>
</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif">And the sites.xml generated should look like this (with some changes for your settings):</font></div><div class="gmail_default"><font face="arial, helvetica, sans-serif"><div class="gmail_default">
<config></div><div class="gmail_default"> <pool handle="persistent-coasters"></div><div class="gmail_default"> <execution provider="coaster-persistent"</div><div class="gmail_default">
url="<a href="http://localhost:51853">http://localhost:51853</a>"</div><div class="gmail_default"> jobmanager="local:local"/></div><div class="gmail_default"> <profile namespace="globus" key="workerManager">passive</profile></div>
<div class="gmail_default"> <profile namespace="globus" key="jobsPerNode">1</profile></div><div class="gmail_default"> <profile key="jobThrottle" namespace="karajan">10</profile></div>
<div class="gmail_default"> <profile namespace="karajan" key="initialScore">10000</profile></div><div class="gmail_default"> <filesystem provider="local" url="none" /></div>
<div class="gmail_default"> <workdirectory>/tmp/swiftwork</workdirectory></div><div class="gmail_default"> </pool></div><div class="gmail_default"></config></div></font></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">
<br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Please let us know how this works out for you. </div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div>
<div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Thanks,</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Yadu<br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">
<br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Jan 15, 2014 at 2:56 PM, Khawar Ahmad <span dir="ltr"><<a href="mailto:khawar.ahmad@cern.ch" target="_blank">khawar.ahmad@cern.ch</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="auto">
<div>Hi David,</div>
<div><br>
</div>
<div>Yes, I can see this file in swift installed directory.</div>
<div><br>
</div>
<div>Regards,</div>
<div>Khawar</div><div><div class="h5">
<div><br>
On 15 Jan 2014, at 19:53, "David Kelly" <<a href="mailto:davidk@ci.uchicago.edu" target="_blank">davidk@ci.uchicago.edu</a>> wrote:<br>
<br>
</div>
<div><span></span></div>
<blockquote type="cite">
<div>
<div dir="ltr">
<div>
<div>Hi Khawaar,<br>
<br>
Sorry that you're running into problems. I think the issue is related to message "Cannot find template for persistent-coasters", which is strange because that file should be included with Swift. In the place where Swift is installed, do you see a file called
etc/sites/persistent-coasters?<br>
</div>
</div>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Wed, Jan 15, 2014 at 12:25 PM, Khawar Ahmad <span dir="ltr">
<<a href="mailto:khawar.ahmad@cern.ch" target="_blank">khawar.ahmad@cern.ch</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Hi David,
<div><br>
</div>
<div>I have done these changes. See the conf file below.</div>
<div><br>
</div>
<div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
xport WORKER_LOCATION=/home/ubuntu</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORKER_HOSTS="192.168.100.3 192.168.100.4"</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORKER_MODE=ssh</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORKER_USERNAME=ubuntu</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export IPADDR="192.168.100.2"</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORKER_LOG_DIR=/home/ubuntu</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORKER_LOGGING_LEVEL=DEBUG</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORK=/home/ubuntu/work</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export JOBSPERNODE=1</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export JOBTHROTTLE=10</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export SSH_TUNNELING=yes</div>
</div>
<div><br>
</div>
<div>setup.sh went fine without errors. see the output below.</div>
<div><br>
</div>
<div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Swift version is Swift 0.94.1 swift-r7114 cog-r3803</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Assuming /home/ubuntu/swift-cloud-tutorial/bin:/home/ubuntu/swift-cloud-tutorial/app: is already at front of PATH</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Saving /home/ubuntu/.swift/swift.properties in /home/ubuntu/.swift/swift.properties.LTCg</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Start-coaster-service...</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Configuration: /home/ubuntu/swift-cloud-tutorial/scs/coaster-service.conf</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Service address: 192.168.100.2</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Starting coaster-service</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Service port: 52871</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Local port: 60572</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Generating sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Cannot find template for persistent-coasters</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Starting worker on 192.168.100.3</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Starting worker on 192.168.100.4</div>
<div>
<div><br>
</div>
<div><br>
</div>
<div>However, the sites.xml file after part03 are empty. see the output below.</div>
<div><br>
</div>
<div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
ubuntu@uwe-vm1:~/swift-cloud-tutorial$ more part0*/sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part01/sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<?xml version="1.0" encoding="UTF-8"?></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<config xmlns="<a href="http://www.ci.uchicago.edu/swift/SwiftSites" target="_blank">http://www.ci.uchicago.edu/swift/SwiftSites</a>"></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<pool handle="localhost"></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<execution provider="local" /></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="karajan" key="jobThrottle">0</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="karajan" key="initialScore">10000</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<filesystem provider="local"/></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<workdirectory>.swift/tmp</workdirectory></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="swift" key="stagingMethod">local</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</pool></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</config></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part02/sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<?xml version="1.0" encoding="UTF-8"?></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<config xmlns="<a href="http://www.ci.uchicago.edu/swift/SwiftSites" target="_blank">http://www.ci.uchicago.edu/swift/SwiftSites</a>"></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<pool handle="localhost"></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<execution provider="local" /></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="karajan" key="jobThrottle">0</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="karajan" key="initialScore">10000</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<filesystem provider="local"/></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<workdirectory>.swift/tmp</workdirectory></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="swift" key="stagingMethod">local</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</pool></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</config></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part03/sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<?xml version="1.0" encoding="UTF-8"?></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<config xmlns="<a href="http://www.ci.uchicago.edu/swift/SwiftSites" target="_blank">http://www.ci.uchicago.edu/swift/SwiftSites</a>"></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<pool handle="localhost"></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<execution provider="local" /></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="karajan" key="jobThrottle">0</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="karajan" key="initialScore">10000</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<filesystem provider="local"/></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<workdirectory>.swift/tmp</workdirectory></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="swift" key="stagingMethod">local</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</pool></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</config></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part04/sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part05/sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part06/sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>In the tutorial, part4 onwards is described as running on compute nodes and apps file has entry “cloud sh /bin/bash”, however, I could not see how “cloud” would be resolved. </div>
<div>This is why, I could not run examples part03 onwards. Any help?</div>
<div><br>
</div>
<div><br>
</div>
<div>Regards,</div>
<div>Khawar</div>
<div>
<div>
<div>On 15 Jan 2014, at 16:17, David Kelly <<a href="mailto:davidk@ci.uchicago.edu" target="_blank">davidk@ci.uchicago.edu</a>> wrote:</div>
<br>
<blockquote type="cite">
<div dir="ltr">
<div>Hi Khawar,<br>
<br>
</div>
For running with the cloud tutorial, all the settings are defined in a file called scs/coaster-service.conf. The only things you should need to change there is the list of IP addresses, the remote username, and remote directories to use.<br>
<br>
When you run the command "source setup.sh", it should start the workers on remote sites and create a sites.xml file in each the part directories. Are you getting any errors when you run "source setup.sh"?<br>
<br>
Thanks,<br>
David<br>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Wed, Jan 15, 2014 at 9:34 AM, Khawar Ahmad <span dir="ltr">
<<a href="mailto:khawar.ahmad@cern.ch" target="_blank">khawar.ahmad@cern.ch</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Hi,
<div><br>
</div>
<div>I am trying to use SWIFT to run sample programs on my test Cloud setup. I am following a tutorial (<a href="http://swift-lang.org/tutorials/cloud/tutorial.html" target="_blank">http://swift-lang.org/tutorials/cloud/tutorial.html</a>).</div>
<div>However, the sites.xml file for Part4 is empty and I get the following error from swift </div>
<div>"<span style="background-color:rgb(0,0,0);color:rgb(245,245,245);font-family:Monaco;font-size:10px">Execution failed:</span></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<span style="white-space:pre-wrap"></span>Could not load file sites.xml: com.thoughtworks.xstream.io.StreamException: : input contained no data"</div>
<div> </div>
<div>Can you tell me what are the settings to run jobs in the Cloud environment? The Cloud is setup using OpenStack.</div>
<div><br>
</div>
<div>Regards,</div>
<div>Khawar</div>
</div>
<br>
_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
</div>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div></div></div>
<br>_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br>
<div dir="ltr">Yadu Nand B<div><br></div></div>
</div>