<div dir="ltr"><div><div>Hi Khawaar,<br><br>Sorry that you're running into problems. I think the issue is related to message "Cannot find template for persistent-coasters", which is strange because that file should be included with Swift. In the place where Swift is installed, do you see a file called etc/sites/persistent-coasters?<br>
</div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Jan 15, 2014 at 12:25 PM, Khawar Ahmad <span dir="ltr"><<a href="mailto:khawar.ahmad@cern.ch" target="_blank">khawar.ahmad@cern.ch</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Hi David,<div><br></div><div>I have done these changes. See the conf file below.</div>
<div><br></div><div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">xport WORKER_LOCATION=/home/ubuntu</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORKER_HOSTS="192.168.100.3 192.168.100.4"</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">export WORKER_MODE=ssh</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORKER_USERNAME=ubuntu</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">export IPADDR="192.168.100.2"</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORKER_LOG_DIR=/home/ubuntu</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">export WORKER_LOGGING_LEVEL=DEBUG</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export WORK=/home/ubuntu/work</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">export JOBSPERNODE=1</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
export JOBTHROTTLE=10</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">export SSH_TUNNELING=yes</div></div><div><br></div><div>setup.sh went fine without errors. see the output below.</div>
<div><br></div><div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">Swift version is Swift 0.94.1 swift-r7114 cog-r3803</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Assuming /home/ubuntu/swift-cloud-tutorial/bin:/home/ubuntu/swift-cloud-tutorial/app: is already at front of PATH</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Saving /home/ubuntu/.swift/swift.properties in /home/ubuntu/.swift/swift.properties.LTCg</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">Start-coaster-service...</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">Configuration: /home/ubuntu/swift-cloud-tutorial/scs/coaster-service.conf</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Service address: 192.168.100.2</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">Starting coaster-service</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Service port: 52871</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">Local port: 60572</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Generating sites.xml</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">Cannot find template for persistent-coasters</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
Starting worker on 192.168.100.3</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">Starting worker on 192.168.100.4</div><div><div><br></div><div><br></div><div>
However, the sites.xml file after part03 are empty. see the output below.</div><div><br></div><div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">ubuntu@uwe-vm1:~/swift-cloud-tutorial$ more part0*/sites.xml</div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part01/sites.xml</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<?xml version="1.0" encoding="UTF-8"?></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"><config xmlns="<a href="http://www.ci.uchicago.edu/swift/SwiftSites" target="_blank">http://www.ci.uchicago.edu/swift/SwiftSites</a>"></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <pool handle="localhost"></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<execution provider="local" /></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <profile namespace="karajan" key="jobThrottle">0</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <profile namespace="karajan" key="initialScore">10000</profile></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<filesystem provider="local"/></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <workdirectory>.swift/tmp</workdirectory></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <profile namespace="swift" key="stagingMethod">local</profile></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</pool></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"></config></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">part02/sites.xml</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"><?xml version="1.0" encoding="UTF-8"?></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<config xmlns="<a href="http://www.ci.uchicago.edu/swift/SwiftSites" target="_blank">http://www.ci.uchicago.edu/swift/SwiftSites</a>"></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<pool handle="localhost"></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <execution provider="local" /></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<profile namespace="karajan" key="jobThrottle">0</profile></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <profile namespace="karajan" key="initialScore">10000</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <filesystem provider="local"/></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<workdirectory>.swift/tmp</workdirectory></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <profile namespace="swift" key="stagingMethod">local</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> </pool></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</config></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part03/sites.xml</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<?xml version="1.0" encoding="UTF-8"?></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"><config xmlns="<a href="http://www.ci.uchicago.edu/swift/SwiftSites" target="_blank">http://www.ci.uchicago.edu/swift/SwiftSites</a>"></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <pool handle="localhost"></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<execution provider="local" /></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <profile namespace="karajan" key="jobThrottle">0</profile></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <profile namespace="karajan" key="initialScore">10000</profile></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
<filesystem provider="local"/></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <workdirectory>.swift/tmp</workdirectory></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"> <profile namespace="swift" key="stagingMethod">local</profile></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
</pool></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"></config></div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">part04/sites.xml</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
part05/sites.xml</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">part06/sites.xml</div><div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)">
::::::::::::::</div></div><div><br></div><div><br></div><div>In the tutorial, part4 onwards is described as running on compute nodes and apps file has entry “cloud sh /bin/bash”, however, I could not see how “cloud” would be resolved. </div>
<div>This is why, I could not run examples part03 onwards. Any help?</div><div><br></div><div><br></div><div>Regards,</div><div>Khawar</div><div><div class="h5"><div>On 15 Jan 2014, at 16:17, David Kelly <<a href="mailto:davidk@ci.uchicago.edu" target="_blank">davidk@ci.uchicago.edu</a>> wrote:</div>
<br><blockquote type="cite"><div dir="ltr"><div>Hi Khawar,<br><br></div>For running with the cloud tutorial, all the settings are defined in a file called scs/coaster-service.conf. The only things you should need to change there is the list of IP addresses, the remote username, and remote directories to use.<br>
<br>When you run the command "source setup.sh", it should start the workers on remote sites and create a sites.xml file in each the part directories. Are you getting any errors when you run "source setup.sh"?<br>
<br>Thanks,<br>David<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Jan 15, 2014 at 9:34 AM, Khawar Ahmad <span dir="ltr"><<a href="mailto:khawar.ahmad@cern.ch" target="_blank">khawar.ahmad@cern.ch</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Hi,<div><br></div><div>I am trying to use SWIFT to run sample programs on my test Cloud setup. I am following a tutorial (<a href="http://swift-lang.org/tutorials/cloud/tutorial.html" target="_blank">http://swift-lang.org/tutorials/cloud/tutorial.html</a>).</div>
<div>However, the sites.xml file for Part4 is empty and I get the following error from swift </div><div>"<span style="background-color:rgb(0,0,0);color:rgb(245,245,245);font-family:Monaco;font-size:10px">Execution failed:</span></div>
<div style="margin:0px;font-size:10px;font-family:Monaco;color:rgb(245,245,245);background-color:rgb(0,0,0)"><span style="white-space:pre-wrap"> </span>Could not load file sites.xml: com.thoughtworks.xstream.io.StreamException: : input contained no data"</div>
<div> </div><div>Can you tell me what are the settings to run jobs in the Cloud environment? The Cloud is setup using OpenStack.</div><div><br></div><div>Regards,</div><div>Khawar</div></div><br>_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br></blockquote></div><br></div>
</blockquote></div></div></div><br></div></div></blockquote></div><br></div>