[Swift-user] sites.xml for cloud

[Khawar Ahmad]

Hi David,

Yes, I can see this file in swift installed directory.

Regards,
Khawar

On 15 Jan 2014, at 19:53, "David Kelly" <davidk at ci.uchicago.edu<mailto:davidk at ci.uchicago.edu>> wrote:

Hi Khawaar,

Sorry that you're running into problems. I think the issue is related to message "Cannot find template for persistent-coasters", which is strange because that file should be included with Swift. In the place where Swift is installed, do you see a file called etc/sites/persistent-coasters?


On Wed, Jan 15, 2014 at 12:25 PM, Khawar Ahmad <khawar.ahmad at cern.ch<mailto:khawar.ahmad at cern.ch>> wrote:
Hi David,

I have done these changes. See the conf file below.

xport WORKER_LOCATION=/home/ubuntu
export WORKER_HOSTS="192.168.100.3 192.168.100.4"
export WORKER_MODE=ssh
export WORKER_USERNAME=ubuntu
export IPADDR="192.168.100.2"
export WORKER_LOG_DIR=/home/ubuntu
export WORKER_LOGGING_LEVEL=DEBUG
export WORK=/home/ubuntu/work
export JOBSPERNODE=1
export JOBTHROTTLE=10
export SSH_TUNNELING=yes

setup.sh went fine without errors. see the output below.

Swift version is Swift 0.94.1 swift-r7114 cog-r3803
Assuming /home/ubuntu/swift-cloud-tutorial/bin:/home/ubuntu/swift-cloud-tutorial/app: is already at front of PATH
Saving /home/ubuntu/.swift/swift.properties in /home/ubuntu/.swift/swift.properties.LTCg
Start-coaster-service...
Configuration: /home/ubuntu/swift-cloud-tutorial/scs/coaster-service.conf
Service address: 192.168.100.2
Starting coaster-service
Service port: 52871
Local port: 60572
Generating sites.xml
Cannot find template for persistent-coasters
Starting worker on 192.168.100.3
Starting worker on 192.168.100.4


However, the sites.xml file after part03 are empty. see the output below.

ubuntu at uwe-vm1:~/swift-cloud-tutorial$ more part0*/sites.xml
::::::::::::::
part01/sites.xml
::::::::::::::
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
   <pool handle="localhost">
      <execution provider="local" />
      <profile namespace="karajan" key="jobThrottle">0</profile>
      <profile namespace="karajan" key="initialScore">10000</profile>
      <filesystem provider="local"/>
      <workdirectory>.swift/tmp</workdirectory>
      <profile namespace="swift" key="stagingMethod">local</profile>
   </pool>
</config>
::::::::::::::
part02/sites.xml
::::::::::::::
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
   <pool handle="localhost">
      <execution provider="local" />
      <profile namespace="karajan" key="jobThrottle">0</profile>
      <profile namespace="karajan" key="initialScore">10000</profile>
      <filesystem provider="local"/>
      <workdirectory>.swift/tmp</workdirectory>
      <profile namespace="swift" key="stagingMethod">local</profile>
   </pool>
</config>
::::::::::::::
part03/sites.xml
::::::::::::::
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
   <pool handle="localhost">
      <execution provider="local" />
      <profile namespace="karajan" key="jobThrottle">0</profile>
      <profile namespace="karajan" key="initialScore">10000</profile>
      <filesystem provider="local"/>
      <workdirectory>.swift/tmp</workdirectory>
      <profile namespace="swift" key="stagingMethod">local</profile>
   </pool>
</config>
::::::::::::::
part04/sites.xml
::::::::::::::
::::::::::::::
part05/sites.xml
::::::::::::::
::::::::::::::
part06/sites.xml
::::::::::::::


In the tutorial, part4 onwards is described as running on compute nodes and apps file has entry “cloud sh /bin/bash”, however, I could not see how “cloud” would be resolved.
This is why, I could not run examples part03 onwards. Any help?


Regards,
Khawar
On 15 Jan 2014, at 16:17, David Kelly <davidk at ci.uchicago.edu<mailto:davidk at ci.uchicago.edu>> wrote:

Hi Khawar,

For running with the cloud tutorial, all the settings are defined in a file called scs/coaster-service.conf. The only things you should need to change there is the list of IP addresses, the remote username, and remote directories to use.

When you run the command "source setup.sh", it should start the workers on remote sites and create a sites.xml file in each the part directories. Are you getting any errors when you run "source setup.sh"?

Thanks,
David


On Wed, Jan 15, 2014 at 9:34 AM, Khawar Ahmad <khawar.ahmad at cern.ch<mailto:khawar.ahmad at cern.ch>> wrote:
Hi,

I am trying to use SWIFT to run sample programs on my test Cloud setup. I am following a tutorial (http://swift-lang.org/tutorials/cloud/tutorial.html).
However, the sites.xml file for Part4 is empty and I get the following error from swift
"Execution failed:
Could not load file sites.xml: com.thoughtworks.xstream.io.StreamException:  : input contained no data"

Can you tell me what are the settings to run jobs in the Cloud environment? The Cloud is setup using OpenStack.

Regards,
Khawar

_______________________________________________
Swift-user mailing list
Swift-user at ci.uchicago.edu<mailto:Swift-user at ci.uchicago.edu>
https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140115/92ee96bd/attachment.html>