[Swift-user] sites.xml for cloud

[Khawar Ahmad]

Hi David,

I have done these changes. See the conf file below.

xport WORKER_LOCATION=/home/ubuntu
export WORKER_HOSTS="192.168.100.3 192.168.100.4"
export WORKER_MODE=ssh
export WORKER_USERNAME=ubuntu
export IPADDR="192.168.100.2"
export WORKER_LOG_DIR=/home/ubuntu
export WORKER_LOGGING_LEVEL=DEBUG
export WORK=/home/ubuntu/work
export JOBSPERNODE=1
export JOBTHROTTLE=10
export SSH_TUNNELING=yes

setup.sh went fine without errors. see the output below.

Swift version is Swift 0.94.1 swift-r7114 cog-r3803
Assuming /home/ubuntu/swift-cloud-tutorial/bin:/home/ubuntu/swift-cloud-tutorial/app: is already at front of PATH
Saving /home/ubuntu/.swift/swift.properties in /home/ubuntu/.swift/swift.properties.LTCg
Start-coaster-service...
Configuration: /home/ubuntu/swift-cloud-tutorial/scs/coaster-service.conf
Service address: 192.168.100.2
Starting coaster-service
Service port: 52871
Local port: 60572
Generating sites.xml
Cannot find template for persistent-coasters
Starting worker on 192.168.100.3
Starting worker on 192.168.100.4


However, the sites.xml file after part03 are empty. see the output below.

ubuntu at uwe-vm1:~/swift-cloud-tutorial$ more part0*/sites.xml
::::::::::::::
part01/sites.xml
::::::::::::::
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
   <pool handle="localhost">
      <execution provider="local" />
      <profile namespace="karajan" key="jobThrottle">0</profile>
      <profile namespace="karajan" key="initialScore">10000</profile>
      <filesystem provider="local"/>
      <workdirectory>.swift/tmp</workdirectory>
      <profile namespace="swift" key="stagingMethod">local</profile>
   </pool>
</config>
::::::::::::::
part02/sites.xml
::::::::::::::
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
   <pool handle="localhost">
      <execution provider="local" />
      <profile namespace="karajan" key="jobThrottle">0</profile>
      <profile namespace="karajan" key="initialScore">10000</profile>
      <filesystem provider="local"/>
      <workdirectory>.swift/tmp</workdirectory>
      <profile namespace="swift" key="stagingMethod">local</profile>
   </pool>
</config>
::::::::::::::
part03/sites.xml
::::::::::::::
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
   <pool handle="localhost">
      <execution provider="local" />
      <profile namespace="karajan" key="jobThrottle">0</profile>
      <profile namespace="karajan" key="initialScore">10000</profile>
      <filesystem provider="local"/>
      <workdirectory>.swift/tmp</workdirectory>
      <profile namespace="swift" key="stagingMethod">local</profile>
   </pool>
</config>
::::::::::::::
part04/sites.xml
::::::::::::::
::::::::::::::
part05/sites.xml
::::::::::::::
::::::::::::::
part06/sites.xml
::::::::::::::


In the tutorial, part4 onwards is described as running on compute nodes and apps file has entry “cloud sh /bin/bash”, however, I could not see how “cloud” would be resolved. 
This is why, I could not run examples part03 onwards. Any help?


Regards,
Khawar
On 15 Jan 2014, at 16:17, David Kelly <davidk at ci.uchicago.edu> wrote:

> Hi Khawar,
> 
> For running with the cloud tutorial, all the settings are defined in a file called scs/coaster-service.conf. The only things you should need to change there is the list of IP addresses, the remote username, and remote directories to use.
> 
> When you run the command "source setup.sh", it should start the workers on remote sites and create a sites.xml file in each the part directories. Are you getting any errors when you run "source setup.sh"?
> 
> Thanks,
> David
> 
> 
> On Wed, Jan 15, 2014 at 9:34 AM, Khawar Ahmad <khawar.ahmad at cern.ch> wrote:
> Hi,
> 
> I am trying to use SWIFT to run sample programs on my test Cloud setup. I am following a tutorial (http://swift-lang.org/tutorials/cloud/tutorial.html).
> However, the sites.xml file for Part4 is empty and I get the following error from swift 
> "Execution failed:
> 	Could not load file sites.xml: com.thoughtworks.xstream.io.StreamException:  : input contained no data"
>  
> Can you tell me what are the settings to run jobs in the Cloud environment? The Cloud is setup using OpenStack.
> 
> Regards,
> Khawar
> 
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140115/316e1bc7/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2720 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140115/316e1bc7/attachment.bin>