[Swift-user] running jobs on cluster or cloud

Justin bbt justinbbt at gmail.com
Thu Aug 28 18:49:05 CDT 2014


Hi all,

 I could successfully run swift on my local system.
Next, I want to use the swift to run some jobs on a cluster.

I followed this tutorial.  (I am using just a simple cluster- I even could
not run the job on one remote node of the cluster)
http://swift-lang.org/tutorials/cloud/tutorial.html

But, I get this when I run swift p1.swift or other swift

Swift 0.94.1 swift-r7114 cog-r3803

RunID: 20140828-1758-ea4phzag
Progress:  time: Thu, 28 Aug 2014 17:58:15 -0400
Progress:  time: Thu, 28 Aug 2014 17:58:24 -0400  Submitted:1
Execution failed:
Exception in simulate:
    Arguments: []
    Host: remotehost2
    Directory: p1-20140828-1758-ea4phzag/jobs/7/simulate-7k2fxlvl

Caused by:
Job failed with an exit code of 127
simulation, p1.swift, line 9


--- this is my site.xml file setting

   <pool handle="remotehost2">
      <execution provider="ssh" jobmanager="ssh:local" url="myclusteturl"/>
      <filesystem provider="ssh" url="myclusteturl"/>
      <profile namespace="karajan" key="jobThrottle">0</profile>
      <profile namespace="karajan" key="initialScore">10000</profile>
      <workdirectory>/path/to/remote/workdirectory</workdirectory>
   </pool>

--- if I use this one
<pool handle="persistent-coasters">
    <execution provider="coaster-persistent"
               url="myclusterurl"
               jobmanager="local:local"/>
    <profile namespace="globus" key="workerManager">passive</profile>
    <profile namespace="globus" key="jobsPerNode">1</profile>
    <profile key="jobThrottle" namespace="karajan">10</profile>
    <profile namespace="karajan" key="initialScore">10000</profile>
    <filesystem provider="local" url="none" />
    <workdirectory>.l</workdirectory>
  </pool>
--- then it loops to my localhost and just repeat submitting the jobs

1. Is this a correct setting?
2. Should I use coaster? I could not understand the description in user
guides and documentation about the concepts of coaster and the required
setting. Is there any better tutorial which would describe the coaster ?
3. I plan to use the swift later on the cloud (Microsoft Azure). What are
the setting required for that? for site.xml and if any other file


Thanks in Advance.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140828/ecf2ff09/attachment.html>


More information about the Swift-user mailing list