[Swift-user] running jobs on cluster or cloud

Justin bbt justinbbt at gmail.com
Thu Aug 28 18:57:40 CDT 2014


Hi all,
>
>  I could successfully run swift on my local system.
> Next, I want to use the swift to run some jobs on a cluster.
>
> I followed this tutorial.  (I am using just a simple cluster- I even could
> not run the job on one remote node of the cluster)
> http://swift-lang.org/tutorials/cloud/tutorial.html
>
> But, I get this when I run swift p1.swift or other swift
>
> Swift 0.94.1 swift-r7114 cog-r3803
>
> RunID: 20140828-1758-ea4phzag
> Progress:  time: Thu, 28 Aug 2014 17:58:15 -0400
> Progress:  time: Thu, 28 Aug 2014 17:58:24 -0400  Submitted:1
> Execution failed:
> Exception in simulate:
>     Arguments: []
>     Host: remotehost2
>     Directory: p1-20140828-1758-ea4phzag/jobs/7/simulate-7k2fxlvl
>
> Caused by:
> Job failed with an exit code of 127
> simulation, p1.swift, line 9
>
>
> --- this is my site.xml file setting
>
>    <pool handle="remotehost2">
>       <execution provider="ssh" jobmanager="ssh:local" url="myclusteturl"/>
>       <filesystem provider="ssh" url="myclusteturl"/>
>       <profile namespace="karajan" key="jobThrottle">0</profile>
>       <profile namespace="karajan" key="initialScore">10000</profile>
>       <workdirectory>/path/to/remote/workdirectory</workdirectory>
>    </pool>
>
> --- if I use this one
> <pool handle="persistent-coasters">
>     <execution provider="coaster-persistent"
>                url="myclusterurl"
>                jobmanager="local:local"/>
>     <profile namespace="globus" key="workerManager">passive</profile>
>     <profile namespace="globus" key="jobsPerNode">1</profile>
>     <profile key="jobThrottle" namespace="karajan">10</profile>
>     <profile namespace="karajan" key="initialScore">10000</profile>
>     <filesystem provider="local" url="none" />
>     <workdirectory>.l</workdirectory>
>   </pool>
> --- then it loops to my localhost and just repeat submitting the jobs
>
> 1. Is this a correct setting?
> 2. Should I use coaster? I could not understand the description in user
> guides and documentation about the concepts of coaster and the required
> setting. Is there any better tutorial which would describe the coaster ?
> 3. I plan to use the swift later on the cloud (Microsoft Azure). What are
> the setting required for that? for site.xml and if any other file
>
>
> Thanks in Advance.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140828/d9bbe08a/attachment.html>


More information about the Swift-user mailing list