[Swift-user] how to run swift script against a local cluster

Jiao Lin linjiao at caltech.edu
Sun Feb 2 13:50:38 CST 2014


Hello,

We just learned about swift and are trying to use swift to run computations on a local cluster. I was trying to follow the note at http://rmcgibbo.github.io/blog/2013/06/03/setting-up-swift/

When trying to run a simple echo command at a local cluster using coaster provider, I got an error:

$ swift echo.swift
Swift 0.94.1 swift-r7114 cog-r3803

RunID: 20140202-1140-yyytkso6
Progress:  time: Sun, 02 Feb 2014 11:40:58 -0800
Execution failed:
        Exception in echo:
    Arguments: [hello]
    Host: fram
    Directory: echo-20140202-1140-yyytkso6/jobs/0/echo-0dqo8vll

Caused by:
        Could not submit job
Caused by:
        Could not start coaster service
Caused by:
        java.lang.NullPointerException
        at org.globus.cog.abstraction.impl.execution.coaster.AutoCA.ensureCACertsExist(AutoCA.java:143)
        at org.globus.cog.abstraction.impl.execution.coaster.AutoCA.createProxy(AutoCA.java:128)
        at org.globus.cog.abstraction.impl.execution.coaster.ServiceManager.setupGSIProxy(ServiceManager.java:238)
        at org.globus.cog.abstraction.impl.execution.coaster.ServiceManager.startService(ServiceManager.java:194)
        at org.globus.cog.abstraction.impl.execution.coaster.ServiceManager.reserveService(ServiceManager.java:132)
        at org.globus.cog.abstraction.impl.execution.coaster.ServiceManager.reserveService(ServiceManager.java:151)
        at org.globus.cog.abstraction.impl.execution.coaster.JobSubmissionTaskHandler.getChannel(JobSubmissionTaskHandler.java:119)
        at org.globus.cog.abstraction.impl.execution.coaster.JobSubmissionTaskHandler.submit(JobSubmissionTaskHandler.java:105)
        at org.globus.cog.abstraction.impl.common.AbstractTaskHandler.submit(AbstractTaskHandler.java:45)
        at org.globus.cog.karajan.scheduler.submitQueue.NonBlockingSubmit.run(NonBlockingSubmit.java:97)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:679)

        echo, echo.swift, line 11

It seems it failed when globus is trying to get certificates? Is it necessary to install some kind of globus service on the cluster?

I wonder what kind of requirements are there for the cluster? The cluster has java 1.7 installed:

java version "1.7.0_51"
Java(TM) SE Runtime Environment (build 1.7.0_51-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode)

Your help is much appreciated.

Jiao
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20140202/84dc7e52/attachment.html>


More information about the Swift-user mailing list