[Swift-devel] command line ssh provider...

[Michael Wilde]

ssh-cl worked for me going from communicado to both login.ci and bridled.

I *assumed* it used my agent because I did not get a password prompt from the swift run. And I dont get a password prompt when running the ssh command line.

It failed when I tried to use coasters with either provider staging (to login.mcs) or localhost/shared workdir (to login.ci).

The command line and stdout/err for the coaster/local-workdir case is below. The logs are on ci net under ~wilde/swift/lab. Config and sites file was:

com$ cat cf
wrapperlog.always.transfer=true
sitedir.keep=true
execution.retries=0
lazy.errors=false
status.mode=provider
use.provider.staging=false
provider.staging.pin.swiftfiles=false

com$ cat sshcl.xml
<config>
  <pool handle="localhost">
    <execution provider="ssh-cl" url="login.ci.uchicago.edu"/>
    <filesystem provider="local"/>
    <workdirectory>/home/wilde/swiftwork</workdirectory>
  </pool>
</config>
com$ 

com$ cat sshclcoast.xml
<config>
  <pool handle="localhost">
    <execution provider="coaster" url="login.ci.uchicago.edu" jobmanager="ssh-cl:local"/>

    <profile namespace="globus" key="jobsPerNode">8</profile>
    <profile namespace="globus" key="slots">1</profile>
    <profile namespace="globus" key="nodeGranularity">1</profile>
    <profile namespace="globus" key="maxNodes">1</profile>
    <profile namespace="karajan" key="jobThrottle">.01</profile>
    <profile namespace="karajan" key="initialScore">10000</profile>

    <filesystem provider="local"/>
    <workdirectory>/home/wilde/swiftwork</workdirectory>

  </pool>
</config>
com$ 



- Mike

com$ which swift
~/swift/src/trunk/cog/modules/swift/dist/swift-svn/bin/swift
com$ pwd
/home/wilde/swift/lab
com$ swift -tc.file tc -sites.file sshcl.xml -config cf catsn.swift -n=1
Swift trunk swift-r5498 cog-r3347

RunID: 20120112-1343-a7mk2zyc
Progress:  time: Thu, 12 Jan 2012 13:43:04 -0600
Final status: Thu, 12 Jan 2012 13:43:04 -0600  Finished successfully:1
com$ swift -tc.file tc -sites.file sshclcoast.xml -config cf catsn.swift -n=1
Swift trunk swift-r5498 cog-r3347

RunID: 20120112-1343-ql7sn3f7
Progress:  time: Thu, 12 Jan 2012 13:43:20 -0600
Failed to transfer wrapper log for job cat-ihhm6jlk
EXCEPTION Exception in cat:
Arguments: [data.txt]
Host: localhost
Directory: catsn-20120112-1343-ql7sn3f7/jobs/i/cat-ihhm6jlk
stderr.txt: 

stdout.txt: 

----

Caused by: null
Caused by: org.globus.cog.abstraction.impl.common.task.TaskSubmissionException: Could not submit job
Caused by: org.globus.cog.abstraction.impl.common.task.TaskSubmissionException: Could not start coaster service
Caused by: org.globus.cog.abstraction.impl.common.task.TaskSubmissionException: Task ended before registration was received. 
STDOUT: Failed to download bootstrap jar from http://communicado.ci.uchicago.edu:45621

STDERR: This machine accepts SSH public key and One Time Password (OTP) logins only.
If you do not have a public key set up, you will be prompted for a password.
This is *not* your CI password, but the One Time Password generated from your
OTP token.  Do not type your CI password, it will not work.  If you do not
have a token or public key, you will not be able to login.

See http://www.ci.uchicago.edu/faq for more information.

Caused by: org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with an exit code of 1
Execution failed:
	Job failed with an exit code of 1
com$ 


----- Original Message -----
> From: "Jonathan Monette" <jonmon at mcs.anl.gov>
> To: "Mihael Hategan" <hategan at mcs.anl.gov>
> Cc: "Swift Devel" <swift-devel at ci.uchicago.edu>, "Michael Wilde" <wilde at mcs.anl.gov>
> Sent: Thursday, January 12, 2012 1:29:10 PM
> Subject: Re: [Swift-devel] command line ssh provider...
> Mike,
> You mentioned that you were able to use ssh command line provider
> using catsn this morning. Was it using agents? Mihael did you test
> using an agent? How do I specify for it to use an agent if available?
> I can do a simple hostname test from communicado to bridled but it
> asks for my password instead of using the agent I have set up.
> 
> 
> On Jan 12, 2012, at 12:21 AM, Mihael Hategan wrote:
> 
> > ... is in trunk (cog r3347). I was able to start coasters with it.
> > The
> > provider is called "ssh-cl". It is ssh, so ~/.ssh/config and agents
> > will
> > apply. Please test.
> >
> > Mihael
> >
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory