[Swift-devel] command line ssh provider...

Mon Jan 16 13:10:38 CST 2012

On Jan 16, 2012, at 12:58 PM, Mihael Hategan wrote:

> Right. So now after getting to communicado, what happens if you manually
> type ssh -v bridled…

[jonmon at communicado: ~/Workspace/Swift/ssh-cl-test]$ ssh -v -A jonmon at bridled.ci.uchicago.edu
OpenSSH_4.3p2, OpenSSL 0.9.8e-fips-rhel5 01 Jul 2008
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Applying options for *
debug1: Connecting to bridled.ci.uchicago.edu [128.135.125.18] port 22.
debug1: Connection established.
debug1: identity file /home/jonmon/.ssh/identity type -1
debug1: identity file /home/jonmon/.ssh/id_rsa type -1
debug1: identity file /home/jonmon/.ssh/id_dsa type -1
debug1: loaded 3 keys
debug1: Remote protocol version 2.0, remote software version OpenSSH_4.3
debug1: match: OpenSSH_4.3 pat OpenSSH*
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_4.3
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: server->client aes128-ctr hmac-md5 none
debug1: kex: client->server aes128-ctr hmac-md5 none
debug1: SSH2_MSG_KEX_DH_GEX_REQUEST(1024<1024<8192) sent
debug1: expecting SSH2_MSG_KEX_DH_GEX_GROUP
debug1: SSH2_MSG_KEX_DH_GEX_INIT sent
debug1: expecting SSH2_MSG_KEX_DH_GEX_REPLY
debug1: Host 'bridled.ci.uchicago.edu' is known and matches the RSA host key.
debug1: Found key in /home/jonmon/.ssh/known_hosts:16
debug1: ssh_rsa_verify: signature correct
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: SSH2_MSG_NEWKEYS received
debug1: SSH2_MSG_SERVICE_REQUEST sent
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey,gssapi-with-mic,password,keyboard-interactive
debug1: Next authentication method: gssapi-with-mic
debug1: Unspecified GSS failure.  Minor code may provide more information
No credentials cache found

debug1: Unspecified GSS failure.  Minor code may provide more information
No credentials cache found

debug1: Next authentication method: publickey
debug1: Offering public key: /Users/jonmon/.ssh/id_rsa
debug1: Server accepts key: pkalg ssh-rsa blen 277
debug1: Authentication succeeded (publickey).
debug1: channel 0: new [client-session]
debug1: Entering interactive session.
debug1: Requesting authentication agent forwarding.
Last login: Mon Nov 21 13:14:32 2011 from login.ci.uchicago.edu

I do not have a private key in my ~/.ssh directory.  This is all done through agent forwarding from my mac(which does have the private key).
> 
> Also, have you tried to add the "-v" in the ssh-cl provider and see
> what's in the logs?
> 
I added the line:
cmdarray("-v");

as the first parameter in the ArrayList.  However I cannot make anything show up in the logs.  I tried entering in the wrong password as well as the correct password.  Is there anything else that needs to be added to the JobSubmissionTaskHandler file?  Or where else should I look besides the logs?

> Mihael
> 
> On Mon, 2012-01-16 at 12:07 -0600, Jonathan Monette wrote:
>> So I am still having problems getting an agent to be using.  I am running this on communicado.  From my mac I ssh -A jonmon at login.ci.uchicago.edu then ssh -A jonmon at communicado.ci.uchicago.edu
>> 
>> Here is what shows up when I grep for ssh as Mike did.
>> 
>> [jonmon at communicado: ~/Workspace/Swift/ssh-cl-test]$ env | grep -i ssh
>> SSH_CLIENT=128.135.125.155 48486 22
>> SSH_TTY=/dev/pts/0
>> RSHCOMMAND=/usr/bin/ssh
>> SSH_AUTH_SOCK=/tmp/ssh-mtYNz20726/agent.20726
>> PWD=/home/jonmon/Workspace/Swift/ssh-cl-test
>> SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass
>> CVS_RSH=ssh
>> SSH_CONNECTION=128.135.125.155 48486 128.135.125.17 22
>> HOSTFILE=/home/jonmon/.ssh/known_hosts
>> 
>> [jonmon at communicado: ~/Workspace/Swift/ssh-cl-test]$ export | grep -i ssh
>> declare -x CVS_RSH="ssh"
>> declare -x HOSTFILE="/home/jonmon/.ssh/known_hosts"
>> declare -x PWD="/home/jonmon/Workspace/Swift/ssh-cl-test"
>> declare -x RSHCOMMAND="/usr/bin/ssh"
>> declare -x SSH_ASKPASS="/usr/libexec/openssh/gnome-ssh-askpass"
>> declare -x SSH_AUTH_SOCK="/tmp/ssh-mtYNz20726/agent.20726"
>> declare -x SSH_CLIENT="128.135.125.155 48486 22"
>> declare -x SSH_CONNECTION="128.135.125.155 48486 128.135.125.17 22"
>> declare -x SSH_TTY="/dev/pts/0"
>> 
>> [jonmon at communicado: ~/Workspace/Swift/ssh-cl-test]$ ll /tmp/ssh-mtYNz20726/
>> total 0
>> srwxr-xr-x 1 jonmon ci-users 0 Jan 16 12:01 agent.20726=
>> 
>> As you can see there is an agent set up where the SSH_AUTH_SOCK variable is pointing to.  However when I try to run my swift script that just runs hostname on the remote machine I get prompted for a password.
>> 
>> [jonmon at communicado: ~/Workspace/Swift/ssh-cl-test]$ ll
>> total 6.0K
>> -rw-r--r-- 1 jonmon ci-users 297 Jul 14  2011 cf
>> -rw-r--r-- 1 jonmon ci-users 111 Jan 12 15:40 hostname.swift
>> -rw-r--r-- 1 jonmon ci-users  24 Jan 12 15:42 hostname.txt
>> -rwxr-xr-x 1 jonmon ci-users  79 Jan 12 13:09 run.sh*
>> -rw-r--r-- 1 jonmon ci-users 361 Jan 16 11:58 sites.xml
>> -rw-r--r-- 1 jonmon ci-users  46 Jan 12 13:12 tc
>> 
>> [jonmon at communicado: ~/Workspace/Swift/ssh-cl-test]$ cat sites.xml 
>> <config>
>> <pool handle="bridled">
>>    <filesystem provider="local" />
>>    <execution provider="ssh-cl" url="bridled.ci.uchicago.edu"/>
>>    <workdirectory>/home/jonmon/Workspace/Swift/swift.workdir</workdirectory>
>>    <profile namespace="karajan" key="jobThrottle">0.20</profile>
>>    <profile namespace="env" key="SWIFT_GEN_SCRIPTS">1</profile>
>> </pool>
>> </config>
>> 
>> [jonmon at communicado: ~/Workspace/Swift/ssh-cl-test]$ cat run.sh 
>> #!/bin/bash
>> 
>> swift -config cf -tc.file tc -sites.file sites.xml hostname.swift
>> [jonmon at communicado: ~/Workspace/Swift/ssh-cl-test]$ ./run.sh 
>> Swift trunk swift-r5498 (swift modified locally) cog-r3347 (cog modified locally)
>> 
>> RunID: 20120116-1205-eke5ge02
>> Progress:  time: Mon, 16 Jan 2012 12:05:22 -0600
>> Password:
>> 
>> Any ideas what to try?  I also tried the -t option that Mike tried but there was not effect.  Still prompted for a password.
>> 
>> On Jan 16, 2012, at 3:36 AM, Mihael Hategan wrote:
>> 
>>> On Fri, 2012-01-13 at 18:00 -0600, Michael Wilde wrote:
>>>> Once I had done that, coasters booted OK.  Then I hit a suspected
>>>> problem in the local provider: it was not accepting jobs, but seemed
>>>> set up OK. Mihael is investigating.
>>> 
>>> Works for me, so I suspect it's more subtle. If you see it again, can
>>> you send me a jstack output of the coaster service?
>>> 
>>> _______________________________________________
>>> Swift-devel mailing list
>>> Swift-devel at ci.uchicago.edu
>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>> 
> 
> 