Jon,<div><br></div><div>Do you have auth.defaults file in ~/.ssh/ set? It has the following structure:</div><div><br></div><div><div><hostname>.type=key</div><div><hostname>.username=<uname></div><div><hostname>.key=/path/to/key</div>
<div><hostname>.passphrase=<passphrase></div><div><br></div><div>file perm should be 600</div><div><br></div>Regards,</div><div>Ketan</div><div><br><div class="gmail_quote">On Thu, Jan 12, 2012 at 9:24 PM, Jonathan Monette <span dir="ltr"><<a href="mailto:jonmon@mcs.anl.gov">jonmon@mcs.anl.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I am getting a different problem. The provider does not seem to be using an agent.<br>
<br>
Starting from my macbook I can ssh -A <a href="mailto:jonmon@login.ci.uchicago.edu">jonmon@login.ci.uchicago.edu</a> and then do ssh -A <a href="mailto:jonmon@communicado.ci.uchicago.edu">jonmon@communicado.ci.uchicago.edu</a> and then ssh -A <a href="mailto:jonmon@bridled.ci.uchicago.edu">jonmon@bridled.ci.uchicago.edu</a> in the terminal and none of them require a password.<br>
<br>
However if I ssh -A <a href="mailto:jonmon@login.ci.uchicago.edu">jonmon@login.ci.uchicago.edu</a> and then ssh -A <a href="mailto:jonmon@communicado.ci.uchicago.edu">jonmon@communicado.ci.uchicago.edu</a>, then start a Swift run that does a simple hostname call on <a href="http://bridled.ci.uchicago.edu" target="_blank">bridled.ci.uchicago.edu</a> I am prompted for my ci password every time.<br>
<br>
I am more than certain that this is a configuration issue so I ask for suggestions. My next step is to completely undo all my ssh keys in the authorized key files and start fresh with new keys and passphrases that are not in my macbook keychain. I do not really want to basically revert back to nothing regarding ssh configuration but this seems to be my only alternative. Any suggestions?<br>
<div><div></div><div class="h5"><br>
On Jan 12, 2012, at 9:19 PM, Michael Wilde wrote:<br>
<br>
> The boostrap log shows this:<br>
><br>
> com$ cat ~/coaster-bootstrap-1460623968.log<br>
> using plain mode<br>
> BS: <a href="http://communicado.ci.uchicago.edu:45621" target="_blank">http://communicado.ci.uchicago.edu:45621</a><br>
> Failed to download bootstrap jar from <a href="http://communicado.ci.uchicago.edu:45621" target="_blank">http://communicado.ci.uchicago.edu:45621</a><br>
> com$<br>
><br>
> - Mike<br>
><br>
> ----- Original Message -----<br>
>> From: "Mihael Hategan" <<a href="mailto:hategan@mcs.anl.gov">hategan@mcs.anl.gov</a>><br>
>> To: "Michael Wilde" <<a href="mailto:wilde@mcs.anl.gov">wilde@mcs.anl.gov</a>><br>
>> Cc: "Jonathan Monette" <<a href="mailto:jonmon@mcs.anl.gov">jonmon@mcs.anl.gov</a>>, "Swift Devel" <<a href="mailto:swift-devel@ci.uchicago.edu">swift-devel@ci.uchicago.edu</a>><br>
>> Sent: Thursday, January 12, 2012 8:34:36 PM<br>
>> Subject: Re: [Swift-devel] command line ssh provider...<br>
>> Can't test it right now because UCDavis decided to firewall stuff, but<br>
>> I<br>
>> do get the bootstrap script to start and it gets to the wget part.<br>
>><br>
>> So the question is, do you get a bootstrap log?<br>
>><br>
>> On Thu, 2012-01-12 at 13:45 -0600, Michael Wilde wrote:<br>
>>> ssh-cl worked for me going from communicado to both <a href="http://login.ci" target="_blank">login.ci</a> and<br>
>>> bridled.<br>
>>><br>
>>> I *assumed* it used my agent because I did not get a password prompt<br>
>>> from the swift run. And I dont get a password prompt when running<br>
>>> the ssh command line.<br>
>>><br>
>>> It failed when I tried to use coasters with either provider staging<br>
>>> (to login.mcs) or localhost/shared workdir (to <a href="http://login.ci" target="_blank">login.ci</a>).<br>
>>><br>
>>> The command line and stdout/err for the coaster/local-workdir case<br>
>>> is below. The logs are on ci net under ~wilde/swift/lab. Config and<br>
>>> sites file was:<br>
>>><br>
>>> com$ cat cf<br>
>>> wrapperlog.always.transfer=true<br>
>>> sitedir.keep=true<br>
>>> execution.retries=0<br>
>>> lazy.errors=false<br>
>>> status.mode=provider<br>
>>> use.provider.staging=false<br>
>>> provider.staging.pin.swiftfiles=false<br>
>>><br>
>>> com$ cat sshcl.xml<br>
>>> <config><br>
>>> <pool handle="localhost"><br>
>>> <execution provider="ssh-cl" url="<a href="http://login.ci.uchicago.edu" target="_blank">login.ci.uchicago.edu</a>"/><br>
>>> <filesystem provider="local"/><br>
>>> <workdirectory>/home/wilde/swiftwork</workdirectory><br>
>>> </pool><br>
>>> </config><br>
>>> com$<br>
>>><br>
>>> com$ cat sshclcoast.xml<br>
>>> <config><br>
>>> <pool handle="localhost"><br>
>>> <execution provider="coaster" url="<a href="http://login.ci.uchicago.edu" target="_blank">login.ci.uchicago.edu</a>"<br>
>>> jobmanager="ssh-cl:local"/><br>
>>><br>
>>> <profile namespace="globus" key="jobsPerNode">8</profile><br>
>>> <profile namespace="globus" key="slots">1</profile><br>
>>> <profile namespace="globus" key="nodeGranularity">1</profile><br>
>>> <profile namespace="globus" key="maxNodes">1</profile><br>
>>> <profile namespace="karajan" key="jobThrottle">.01</profile><br>
>>> <profile namespace="karajan" key="initialScore">10000</profile><br>
>>><br>
>>> <filesystem provider="local"/><br>
>>> <workdirectory>/home/wilde/swiftwork</workdirectory><br>
>>><br>
>>> </pool><br>
>>> </config><br>
>>> com$<br>
>>><br>
>>><br>
>>><br>
>>> - Mike<br>
>>><br>
>>> com$ which swift<br>
>>> ~/swift/src/trunk/cog/modules/swift/dist/swift-svn/bin/swift<br>
>>> com$ pwd<br>
>>> /home/wilde/swift/lab<br>
>>> com$ swift -tc.file tc -sites.file sshcl.xml -config cf catsn.swift<br>
>>> -n=1<br>
>>> Swift trunk swift-r5498 cog-r3347<br>
>>><br>
>>> RunID: 20120112-1343-a7mk2zyc<br>
>>> Progress: time: Thu, 12 Jan 2012 13:43:04 -0600<br>
>>> Final status: Thu, 12 Jan 2012 13:43:04 -0600 Finished<br>
>>> successfully:1<br>
>>> com$ swift -tc.file tc -sites.file sshclcoast.xml -config cf<br>
>>> catsn.swift -n=1<br>
>>> Swift trunk swift-r5498 cog-r3347<br>
>>><br>
>>> RunID: 20120112-1343-ql7sn3f7<br>
>>> Progress: time: Thu, 12 Jan 2012 13:43:20 -0600<br>
>>> Failed to transfer wrapper log for job cat-ihhm6jlk<br>
>>> EXCEPTION Exception in cat:<br>
>>> Arguments: [data.txt]<br>
>>> Host: localhost<br>
>>> Directory: catsn-20120112-1343-ql7sn3f7/jobs/i/cat-ihhm6jlk<br>
>>> stderr.txt:<br>
>>><br>
>>> stdout.txt:<br>
>>><br>
>>> ----<br>
>>><br>
>>> Caused by: null<br>
>>> Caused by:<br>
>>> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:<br>
>>> Could not submit job<br>
>>> Caused by:<br>
>>> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:<br>
>>> Could not start coaster service<br>
>>> Caused by:<br>
>>> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:<br>
>>> Task ended before registration was received.<br>
>>> STDOUT: Failed to download bootstrap jar from<br>
>>> <a href="http://communicado.ci.uchicago.edu:45621" target="_blank">http://communicado.ci.uchicago.edu:45621</a><br>
>>><br>
>>> STDERR: This machine accepts SSH public key and One Time Password<br>
>>> (OTP) logins only.<br>
>>> If you do not have a public key set up, you will be prompted for a<br>
>>> password.<br>
>>> This is *not* your CI password, but the One Time Password generated<br>
>>> from your<br>
>>> OTP token. Do not type your CI password, it will not work. If you do<br>
>>> not<br>
>>> have a token or public key, you will not be able to login.<br>
>>><br>
>>> See <a href="http://www.ci.uchicago.edu/faq" target="_blank">http://www.ci.uchicago.edu/faq</a> for more information.<br>
>>><br>
>>> Caused by:<br>
>>> org.globus.cog.abstraction.impl.common.execution.JobException: Job<br>
>>> failed with an exit code of 1<br>
>>> Execution failed:<br>
>>> Job failed with an exit code of 1<br>
>>> com$<br>
>>><br>
>>><br>
>>> ----- Original Message -----<br>
>>>> From: "Jonathan Monette" <<a href="mailto:jonmon@mcs.anl.gov">jonmon@mcs.anl.gov</a>><br>
>>>> To: "Mihael Hategan" <<a href="mailto:hategan@mcs.anl.gov">hategan@mcs.anl.gov</a>><br>
>>>> Cc: "Swift Devel" <<a href="mailto:swift-devel@ci.uchicago.edu">swift-devel@ci.uchicago.edu</a>>, "Michael Wilde"<br>
>>>> <<a href="mailto:wilde@mcs.anl.gov">wilde@mcs.anl.gov</a>><br>
>>>> Sent: Thursday, January 12, 2012 1:29:10 PM<br>
>>>> Subject: Re: [Swift-devel] command line ssh provider...<br>
>>>> Mike,<br>
>>>> You mentioned that you were able to use ssh command line provider<br>
>>>> using catsn this morning. Was it using agents? Mihael did you test<br>
>>>> using an agent? How do I specify for it to use an agent if<br>
>>>> available?<br>
>>>> I can do a simple hostname test from communicado to bridled but it<br>
>>>> asks for my password instead of using the agent I have set up.<br>
>>>><br>
>>>><br>
>>>> On Jan 12, 2012, at 12:21 AM, Mihael Hategan wrote:<br>
>>>><br>
>>>>> ... is in trunk (cog r3347). I was able to start coasters with<br>
>>>>> it.<br>
>>>>> The<br>
>>>>> provider is called "ssh-cl". It is ssh, so ~/.ssh/config and<br>
>>>>> agents<br>
>>>>> will<br>
>>>>> apply. Please test.<br>
>>>>><br>
>>>>> Mihael<br>
>>>>><br>
>>>>> _______________________________________________<br>
>>>>> Swift-devel mailing list<br>
>>>>> <a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
>>>>> <a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
>>><br>
><br>
> --<br>
> Michael Wilde<br>
> Computation Institute, University of Chicago<br>
> Mathematics and Computer Science Division<br>
> Argonne National Laboratory<br>
><br>
<br>
_______________________________________________<br>
Swift-devel mailing list<br>
<a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Ketan<br><br><br>
</div>