<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Tahoma
}
--></style>
</head>
<body class='hmmessage'><div dir='ltr'>
Sure, attached are the output of stdout and stderror, and the log generated by swift.<div><br><br><div>> Subject: RE: [Swift-devel] ssh test case on pads/beagle<br>> From: hategan@mcs.anl.gov<br>> To: alberto_chavez@live.com<br>> CC: jonmon@mcs.anl.gov; swift-devel@ci.uchicago.edu<br>> Date: Thu, 11 Aug 2011 00:18:07 -0700<br>> <br>> Can you post (a link to) the entire log file? Since it contains both the<br>> tc.data and sites.xml and the error, it's probably always better to post<br>> than individual snippets.<br>> <br>> On Thu, 2011-08-11 at 01:17 -0500, Alberto Chavez wrote:<br>> > Sure:<br>> > <br>> > <config><br>> > <pool handle="ssh"><br>> > <execution provider="ssh" url="steamroller" jobmanager="ssh"/><br>> > <filesystem provider="ssh" url="steamroller" /><br>> > <profile key="jobThrottle" namespace="karajan">0</profile><br>> > <workdirectory>/home/achavez/swiftwork</workdirectory><br>> > </pool><br>> > </config><br>> > <br>> > <br>> > ______________________________________________________________________<br>> > To: alberto_chavez@live.com<br>> > From: jonmon@mcs.anl.gov<br>> > CC: hategan@mcs.anl.gov; swift-devel@ci.uchicago.edu<br>> > Subject: Re: [Swift-devel] ssh test case on pads/beagle<br>> > Date: Wed, 10 Aug 2011 23:54:24 -0500<br>> > <br>> > Could you post the sites file? <br>> > <br>> > ----- Reply message -----<br>> > From: "Alberto Chavez" <alberto_chavez@live.com><br>> > Date: Wed, Aug 10, 2011 7:16 pm<br>> > Subject: [Swift-devel] ssh test case on pads/beagle<br>> > To: <jonmon@mcs.anl.gov><br>> > Cc: "Mihael Hategan" <hategan@mcs.anl.gov>, "Swift Devel"<br>> > <swift-devel@ci.uchicago.edu><br>> > <br>> > <br>> > <br>> > Exit code "127" normally means that a particular function doesn't<br>> > exist. Are you sure that all those paths to apps exist?<br>> > > Yes, I doubled check that and those are the right paths to the apps.<br>> > <br>> > <br>> > Also, I am not sure if this is a problem but shouldn't there be a<br>> > third column in the app file? LIke<br>> > "ssh echo /bin/echo null null null"<br>> > <br>> > <br>> > <br>> > <br>> > Looking at the documentation for the transformation catalog, the<br>> > structure should be:<br>> > <br>> > site, transformation name, executable path, installation status,<br>> > platform, and profile entries.<br>> > <br>> > <br>> > <br>> > <br>> > <br>> > The installation status and platform fields are not used. Set them<br>> > to INSTALLED and INTEL32::LINUX respectively.<br>> > <br>> > The profiles field should be set to null if no profile entries are to<br>> > be specified, or should contain the profile entries separated by<br>> > semicolons.<br>> > <br>> > <br>> > but even when I switch the columns to INSTALLED and INTEL32::LINUX and<br>> > keep the profiles field set to null, I'm still getting the same exit<br>> > code.<br>> > <br>> > <br>> > On Aug 10, 2011, at 6:41 PM, Alberto Chavez wrote:<br>> > <br>> > I changed my ssh-key, and they worked on the MCS machines<br>> > because the authorized_keys file has not been updated yet on<br>> > the CI Machines. <br>> > I created a new ssh-key using:<br>> > ssh-keygen -t rsa -b 2048<br>> > exactly as the MCS site suggested,<br>> > On the other hand, I still have a problem, I am getting the<br>> > following error:<br>> > <br>> > <br>> > Swift svn swift-r4978 cog-r3226<br>> > <br>> > <br>> > RunID: 20110810-1819-1cdo2o62<br>> > Progress: time: Wed, 10 Aug 2011 18:19:42 -0500<br>> > Exception in cat:<br>> > Arguments: [data.txt]<br>> > Host: ssh<br>> > Directory:<br>> > 001-catsn-ssh-20110810-1819-1cdo2o62/jobs/9/cat-9jd0g9ek<br>> > - - -<br>> > Caused by: null<br>> > Caused by:<br>> > org.globus.cog.abstraction.impl.common.execution.JobException:<br>> > Job failed with an exit code of 127<br>> > Final status: time: Wed, 10 Aug 2011 18:20:00 -0500<br>> > Failed:10<br>> > The following errors have occurred:<br>> > 1. Job failed with an exit code of 127 (10 times)<br>> > <br>> > <br>> > <br>> > <br>> > These are the contents of the log:<br>> > <br>> > <br>> > Execution completed with errors<br>> > <br>> > <br>> > 2011-08-10 18:19:43,251-0500 INFO ConnectionProtocol Freeing<br>> > channel 0 [Unnamed Channel]<br>> > 2011-08-10 18:19:43,263-0500 INFO Exec Exit code 127<br>> > 2011-08-10 18:19:43,269-0500 INFO ConnectionProtocol Freeing<br>> > channel 0 [Unnamed Channel]<br>> > 2011-08-10 18:19:43,277-0500 DEBUG vdl:execute2<br>> > APPLICATION_EXCEPTION jobid=cat-9jd0g9ek - Application<br>> > exception: null<br>> > Caused by:<br>> > org.globus.cog.abstraction.impl.common.execution.JobException:<br>> > Job failed with an exit code of 127<br>> > 2011-08-10 18:19:43,280-0500 INFO vdl:execute END_FAILURE<br>> > thread=0-5-3-1 tr=cat<br>> > 2011-08-10 18:19:43,281-0500 INFO vdl:execute Exception in<br>> > cat:<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.fail(FlowNode.java:250)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.fail(FlowNode.java:254)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.GenerateErrorNode.post(GenerateErrorNode.java:27)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:28)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:29)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:20)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:139)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:197)<br>> > at<br>> > org.globus.cog.karajan.workflow.FlowElementWrapper.start(FlowElementWrapper.java:227)<br>> > at<br>> > org.globus.cog.karajan.workflow.events.EventBus.start(EventBus.java:104)<br>> > at<br>> > org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:40)<br>> > at java.util.concurrent.Executors<br>> > $RunnableAdapter.call(Executors.java:471)<br>> > at java.util.concurrent.FutureTask<br>> > $Sync.innerRun(FutureTask.java:334)<br>> > at<br>> > java.util.concurrent.FutureTask.run(FutureTask.java:166)<br>> > at<br>> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)<br>> > at java.util.concurrent.ThreadPoolExecutor<br>> > $Worker.run(ThreadPoolExecutor.java:603)<br>> > at java.lang.Thread.run(Thread.java:636)<br>> > 2011-08-10 18:20:00,332-0500 INFO ExecutionContext Detailed<br>> > exception:<br>> > <br>> > <br>> > Execution completed with errors<br>> > <br>> > <br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.fail(FlowNode.java:250)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.fail(FlowNode.java:254)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.GenerateErrorNode.post(GenerateErrorNode.java:27)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:28)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:29)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:20)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:139)<br>> > at<br>> > org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:197)<br>> > at<br>> > org.globus.cog.karajan.workflow.FlowElementWrapper.start(FlowElementWrapper.java:227)<br>> > at<br>> > org.globus.cog.karajan.workflow.events.EventBus.start(EventBus.java:104)<br>> > at<br>> > org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:40)<br>> > at java.util.concurrent.Executors<br>> > $RunnableAdapter.call(Executors.java:471)<br>> > at java.util.concurrent.FutureTask<br>> > $Sync.innerRun(FutureTask.java:334)<br>> > at<br>> > java.util.concurrent.FutureTask.run(FutureTask.java:166)<br>> > at<br>> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)<br>> > at java.util.concurrent.ThreadPoolExecutor<br>> > $Worker.run(ThreadPoolExecutor.java:603)<br>> > at java.lang.Thread.run(Thread.java:636)<br>> > <br>> > I believe that the problem resides on the TC file because when<br>> > I run a much simpler SwiftScript like:<br>> > <br>> > <br>> > int i = 9;<br>> > trace(i);<br>> > <br>> > <br>> > I get the following output:<br>> > <br>> > <br>> > swift traceme.swift -tc.file tc.template.data<br>> > -sites.file sites.template.xml -config cf <br>> > Swift svn swift-r4978 cog-r3226<br>> > <br>> > <br>> > RunID: 20110810-1832-buktjj3d<br>> > Progress: time: Wed, 10 Aug 2011 18:32:30 -0500<br>> > SwiftScript trace: 9.0<br>> > Final status: time: Wed, 10 Aug 2011 18:32:30 -0500<br>> > <br>> > <br>> > but as soon as I start using the commands stated the TC file,<br>> > I get the "exit code 127"<br>> > <br>> > <br>> > My tc file reads:<br>> > <br>> > <br>> > ssh echo /bin/echo null null<br>> > ssh cat /bin/cat null null<br>> > ssh ls /bin/ls null null<br>> > ssh grep /bin/grep null null<br>> > ssh sort /bin/sort null null<br>> > ssh paste /bin/paste null null<br>> > ssh wc /usr/bin/wc null null<br>> > <br>> > <br>> > I am working on the login node of the MCS machine trying to<br>> > ssh via Swift to steamroller.<br>> > <br>> > <br>> > > Subject: Re: [Swift-devel] ssh test case on pads/beagle<br>> > > From: hategan@mcs.anl.gov<br>> > > To: alberto_chavez@live.com<br>> > > CC: swift-devel@ci.uchicago.edu<br>> > > Date: Tue, 9 Aug 2011 11:57:06 -0700<br>> > > <br>> > > Hmm: Unsupported passphrase algorithm: AES-128-CBC<br>> > > <br>> > > I'll try to see how that can be fixed. In the mean time, can<br>> > you<br>> > > generate a new key pair with 3DES encryption instead and use<br>> > that?<br>> > > <br>> > > On Tue, 2011-08-09 at 13:43 -0500, Alberto Chavez wrote:<br>> > > > Hello,<br>> > > > <br>> > > > <br>> > > > I am trying to run a simpler case than ssh-pbs-coaster<br>> > test case, and<br>> > > > I'm still having the same error.<br>> > > > Now I am running only ssh test case<br>> > > > (/tests/providers/ssh/001-catsn-ssn.swift)<br>> > > > <br>> > > > <br>> > > > The command line is:<br>> > > > swift -config cf -tc.file tc.template.data -sites.file<br>> > > > sites.template.xml 001-catsn-ssh.swift<br>> > > > <br>> > > > <br>> > > > The output:<br>> > > > Swift svn swift-r4861 (swift modified locally) cog-r3183<br>> > > > <br>> > > > <br>> > > > RunID: 20110809-1336-ohte788a<br>> > > > Progress: time: Tue, 09 Aug 2011 13:36:42 -0500<br>> > > > Exception in cat:<br>> > > > Arguments: [data.txt]<br>> > > > Host: ssh<br>> > > > Directory:<br>> > 001-catsn-ssh-20110809-1336-ohte788a/jobs/m/cat-mq74h7ek<br>> > > > - - -<br>> > > > <br>> > > > <br>> > > > Caused by: null<br>> > > > Caused by:<br>> > > ><br>> > org.globus.cog.abstraction.impl.common.task.InvalidSecurityContextException: Invalid private key or passphrase<br>> > > > Caused by:<br>> > > ><br>> > com.sshtools.j2ssh.transport.publickey.InvalidSshKeyException:<br>> > Can't<br>> > > > read key due to cryptography problems:<br>> > > > java.security.NoSuchAlgorithmException: Unsupported<br>> > passphrase<br>> > > > algorithm: AES-128-CBC<br>> > > > Progress: time: Tue, 09 Aug 2011 13:36:43 -0500 Selecting<br>> > site:8<br>> > > > Submitting:1 Failed:1<br>> > > > Exception in cat:<br>> > > > Arguments: [data.txt]<br>> > > > Host: ssh<br>> > > > Directory:<br>> > 001-catsn-ssh-20110809-1336-ohte788a/jobs/n/cat-nq74h7ek<br>> > > > - - -<br>> > > > <br>> > > > <br>> > > > Caused by: null<br>> > > > Caused by:<br>> > > ><br>> > org.globus.cog.abstraction.impl.common.task.InvalidSecurityContextException: Invalid private key or passphrase<br>> > > > Caused by:<br>> > > ><br>> > com.sshtools.j2ssh.transport.publickey.InvalidSshKeyException:<br>> > Can't<br>> > > > read key due to cryptography problems:<br>> > > > java.security.NoSuchAlgorithmException: Unsupported<br>> > passphrase<br>> > > > algorithm: AES-128-CBC<br>> > > > Progress: time: Tue, 09 Aug 2011 13:36:44 -0500 Selecting<br>> > site:7<br>> > > > Submitting:1 Failed:2<br>> > > > Exception in cat:<br>> > > > Arguments: [data.txt]<br>> > > > Host: ssh<br>> > > > Directory:<br>> > 001-catsn-ssh-20110809-1336-ohte788a/jobs/o/cat-oq74h7ek<br>> > > > - - -<br>> > > > <br>> > > > <br>> > > > Caused by: null<br>> > > > Caused by:<br>> > > ><br>> > org.globus.cog.abstraction.impl.common.task.InvalidSecurityContextException: Invalid private key or passphrase<br>> > > > Caused by:<br>> > > ><br>> > com.sshtools.j2ssh.transport.publickey.InvalidSshKeyException:<br>> > Can't<br>> > > > read key due to cryptography problems:<br>> > > > java.security.NoSuchAlgorithmException: Unsupported<br>> > passphrase<br>> > > > algorithm: AES-128-CBC<br>> > > > "error_log.log" 105L, 5770C<br>> > > > <br>> > > > <br>> > > > My auth.defaults reads:<br>> > > > <br>> > > > <br>> > > > login1.beagle.ci.uchicago.edu.type=key<br>> > > > login1.beagle.ci.uchicago.edu.username=achavez<br>> > > ><br>> > login1.beagle.ci.uchicago.edu.key=/home/Alberto/.ssh/identity<br>> > > > <br>> > > > <br>> > > > login1.pads.ci.uchicago.edu.type=key<br>> > > > login1.pads.ci.uchicago.edu.username=achavez<br>> > > ><br>> > login1.pads.ci.uchicago.edu.key=/home/Alberto/.ssh/identity<br>> > > > <br>> > > > <br>> > > > <br>> > > > <br>> > > > and it has been set to 600, I ommited the passphrase line,<br>> > but it is<br>> > > > there, and the passphrase is right because I just verified<br>> > it in two<br>> > > > ways:<br>> > > > 1) by logging to pads and beagle without providing a<br>> > password<br>> > > > 2) "changed" the password. I the "new" password is the<br>> > same as the<br>> > > > "old" one.<br>> > > > <br>> > > > sites.templates.xml:<br>> > > > <br>> > > > <config><br>> > > > <pool handle="ssh"><br>> > > > <execution provider="ssh"<br>> > url="login1.pads.ci.uchicago.edu"<br>> > > > jobmanager="ssh"/><br>> > > > <filesystem provider="ssh"<br>> > url="login1.pads.ci.uchicago.edu" /><br>> > > > <profile key="jobThrottle" namespace="karajan">0</profile><br>> > > > <workdirectory>/home/achavez/swiftwork</workdirectory><br>> > > > </pool><br>> > > > </config><br>> > > > <br>> > > > <br>> > > > config file:<br>> > > > <br>> > > > wrapperlog.always.transfer=true<br>> > > > sitedir.keep=true<br>> > > > execution.retries=0<br>> > > > lazy.errors=true<br>> > > > status.mode=provider<br>> > > > use.provider.staging=true<br>> > > > provider.staging.pin.swiftfiles=false<br>> > > > foreach.max.threads=10<br>> > > > provenance.log=true<br>> > > > <br>> > > > <br>> > > > <br>> > > > <br>> > > > <br>> > > > I also tried a simpler SwiftScript:<br>> > > > <br>> > > > <br>> > > > type filemsg;<br>> > > > <br>> > > > <br>> > > > app (filemsg output) hello(string s)<br>> > > > {<br>> > > > echo s stdout=@filename(output);<br>> > > > }<br>> > > > <br>> > > > <br>> > > > filemsg myfile<"dogcatdinosaur.out">;<br>> > > > myfile = hello("dog,cat,dinosaur");<br>> > > > <br>> > > > <br>> > > > and I get the following output:<br>> > > > <br>> > > > <br>> > > > Swift svn swift-r4861 (swift modified locally) cog-r3183<br>> > > > <br>> > > > <br>> > > > RunID: 20110809-1343-2es2hel2<br>> > > > Progress: time: Tue, 09 Aug 2011 13:43:25 -0500<br>> > > > Exception in echo:<br>> > > > Arguments: [dog,cat,dinosaur]<br>> > > > Host: ssh<br>> > > > Directory:<br>> > hello_swift-20110809-1343-2es2hel2/jobs/0/echo-0oldh7ek<br>> > > > - - -<br>> > > > <br>> > > > <br>> > > > Caused by: null<br>> > > > Caused by:<br>> > > ><br>> > org.globus.cog.abstraction.impl.common.task.InvalidSecurityContextException: Invalid private key or passphrase<br>> > > > Caused by:<br>> > > ><br>> > com.sshtools.j2ssh.transport.publickey.InvalidSshKeyException:<br>> > Can't<br>> > > > read key due to cryptography problems:<br>> > > > java.security.NoSuchAlgorithmException: Unsupported<br>> > passphrase<br>> > > > algorithm: AES-128-CBC<br>> > > > Final status: time: Tue, 09 Aug 2011 13:43:26 -0500<br>> > Failed:1<br>> > > > The following errors have occurred:<br>> > > > 1. Can't read key due to cryptography problems:<br>> > > > java.security.NoSuchAlgorithmException: Unsupported<br>> > passphrase<br>> > > > algorithm: AES-128-CBC<br>> > > > <br>> > > > <br>> > > > <br>> > > > <br>> > > > any thoughts on this? <br>> > > > _______________________________________________<br>> > > > Swift-devel mailing list<br>> > > > Swift-devel@ci.uchicago.edu<br>> > ><br>> > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel<br>> > > <br>> > > <br>> > <br>> > _______________________________________________<br>> > Swift-devel mailing list<br>> > Swift-devel@ci.uchicago.edu<br>> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel<br>> > <br>> > <br>> > <br>> <br>> <br></div></div> </div></body>
</html>