<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi Igor,<br>
<br>
Are you able to ssh from your machine to legion directly without
entering passwords ?<br>
Could you please send us a tarball of the runNNN directories for a
failing run ?<br>
<br>
I've put the following settings in my ~/.ssh/config on my laptop and
setup ssh keys on<br>
both socrates and legion. This allows me to use "ssh
legion.rc.ucl.ac.uk" and connect.<br>
<br>
Host legion.rc.ucl.ac.uk<br>
User YOUR_USERNAME<br>
Hostname legion.rc.ucl.ac.uk<br>
ProxyCommand ssh socrates -W %h:%p<br>
<br>
Host socrates<br>
Hostname socrates.ucl.ac.uk<br>
User YOUR_USERNAME<br>
ForwardAgent yes<br>
<br>
Thanks,<br>
Yadu<br>
<br>
<br>
<div class="moz-cite-prefix">On 05/04/2015 07:51 AM, Igor Russo
wrote:<br>
</div>
<blockquote
cite="mid:CAC5KLL7MVdqxFoX47nxU1jtp+Wk2w4Jrxnt12EUrxwvj2nxrxg@mail.gmail.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<div dir="ltr">Hi Yadu,
<div><br>
</div>
<div>Thanks again.</div>
<div><br>
</div>
<div>I tried your suggestion. Now i'm not getting the previous
error, but the jobs aren't being submitted:</div>
<div><br>
</div>
<div>
<div>RunID: run001</div>
<div>Progress: Seg, 04 Mai 2015 09:32:54-0300</div>
<div>Progress: Seg, 04 Mai 2015 09:32:55-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:33:25-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:33:55-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:34:25-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:34:55-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:35:25-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:35:55-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:36:25-0300 Submitting:1</div>
</div>
<div><br>
</div>
<div>In the the log file, i notice the following errors:</div>
<div><br>
</div>
<div>
<div>2015-05-04 09:24:06,223-0300 INFO ServiceManager Service
does not appear to be registered with this manager</div>
<div>2015-05-04 09:24:06,223-0300 INFO ServiceManager Coaster
service ended. Reason: null</div>
</div>
<div><br>
</div>
<div>Thanks,<br>
</div>
<div>Igor</div>
<div>
<div><br>
</div>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2015-05-01 17:47 GMT-03:00 Yadu Nand
Babuji <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:yadunand@uchicago.edu" target="_blank">yadunand@uchicago.edu</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div class="gmail_default"
style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">Hi
Igor,</div>
<div class="gmail_default"
style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
</div>
<div class="gmail_default"
style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">The
remote connection system requires that the local machine
you run the swift client on has</div>
<div class="gmail_default"
style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">a
public ip address. It looks like swift was not able to
guess it and set it to<span
style="font-family:arial,sans-serif;font-size:12.8000001907349px"> </span><a
moz-do-not-send="true"
href="http://igor-ubuntu:51251/"
style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:12.8000001907349px"
target="_blank">http://igor-ubuntu:51251</a></div>
<div class="gmail_default"
style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
</div>
<div class="gmail_default"
style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">Could
you retry running part04 after doing the next step, and
please make sure your environment has<br>
these variables set whenever you run swift to remote
systems :</div>
<div class="gmail_default"
style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">
<div class="gmail_default">export
GLOBUS_HOSTNAME=<PUBLIC_IP_OF_YOUR_MACHINE></div>
<div class="gmail_default">export
GLOBUS_TCP_PORT_RANGE=50000,51000</div>
<div class="gmail_default"><br>
</div>
<div class="gmail_default">Thanks,</div>
<div class="gmail_default">Yadu</div>
</div>
<div>
<div class="h5">
<div class="gmail_default"
style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
</div>
<br>
<div>On 05/01/2015 02:29 PM, Igor Russo wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div style="font-size:12.8000001907349px">Hi Yadu,<br>
</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">Thank
you very much!</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">I
changed the config file with the data from my
cluster.</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">When
executing the 4th part of Swift-tutorial, i'm
getting the following error:</div>
<div style="font-size:12.8000001907349px">"Failed
to download bootstrap jar from ..."</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">--------------------------------------------------------------------------------</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">RunID:
run031<br>
</div>
<div style="font-size:12.8000001907349px">
<div>Progress: Sex, 01 Mai 2015 15:40:42-0300</div>
<div>Progress: Sex, 01 Mai 2015 15:40:43-0300
Submitting:1</div>
<div><br>
</div>
<div>Execution failed:</div>
<div>Exception in sort:</div>
<div> Arguments: [-n, unsorted.txt]</div>
<div> Host: mmc</div>
<div> Directory:
p4-run031/jobs/s/sort-go28d68m</div>
<div><span style="white-space:pre-wrap"> </span>exception
@ swift-int-staging.k, line: 165</div>
<div>Caused by: </div>
<div><span style="white-space:pre-wrap"> </span>exception
@ swift-int-staging.k, line: 160</div>
<div>Caused by: null</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Could not submit job</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Could not start coaster service</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Task ended before registration was received. </div>
<div>Failed to download bootstrap jar from <a
moz-do-not-send="true"
href="http://igor-ubuntu:51251/"
target="_blank">http://igor-ubuntu:51251</a></div>
<div><br>
</div>
<div><span style="white-space:pre-wrap"> </span>k:assign
@ swift.k, line: 174</div>
<div>Caused by: Exception in sort:</div>
<div> Arguments: [-n, unsorted.txt]</div>
<div> Host: mmc</div>
<div> Directory:
p4-run031/jobs/s/sort-go28d68m</div>
<div><span style="white-space:pre-wrap"> </span>exception
@ swift-int-staging.k, line: 165</div>
<div>Caused by: </div>
<div><span style="white-space:pre-wrap"> </span>exception
@ swift-int-staging.k, line: 160</div>
<div>Caused by: null</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Could not submit job</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Could not start coaster service</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Task ended before registration was received. </div>
<div>Failed to download bootstrap jar from <a
moz-do-not-send="true"
href="http://igor-ubuntu:51251/"
target="_blank">http://igor-ubuntu:51251</a></div>
</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">--------------------------------------------------------------------------------<br>
</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">Thanks,</div>
<div style="font-size:12.8000001907349px">Igor</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2015-05-01 13:47
GMT-03:00 Yadu Nand Babuji <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:yadunand@uchicago.edu"
target="_blank">yadunand@uchicago.edu</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0
0 0 .8ex;border-left:1px #ccc
solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"> Hi
Igor,<br>
<br>
Swift does support SGE clusters, and you can
refer to the swift-tutorial<br>
for sample code and configurations from this
link:<br>
<a moz-do-not-send="true"
href="https://github.com/swift-lang/swift-tutorial"
target="_blank">https://github.com/swift-lang/swift-tutorial</a><br>
<br>
Here's a sample config from our test-suite
for Godzilla, an SGE cluster at UChicago:<br>
<a moz-do-not-send="true"
href="https://github.com/swift-lang/swift-k/blob/master/tests/sites/godzilla/swift.conf"
target="_blank">https://github.com/swift-lang/swift-k/blob/master/tests/sites/godzilla/swift.conf</a><br>
You could modify and add this config to the
swift.conf file in the swift-tutorial to run
<br>
Swift on any machine and execute on a remote
SGE cluster.<br>
<br>
SGE is a widely used resource manager and
most sites have differences in<br>
their setups that make each site unique. If
you run into issues with the default<br>
swift package, and could provide help in
figuring out specifics of your cluster, we<br>
will help you adapt the Swift SGE provider
to support your cluster.<br>
<br>
Thanks,<br>
Yadu
<div>
<div><br>
<br>
<br>
<div>On 04/28/2015 05:09 PM, Igor Russo
wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">Hi All,
<div><br>
</div>
<div>It is possible to use Swift
with a remote SGE/OGE cluster?</div>
<div><br>
</div>
<div>Regards,</div>
<div>Igor</div>
</div>
<br>
<fieldset></fieldset>
<br>
</div>
</div>
<pre>_______________________________________________
Swift-user mailing list
<a moz-do-not-send="true" href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a moz-do-not-send="true" href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
</blockquote>
<br>
</div>
<br>
_______________________________________________<br>
Swift-user mailing list<br>
<a moz-do-not-send="true"
href="mailto:Swift-user@ci.uchicago.edu"
target="_blank">Swift-user@ci.uchicago.edu</a><br>
<a moz-do-not-send="true"
href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user"
target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Swift-user mailing list
<a moz-do-not-send="true" href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a moz-do-not-send="true" href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Swift-user mailing list<br>
<a moz-do-not-send="true"
href="mailto:Swift-user@ci.uchicago.edu">Swift-user@ci.uchicago.edu</a><br>
<a moz-do-not-send="true"
href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user"
target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Swift-user mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Swift-user@ci.uchicago.edu">Swift-user@ci.uchicago.edu</a>
<a class="moz-txt-link-freetext" href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
</blockquote>
<br>
</body>
</html>