<div dir="ltr"><span style="font-size:12.8000001907349px">Hi Yadu,</span><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Yes, i can ssh from my laptop to the cluster <span style="font-size:12.8000001907349px">directly.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">The coaster-bootstrap-*.log files are created in the remote system.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">I'm sending the log file attached.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">Thanks,</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">Igor</span></div></div><div class="gmail_extra"><br><div class="gmail_quote">2015-05-04 16:57 GMT-03:00 Yadu Nand Babuji <span dir="ltr"><<a href="mailto:yadunand@uchicago.edu" target="_blank">yadunand@uchicago.edu</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
Hi Igor,<br>
<br>
Are you able to ssh from your machine to legion directly without
entering passwords ?<br>
Could you please send us a tarball of the runNNN directories for a
failing run ?<br>
<br>
I've put the following settings in my ~/.ssh/config on my laptop and
setup ssh keys on<br>
both socrates and legion. This allows me to use "ssh
<a href="http://legion.rc.ucl.ac.uk" target="_blank">legion.rc.ucl.ac.uk</a>" and connect.<br>
<br>
Host <a href="http://legion.rc.ucl.ac.uk" target="_blank">legion.rc.ucl.ac.uk</a><br>
User YOUR_USERNAME<br>
Hostname <a href="http://legion.rc.ucl.ac.uk" target="_blank">legion.rc.ucl.ac.uk</a><br>
ProxyCommand ssh socrates -W %h:%p<br>
<br>
Host socrates<br>
Hostname <a href="http://socrates.ucl.ac.uk" target="_blank">socrates.ucl.ac.uk</a><br>
User YOUR_USERNAME<br>
ForwardAgent yes<br>
<br>
Thanks,<br>
Yadu<div><div class="h5"><br>
<br>
<br>
<div>On 05/04/2015 07:51 AM, Igor Russo
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Yadu,
<div><br>
</div>
<div>Thanks again.</div>
<div><br>
</div>
<div>I tried your suggestion. Now i'm not getting the previous
error, but the jobs aren't being submitted:</div>
<div><br>
</div>
<div>
<div>RunID: run001</div>
<div>Progress: Seg, 04 Mai 2015 09:32:54-0300</div>
<div>Progress: Seg, 04 Mai 2015 09:32:55-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:33:25-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:33:55-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:34:25-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:34:55-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:35:25-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:35:55-0300 Submitting:1</div>
<div>Progress: Seg, 04 Mai 2015 09:36:25-0300 Submitting:1</div>
</div>
<div><br>
</div>
<div>In the the log file, i notice the following errors:</div>
<div><br>
</div>
<div>
<div>2015-05-04 09:24:06,223-0300 INFO ServiceManager Service
does not appear to be registered with this manager</div>
<div>2015-05-04 09:24:06,223-0300 INFO ServiceManager Coaster
service ended. Reason: null</div>
</div>
<div><br>
</div>
<div>Thanks,<br>
</div>
<div>Igor</div>
<div>
<div><br>
</div>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2015-05-01 17:47 GMT-03:00 Yadu Nand
Babuji <span dir="ltr"><<a href="mailto:yadunand@uchicago.edu" target="_blank">yadunand@uchicago.edu</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">Hi
Igor,</div>
<div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
</div>
<div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">The
remote connection system requires that the local machine
you run the swift client on has</div>
<div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">a
public ip address. It looks like swift was not able to
guess it and set it to<span style="font-family:arial,sans-serif;font-size:12.8000001907349px"> </span><a href="http://igor-ubuntu:51251/" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:12.8000001907349px" target="_blank">http://igor-ubuntu:51251</a></div>
<div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
</div>
<div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">Could
you retry running part04 after doing the next step, and
please make sure your environment has<br>
these variables set whenever you run swift to remote
systems :</div>
<div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">
<div class="gmail_default">export
GLOBUS_HOSTNAME=<PUBLIC_IP_OF_YOUR_MACHINE></div>
<div class="gmail_default">export
GLOBUS_TCP_PORT_RANGE=50000,51000</div>
<div class="gmail_default"><br>
</div>
<div class="gmail_default">Thanks,</div>
<div class="gmail_default">Yadu</div>
</div>
<div>
<div>
<div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
</div>
<br>
<div>On 05/01/2015 02:29 PM, Igor Russo wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div style="font-size:12.8000001907349px">Hi Yadu,<br>
</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">Thank
you very much!</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">I
changed the config file with the data from my
cluster.</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">When
executing the 4th part of Swift-tutorial, i'm
getting the following error:</div>
<div style="font-size:12.8000001907349px">"Failed
to download bootstrap jar from ..."</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">--------------------------------------------------------------------------------</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">RunID:
run031<br>
</div>
<div style="font-size:12.8000001907349px">
<div>Progress: Sex, 01 Mai 2015 15:40:42-0300</div>
<div>Progress: Sex, 01 Mai 2015 15:40:43-0300
Submitting:1</div>
<div><br>
</div>
<div>Execution failed:</div>
<div>Exception in sort:</div>
<div> Arguments: [-n, unsorted.txt]</div>
<div> Host: mmc</div>
<div> Directory:
p4-run031/jobs/s/sort-go28d68m</div>
<div><span style="white-space:pre-wrap"> </span>exception
@ swift-int-staging.k, line: 165</div>
<div>Caused by: </div>
<div><span style="white-space:pre-wrap"> </span>exception
@ swift-int-staging.k, line: 160</div>
<div>Caused by: null</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Could not submit job</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Could not start coaster service</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Task ended before registration was received. </div>
<div>Failed to download bootstrap jar from <a href="http://igor-ubuntu:51251/" target="_blank">http://igor-ubuntu:51251</a></div>
<div><br>
</div>
<div><span style="white-space:pre-wrap"> </span>k:assign
@ swift.k, line: 174</div>
<div>Caused by: Exception in sort:</div>
<div> Arguments: [-n, unsorted.txt]</div>
<div> Host: mmc</div>
<div> Directory:
p4-run031/jobs/s/sort-go28d68m</div>
<div><span style="white-space:pre-wrap"> </span>exception
@ swift-int-staging.k, line: 165</div>
<div>Caused by: </div>
<div><span style="white-space:pre-wrap"> </span>exception
@ swift-int-staging.k, line: 160</div>
<div>Caused by: null</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Could not submit job</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Could not start coaster service</div>
<div>Caused by:
org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
Task ended before registration was received. </div>
<div>Failed to download bootstrap jar from <a href="http://igor-ubuntu:51251/" target="_blank">http://igor-ubuntu:51251</a></div>
</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">--------------------------------------------------------------------------------<br>
</div>
<div style="font-size:12.8000001907349px"><br>
</div>
<div style="font-size:12.8000001907349px">Thanks,</div>
<div style="font-size:12.8000001907349px">Igor</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2015-05-01 13:47
GMT-03:00 Yadu Nand Babuji <span dir="ltr"><<a href="mailto:yadunand@uchicago.edu" target="_blank">yadunand@uchicago.edu</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"> Hi
Igor,<br>
<br>
Swift does support SGE clusters, and you can
refer to the swift-tutorial<br>
for sample code and configurations from this
link:<br>
<a href="https://github.com/swift-lang/swift-tutorial" target="_blank">https://github.com/swift-lang/swift-tutorial</a><br>
<br>
Here's a sample config from our test-suite
for Godzilla, an SGE cluster at UChicago:<br>
<a href="https://github.com/swift-lang/swift-k/blob/master/tests/sites/godzilla/swift.conf" target="_blank">https://github.com/swift-lang/swift-k/blob/master/tests/sites/godzilla/swift.conf</a><br>
You could modify and add this config to the
swift.conf file in the swift-tutorial to run
<br>
Swift on any machine and execute on a remote
SGE cluster.<br>
<br>
SGE is a widely used resource manager and
most sites have differences in<br>
their setups that make each site unique. If
you run into issues with the default<br>
swift package, and could provide help in
figuring out specifics of your cluster, we<br>
will help you adapt the Swift SGE provider
to support your cluster.<br>
<br>
Thanks,<br>
Yadu
<div>
<div><br>
<br>
<br>
<div>On 04/28/2015 05:09 PM, Igor Russo
wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div>
<div dir="ltr">Hi All,
<div><br>
</div>
<div>It is possible to use Swift
with a remote SGE/OGE cluster?</div>
<div><br>
</div>
<div>Regards,</div>
<div>Igor</div>
</div>
<br>
<fieldset></fieldset>
<br>
</div>
</div>
<pre>_______________________________________________
Swift-user mailing list
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
</blockquote>
<br>
</div>
<br>
_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Swift-user mailing list
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Swift-user mailing list
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
</blockquote>
<br>
</div></div></div>
<br>_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br></blockquote></div><br></div>