<div dir="ltr"><span style="font-size:12.8000001907349px">Hi Yadu,</span><div style="font-size:12.8000001907349px"><br></div><div style="font-size:12.8000001907349px">Yes, i can ssh from my laptop to the cluster <span style="font-size:12.8000001907349px">directly.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">The coaster-bootstrap-*.log files are created in the remote system.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">I'm sending the log file attached.</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px"><br></span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">Thanks,</span></div><div style="font-size:12.8000001907349px"><span style="font-size:12.8000001907349px">Igor</span></div></div><div class="gmail_extra"><br><div class="gmail_quote">2015-05-04 16:57 GMT-03:00 Yadu Nand Babuji <span dir="ltr"><<a href="mailto:yadunand@uchicago.edu" target="_blank">yadunand@uchicago.edu</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    Hi Igor,<br>
    <br>
    Are you able to ssh from your machine to legion directly without
    entering passwords ?<br>
    Could you please send us a tarball of the runNNN directories for a
    failing run ?<br>
    <br>
    I've put the following settings in my ~/.ssh/config on my laptop and
    setup ssh keys on<br>
    both socrates and legion. This allows me to use "ssh
    <a href="http://legion.rc.ucl.ac.uk" target="_blank">legion.rc.ucl.ac.uk</a>" and connect.<br>
    <br>
    Host <a href="http://legion.rc.ucl.ac.uk" target="_blank">legion.rc.ucl.ac.uk</a><br>
        User YOUR_USERNAME<br>
        Hostname <a href="http://legion.rc.ucl.ac.uk" target="_blank">legion.rc.ucl.ac.uk</a><br>
        ProxyCommand ssh socrates -W %h:%p<br>
    <br>
    Host socrates<br>
        Hostname <a href="http://socrates.ucl.ac.uk" target="_blank">socrates.ucl.ac.uk</a><br>
        User YOUR_USERNAME<br>
        ForwardAgent yes<br>
    <br>
    Thanks,<br>
    Yadu<div><div class="h5"><br>
    <br>
    <br>
    <div>On 05/04/2015 07:51 AM, Igor Russo
      wrote:<br>
    </div>
    <blockquote type="cite">
      
      <div dir="ltr">Hi Yadu,
        <div><br>
        </div>
        <div>Thanks again.</div>
        <div><br>
        </div>
        <div>I tried your suggestion. Now i'm not getting the previous
          error, but the jobs aren't being submitted:</div>
        <div><br>
        </div>
        <div>
          <div>RunID: run001</div>
          <div>Progress: Seg, 04 Mai 2015 09:32:54-0300</div>
          <div>Progress: Seg, 04 Mai 2015 09:32:55-0300  Submitting:1</div>
          <div>Progress: Seg, 04 Mai 2015 09:33:25-0300  Submitting:1</div>
          <div>Progress: Seg, 04 Mai 2015 09:33:55-0300  Submitting:1</div>
          <div>Progress: Seg, 04 Mai 2015 09:34:25-0300  Submitting:1</div>
          <div>Progress: Seg, 04 Mai 2015 09:34:55-0300  Submitting:1</div>
          <div>Progress: Seg, 04 Mai 2015 09:35:25-0300  Submitting:1</div>
          <div>Progress: Seg, 04 Mai 2015 09:35:55-0300  Submitting:1</div>
          <div>Progress: Seg, 04 Mai 2015 09:36:25-0300  Submitting:1</div>
        </div>
        <div><br>
        </div>
        <div>In the the log file, i notice the following errors:</div>
        <div><br>
        </div>
        <div>
          <div>2015-05-04 09:24:06,223-0300 INFO  ServiceManager Service
            does not appear to be registered with this manager</div>
          <div>2015-05-04 09:24:06,223-0300 INFO  ServiceManager Coaster
            service ended. Reason: null</div>
        </div>
        <div><br>
        </div>
        <div>Thanks,<br>
        </div>
        <div>Igor</div>
        <div>
          <div><br>
          </div>
        </div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">2015-05-01 17:47 GMT-03:00 Yadu Nand
          Babuji <span dir="ltr"><<a href="mailto:yadunand@uchicago.edu" target="_blank">yadunand@uchicago.edu</a>></span>:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div bgcolor="#FFFFFF" text="#000000">
              <div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">Hi
                Igor,</div>
              <div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
              </div>
              <div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">The
                remote connection system requires that the local machine
                you run the swift client on has</div>
              <div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">a
                public ip address. It looks like swift was not able to
                guess it and set it to<span style="font-family:arial,sans-serif;font-size:12.8000001907349px"> </span><a href="http://igor-ubuntu:51251/" style="color:rgb(17,85,204);font-family:arial,sans-serif;font-size:12.8000001907349px" target="_blank">http://igor-ubuntu:51251</a></div>
              <div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
              </div>
              <div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">Could
                you retry running part04 after doing the next step, and
                please make sure your environment has<br>
                these variables set whenever you run swift to remote
                systems :</div>
              <div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif">
                <div class="gmail_default">export
                  GLOBUS_HOSTNAME=<PUBLIC_IP_OF_YOUR_MACHINE></div>
                <div class="gmail_default">export
                  GLOBUS_TCP_PORT_RANGE=50000,51000</div>
                <div class="gmail_default"><br>
                </div>
                <div class="gmail_default">Thanks,</div>
                <div class="gmail_default">Yadu</div>
              </div>
              <div>
                <div>
                  <div class="gmail_default" style="color:rgb(34,34,34);font-size:small;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;font-family:arial,helvetica,sans-serif"><br>
                  </div>
                  <br>
                  <div>On 05/01/2015 02:29 PM, Igor Russo wrote:<br>
                  </div>
                  <blockquote type="cite">
                    <div dir="ltr">
                      <div style="font-size:12.8000001907349px">Hi Yadu,<br>
                      </div>
                      <div style="font-size:12.8000001907349px"><br>
                      </div>
                      <div style="font-size:12.8000001907349px">Thank
                        you very much!</div>
                      <div style="font-size:12.8000001907349px"><br>
                      </div>
                      <div style="font-size:12.8000001907349px">I
                        changed the config file with the data from my
                        cluster.</div>
                      <div style="font-size:12.8000001907349px"><br>
                      </div>
                      <div style="font-size:12.8000001907349px">When
                        executing the 4th part of Swift-tutorial, i'm
                        getting the following error:</div>
                      <div style="font-size:12.8000001907349px">"Failed
                        to download bootstrap jar from ..."</div>
                      <div style="font-size:12.8000001907349px"><br>
                      </div>
                      <div style="font-size:12.8000001907349px"><br>
                      </div>
                      <div style="font-size:12.8000001907349px">--------------------------------------------------------------------------------</div>
                      <div style="font-size:12.8000001907349px"><br>
                      </div>
                      <div style="font-size:12.8000001907349px">RunID:
                        run031<br>
                      </div>
                      <div style="font-size:12.8000001907349px">
                        <div>Progress: Sex, 01 Mai 2015 15:40:42-0300</div>
                        <div>Progress: Sex, 01 Mai 2015 15:40:43-0300
                           Submitting:1</div>
                        <div><br>
                        </div>
                        <div>Execution failed:</div>
                        <div>Exception in sort:</div>
                        <div>    Arguments: [-n, unsorted.txt]</div>
                        <div>    Host: mmc</div>
                        <div>    Directory:
                          p4-run031/jobs/s/sort-go28d68m</div>
                        <div><span style="white-space:pre-wrap"> </span>exception
                          @ swift-int-staging.k, line: 165</div>
                        <div>Caused by: </div>
                        <div><span style="white-space:pre-wrap"> </span>exception
                          @ swift-int-staging.k, line: 160</div>
                        <div>Caused by: null</div>
                        <div>Caused by:
                          org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
                          Could not submit job</div>
                        <div>Caused by:
                          org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
                          Could not start coaster service</div>
                        <div>Caused by:
                          org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
                          Task ended before registration was received. </div>
                        <div>Failed to download bootstrap jar from <a href="http://igor-ubuntu:51251/" target="_blank">http://igor-ubuntu:51251</a></div>
                        <div><br>
                        </div>
                        <div><span style="white-space:pre-wrap"> </span>k:assign
                          @ swift.k, line: 174</div>
                        <div>Caused by: Exception in sort:</div>
                        <div>    Arguments: [-n, unsorted.txt]</div>
                        <div>    Host: mmc</div>
                        <div>    Directory:
                          p4-run031/jobs/s/sort-go28d68m</div>
                        <div><span style="white-space:pre-wrap"> </span>exception
                          @ swift-int-staging.k, line: 165</div>
                        <div>Caused by: </div>
                        <div><span style="white-space:pre-wrap"> </span>exception
                          @ swift-int-staging.k, line: 160</div>
                        <div>Caused by: null</div>
                        <div>Caused by:
                          org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
                          Could not submit job</div>
                        <div>Caused by:
                          org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
                          Could not start coaster service</div>
                        <div>Caused by:
                          org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
                          Task ended before registration was received. </div>
                        <div>Failed to download bootstrap jar from <a href="http://igor-ubuntu:51251/" target="_blank">http://igor-ubuntu:51251</a></div>
                      </div>
                      <div style="font-size:12.8000001907349px"><br>
                      </div>
                      <div style="font-size:12.8000001907349px">--------------------------------------------------------------------------------<br>
                      </div>
                      <div style="font-size:12.8000001907349px"><br>
                      </div>
                      <div style="font-size:12.8000001907349px">Thanks,</div>
                      <div style="font-size:12.8000001907349px">Igor</div>
                    </div>
                    <div class="gmail_extra"><br>
                      <div class="gmail_quote">2015-05-01 13:47
                        GMT-03:00 Yadu Nand Babuji <span dir="ltr"><<a href="mailto:yadunand@uchicago.edu" target="_blank">yadunand@uchicago.edu</a>></span>:<br>
                        <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                          <div bgcolor="#FFFFFF" text="#000000"> Hi
                            Igor,<br>
                            <br>
                            Swift does support SGE clusters, and you can
                            refer to the swift-tutorial<br>
                            for sample code and configurations from this
                            link:<br>
                            <a href="https://github.com/swift-lang/swift-tutorial" target="_blank">https://github.com/swift-lang/swift-tutorial</a><br>
                            <br>
                            Here's a sample config from our test-suite
                            for Godzilla, an SGE cluster at UChicago:<br>
                            <a href="https://github.com/swift-lang/swift-k/blob/master/tests/sites/godzilla/swift.conf" target="_blank">https://github.com/swift-lang/swift-k/blob/master/tests/sites/godzilla/swift.conf</a><br>
                            You could modify and add this config to the
                            swift.conf file in the swift-tutorial to run
                            <br>
                            Swift on any machine and execute on a remote
                            SGE cluster.<br>
                            <br>
                            SGE is a widely used resource manager and
                            most sites have differences in<br>
                            their setups that make each site unique. If
                            you run into issues with the default<br>
                            swift package, and could provide help in
                            figuring out specifics of your cluster, we<br>
                            will help you adapt the Swift SGE provider
                            to support your cluster.<br>
                            <br>
                            Thanks,<br>
                            Yadu
                            <div>
                              <div><br>
                                <br>
                                <br>
                                <div>On 04/28/2015 05:09 PM, Igor Russo
                                  wrote:<br>
                                </div>
                              </div>
                            </div>
                            <blockquote type="cite">
                              <div>
                                <div>
                                  <div dir="ltr">Hi All,
                                    <div><br>
                                    </div>
                                    <div>It is possible to use Swift
                                      with a remote SGE/OGE cluster?</div>
                                    <div><br>
                                    </div>
                                    <div>Regards,</div>
                                    <div>Igor</div>
                                  </div>
                                  <br>
                                  <fieldset></fieldset>
                                  <br>
                                </div>
                              </div>
                              <pre>_______________________________________________
Swift-user mailing list
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
                            </blockquote>
                            <br>
                          </div>
                          <br>
_______________________________________________<br>
                          Swift-user mailing list<br>
                          <a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a><br>
                          <a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br>
                        </blockquote>
                      </div>
                      <br>
                    </div>
                    <br>
                    <fieldset></fieldset>
                    <br>
                    <pre>_______________________________________________
Swift-user mailing list
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
                  </blockquote>
                  <br>
                </div>
              </div>
            </div>
            <br>
            _______________________________________________<br>
            Swift-user mailing list<br>
            <a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a><br>
            <a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br>
          </blockquote>
        </div>
        <br>
      </div>
      <br>
      <fieldset></fieldset>
      <br>
      <pre>_______________________________________________
Swift-user mailing list
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
    </blockquote>
    <br>
  </div></div></div>

<br>_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br></blockquote></div><br></div>