[Swift-user] Remote SGE cluster
Yadu Nand Babuji
yadunand at uchicago.edu
Fri May 1 15:47:58 CDT 2015
Hi Igor,
The remote connection system requires that the local machine you run the
swift client on has
a public ip address. It looks like swift was not able to guess it and
set it tohttp://igor-ubuntu:51251 <http://igor-ubuntu:51251/>
Could you retry running part04 after doing the next step, and please
make sure your environment has
these variables set whenever you run swift to remote systems :
export GLOBUS_HOSTNAME=<PUBLIC_IP_OF_YOUR_MACHINE>
export GLOBUS_TCP_PORT_RANGE=50000,51000
Thanks,
Yadu
On 05/01/2015 02:29 PM, Igor Russo wrote:
> Hi Yadu,
>
> Thank you very much!
>
> I changed the config file with the data from my cluster.
>
> When executing the 4th part of Swift-tutorial, i'm getting the
> following error:
> "Failed to download bootstrap jar from ..."
>
>
> --------------------------------------------------------------------------------
>
> RunID: run031
> Progress: Sex, 01 Mai 2015 15:40:42-0300
> Progress: Sex, 01 Mai 2015 15:40:43-0300 Submitting:1
>
> Execution failed:
> Exception in sort:
> Arguments: [-n, unsorted.txt]
> Host: mmc
> Directory: p4-run031/jobs/s/sort-go28d68m
> exception @ swift-int-staging.k, line: 165
> Caused by:
> exception @ swift-int-staging.k, line: 160
> Caused by: null
> Caused by:
> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
> Could not submit job
> Caused by:
> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
> Could not start coaster service
> Caused by:
> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
> Task ended before registration was received.
> Failed to download bootstrap jar from http://igor-ubuntu:51251
> <http://igor-ubuntu:51251/>
>
> k:assign @ swift.k, line: 174
> Caused by: Exception in sort:
> Arguments: [-n, unsorted.txt]
> Host: mmc
> Directory: p4-run031/jobs/s/sort-go28d68m
> exception @ swift-int-staging.k, line: 165
> Caused by:
> exception @ swift-int-staging.k, line: 160
> Caused by: null
> Caused by:
> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
> Could not submit job
> Caused by:
> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
> Could not start coaster service
> Caused by:
> org.globus.cog.abstraction.impl.common.task.TaskSubmissionException:
> Task ended before registration was received.
> Failed to download bootstrap jar from http://igor-ubuntu:51251
> <http://igor-ubuntu:51251/>
>
> --------------------------------------------------------------------------------
>
> Thanks,
> Igor
>
> 2015-05-01 13:47 GMT-03:00 Yadu Nand Babuji <yadunand at uchicago.edu
> <mailto:yadunand at uchicago.edu>>:
>
> Hi Igor,
>
> Swift does support SGE clusters, and you can refer to the
> swift-tutorial
> for sample code and configurations from this link:
> https://github.com/swift-lang/swift-tutorial
>
> Here's a sample config from our test-suite for Godzilla, an SGE
> cluster at UChicago:
> https://github.com/swift-lang/swift-k/blob/master/tests/sites/godzilla/swift.conf
> You could modify and add this config to the swift.conf file in the
> swift-tutorial to run
> Swift on any machine and execute on a remote SGE cluster.
>
> SGE is a widely used resource manager and most sites have
> differences in
> their setups that make each site unique. If you run into issues
> with the default
> swift package, and could provide help in figuring out specifics of
> your cluster, we
> will help you adapt the Swift SGE provider to support your cluster.
>
> Thanks,
> Yadu
>
>
>
> On 04/28/2015 05:09 PM, Igor Russo wrote:
>> Hi All,
>>
>> It is possible to use Swift with a remote SGE/OGE cluster?
>>
>> Regards,
>> Igor
>>
>>
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu <mailto:Swift-user at ci.uchicago.edu>
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu <mailto:Swift-user at ci.uchicago.edu>
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>
>
>
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20150501/ebab49ba/attachment.html>
More information about the Swift-user
mailing list