[Swift-devel] Re: catsn on beagle
Ketan Maheshwari
ketancmaheshwari at gmail.com
Sat Jun 4 12:51:53 CDT 2011
Alright, so this is the issue. GLOBUS_HOSTNAME is picked up from HOSTNAME
and I do not know where does this none comes in your case.
In my case I get hostname: login2.beagle.ci.uchicago.edu
see if you can manually change this env variable and try to run again.
On Sat, Jun 4, 2011 at 12:49 PM, Jonathan S Monette <jonmon at utexas.edu>wrote:
> login2.beagle.ci.uchicago.edu.(none)
>
> when you ran your test was in on login1 or login2?
>
>
> On Sat, Jun 4, 2011 at 12:47 PM, Ketan Maheshwari <
> ketancmaheshwari at gmail.com> wrote:
>
>> What does
>>
>> echo $HOSTNAME give?
>>
>>
>> On Sat, Jun 4, 2011 at 12:44 PM, Jonathan S Monette <jonmon at utexas.edu>wrote:
>>
>>> I am not sure why that (none) appears. Is this a variable that the
>>> system sets or do I need to set it?
>>>
>>>
>>> On Sat, Jun 4, 2011 at 12:39 PM, Ketan Maheshwari <
>>> ketancmaheshwari at gmail.com> wrote:
>>>
>>>> This suprises me because, I do not see that (none) in my commandline.
>>>>
>>>>
>>>> On Sat, Jun 4, 2011 at 12:38 PM, Jonathan S Monette <jonmon at utexas.edu>wrote:
>>>>
>>>>> I added
>>>>> echo ${OPTIONS}
>>>>> echo ${COG_OPTS}
>>>>> echo ${LOCALCLASSPATH}
>>>>> echo ${EXEC}
>>>>> echo ${CMDLINE}
>>>>>
>>>>> to the script. It seems in the $OPTIONS variable this appears.
>>>>>
>>>>> -Xmx8192M
>>>>> -Djava.endorsed.dirs=/home/jonmon/Library/Swift/swift-0.92/bin/../lib/endorsed
>>>>> -DUID=1881 -DGLOBUS_HOSTNAME=login2.beagle.ci.uchicago.edu.(none)
>>>>> -DCOG_INSTALL_PATH=/home/jonmon/Library/Swift/swift-0.92/bin/..
>>>>> -Dswift.home=/home/jonmon/Library/Swift/swift-0.92/bin/..
>>>>> -Djava.security.egd=file:///dev/urandom
>>>>>
>>>>> There is the line DGLOBUS_HOSTNAME=login2.beagle.ci.uchicago.edu.(none)
>>>>> I believe that is the parenthesis that is causing this to fail. Now How do
>>>>> I fix it.
>>>>>
>>>>> On Sat, Jun 4, 2011 at 12:36 PM, Jonathan S Monette <jonmon at utexas.edu
>>>>> > wrote:
>>>>>
>>>>>> I may have found the error. I download 0.92 binaries and changed the
>>>>>> swift command script. I added
>>>>>>
>>>>>>
>>>>>> On Sat, Jun 4, 2011 at 12:26 PM, Jonathan S Monette <
>>>>>> jonmon at utexas.edu> wrote:
>>>>>>
>>>>>>> Same result. Same error
>>>>>>>
>>>>>>>
>>>>>>> On Sat, Jun 4, 2011 at 12:24 PM, ketan <ketancmaheshwari at gmail.com>wrote:
>>>>>>>
>>>>>>>> can you try running the commandline by copying from run.sh and
>>>>>>>> pasting it at the prompt.
>>>>>>>>
>>>>>>>>
>>>>>>>> On 6/4/11 12:18 PM, Jonathan S Monette wrote:
>>>>>>>>
>>>>>>>> I do have that project. I did projects --avail and got back
>>>>>>>>
>>>>>>>> Project PI Title
>>>>>>>>
>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>> CI-CCR000013 Michael Wilde The Swift Parallel Scripting
>>>>>>>> System
>>>>>>>>
>>>>>>>> Here is my run.sh file. I execute with ./run.sh after I did chmod
>>>>>>>> +x run.sh
>>>>>>>>
>>>>>>>> #!/bin/bash
>>>>>>>> swift -config cf -tc.file tc -sites.file beagle-coaster.xml
>>>>>>>> catsn.swift -n=1
>>>>>>>>
>>>>>>>> I do have sh and cat in my path. I can execute them. Here is
>>>>>>>> what which sh and which cat produced.
>>>>>>>>
>>>>>>>> sh is /usr/bin/sh
>>>>>>>> cat is /bin/cat
>>>>>>>>
>>>>>>>> On Sat, Jun 4, 2011 at 12:10 PM, ketan <ketancmaheshwari at gmail.com>wrote:
>>>>>>>>
>>>>>>>>> Can you try "projects --avail" command on beagle to see if you are
>>>>>>>>> member of a project.
>>>>>>>>>
>>>>>>>>> Else you will need to request membership. You can do this from this
>>>>>>>>> page:
>>>>>>>>>
>>>>>>>>> http://pads.ci.uchicago.edu/access/
>>>>>>>>>
>>>>>>>>> In any case, your error does not seem to be because of the above.
>>>>>>>>> Looks like '(' has sneaked in because of some unexpected typo in commandline
>>>>>>>>> .. can you doublecheck it.
>>>>>>>>>
>>>>>>>>> Also can you make sure that you have all the files: tc,
>>>>>>>>> beagle-coasters.xml cf in PATH, ie. are you able to access them w/o ./
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 6/4/11 12:03 PM, Jonathan S Monette wrote:
>>>>>>>>>
>>>>>>>>> I did change the work directory. I however did not change the
>>>>>>>>> project name. I do not know my project name so I kept the same project that
>>>>>>>>> was in there. Here is my modified beagle-coasters.xml
>>>>>>>>>
>>>>>>>>> <config>
>>>>>>>>> <pool handle="pbs">
>>>>>>>>> <execution provider="coaster" jobmanager="local:pbs"/>
>>>>>>>>> <profile namespace="globus"
>>>>>>>>> key="project">CI-CCR000013</profile>
>>>>>>>>>
>>>>>>>>> <profile namespace="globus" key="ppn">24:cray:pack</profile>
>>>>>>>>>
>>>>>>>>> <profile namespace="globus" key="workersPerNode">24</profile>
>>>>>>>>> <profile namespace="globus" key="maxTime">1000</profile>
>>>>>>>>> <profile namespace="globus" key="slots">1</profile>
>>>>>>>>> <profile namespace="globus" key="nodeGranularity">1</profile>
>>>>>>>>> <profile namespace="globus" key="maxNodes">1</profile>
>>>>>>>>>
>>>>>>>>> <profile namespace="karajan" key="jobThrottle">.63</profile>
>>>>>>>>> <profile namespace="karajan" key="initialScore">10000</profile>
>>>>>>>>>
>>>>>>>>> <filesystem provider="local"/>
>>>>>>>>> <workdirectory
>>>>>>>>> >/lustre/beagle/jonmon/Swift/work</workdirectory>
>>>>>>>>> </pool>
>>>>>>>>> </config>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Sat, Jun 4, 2011 at 12:00 PM, Ketan Maheshwari <
>>>>>>>>> ketancmaheshwari at gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Jon,
>>>>>>>>>>
>>>>>>>>>> Thanks for trying out catsn on Beagle.
>>>>>>>>>>
>>>>>>>>>> I just tried it myself but could not reproduce the error you are
>>>>>>>>>> getting. Have you made the changes that are mentioned in the README:
>>>>>>>>>> ==
>>>>>>>>>> Change workdir location in beagle-coaster.xml
>>>>>>>>>> Change the project entry in the beagle-coaster.xml to your project
>>>>>>>>>> name
>>>>>>>>>> ==
>>>>>>>>>>
>>>>>>>>>> Ketan
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Sat, Jun 4, 2011 at 11:50 AM, Jonathan S Monette <
>>>>>>>>>> jonmon at utexas.edu> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hello,
>>>>>>>>>>> I am trying to run the catsn test on beagle using the files in
>>>>>>>>>>> ~ketan/catsn. I have copied over this directory over to my home directory
>>>>>>>>>>> and I believe I set it up correctly. I did module load swift and the ran
>>>>>>>>>>> run.sh that was in this directory. I get this error.
>>>>>>>>>>>
>>>>>>>>>>> /soft/swift/0.92/bin/swift: eval: line 152: syntax error near
>>>>>>>>>>> unexpected token `('
>>>>>>>>>>> /soft/swift/0.92/bin/swift: eval: line 152: `java -Xmx8192M
>>>>>>>>>>> -Djava.endorsed.dirs=/soft/swift/0.92/bin/../lib/endorsed -DUID=1881
>>>>>>>>>>> -DGLOBUS_HOSTNAME=login2.beagle.ci.uchicago.edu.(none)
>>>>>>>>>>> -DCOG_INSTALL_PATH=/soft/swift/0.92/bin/..
>>>>>>>>>>> -Dswift.home=/soft/swift/0.92/bin/.. -Djava.security.egd=
>>>>>>>>>>> file:///dev/urandom -classpath
>>>>>>>>>>> /soft/swift/0.92/bin/../etc:/soft/swift/0.92/bin/../libexec:/soft/swift/0.92/bin/../lib/addressing-1.0.jar:/soft/swift/0.92/bin/../lib/ant.jar:/soft/swift/0.92/bin/../lib/antlr-2.7.5.jar:/soft/swift/0.92/bin/../lib/axis.jar:/soft/swift/0.92/bin/../lib/axis-url.jar:/soft/swift/0.92/bin/../lib/backport-util-concurrent.jar:/soft/swift/0.92/bin/../lib/castor-0.9.6.jar:/soft/swift/0.92/bin/../lib/coaster-bootstrap.jar:/soft/swift/0.92/bin/../lib/cog-abstraction-common-2.4.jar:/soft/swift/0.92/bin/../lib/cog-axis.jar:/soft/swift/0.92/bin/../lib/cog-grapheditor-0.47.jar:/soft/swift/0.92/bin/../lib/cog-jglobus-1.7.0.jar:/soft/swift/0.92/bin/../lib/cog-karajan-0.36-dev.jar:/soft/swift/0.92/bin/../lib/cog-provider-clref-gt4_0_0.jar:/soft/swift/0.92/bin/../lib/cog-provider-coaster-0.3.jar:/soft/swift/0.92/bin/../lib/cog-provider-dcache-0.1.jar:/soft/swift/0.92/bin/../lib/cog-provider-gt2-2.4.jar:/soft/swift/0.92/bin/../lib/cog-provider-gt4_0_0-2.5.jar:/soft/swift/0.92/bin/../lib/cog-pro
>>>>>>>>>>> vider-local-2.2.jar:/soft/swift/0.92/bin/../lib/cog-provider-localscheduler-0.4.jar:/soft/swift/0.92/bin/../lib/cog-provider-ssh-2.4.jar:/soft/swift/0.92/bin/../lib/cog-provider-webdav-2.1.jar:/soft/swift/0.92/bin/../lib/cog-resources-1.0.jar:/soft/swift/0.92/bin/../lib/cog-swift-svn.jar:/soft/swift/0.92/bin/../lib/cog-trap-1.0.jar:/soft/swift/0.92/bin/../lib/cog-url.jar:/soft/swift/0.92/bin/../lib/cog-util-0.92.jar:/soft/swift/0.92/bin/../lib/commonj.jar:/soft/swift/0.92/bin/../lib/commons-beanutils.jar:/soft/swift/0.92/bin/../lib/commons-collections-3.0.jar:/soft/swift/0.92/bin/../lib/commons-digester.jar:/soft/swift/0.92/bin/../lib/commons-discovery.jar:/soft/swift/0.92/bin/../lib/commons-httpclient.jar:/soft/swift/0.92/bin/../lib/commons-logging-1.1.jar:/soft/swift/0.92/bin/../lib/concurrent.jar:/soft/swift/0.92/bin/../lib/cryptix32.jar:/soft/swift/0.92/bin/../lib/cryptix-asn1.jar:/soft/swift/0.92/bin/../lib/cryptix.jar:/soft/swift/0.92/bin/../lib/globus_delegation_servic
>>>>>>>>>>> e.jar:/soft/swift/0.92/bin/../lib/globus_delegation_stubs.jar:/soft/swift/0.92/bin/../lib/globus_wsrf_mds_aggregator_stubs.jar:/soft/swift/0.92/bin/../lib/globus_wsrf_rendezvous_service.jar:/soft/swift/0.92/bin/../lib/globus_wsrf_rendezvous_stubs.jar:/soft/swift/0.92/bin/../lib/globus_wsrf_rft_stubs.jar:/soft/swift/0.92/bin/../lib/gram-client.jar:/soft/swift/0.92/bin/../lib/gram-stubs.jar:/soft/swift/0.92/bin/../lib/gram-utils.jar:/soft/swift/0.92/bin/../lib/j2ssh-common-0.2.2.jar:/soft/swift/0.92/bin/../lib/j2ssh-core-0.2.2-patch-b.jar:/soft/swift/0.92/bin/../lib/jakarta-regexp-1.2.jar:/soft/swift/0.92/bin/../lib/jakarta-slide-webdavlib-2.0.jar:/soft/swift/0.92/bin/../lib/jaxrpc.jar:/soft/swift/0.92/bin/../lib/jce-jdk13-131.jar:/soft/swift/0.92/bin/../lib/jgss.jar:/soft/swift/0.92/bin/../lib/jline-0.9.94.jar:/soft/swift/0.92/bin/../lib/jsr173_1.0_api.jar:/soft/swift/0.92/bin/../lib/jug-lgpl-2.0.0.jar:/soft/swift/0.92/bin/../lib/junit.jar:/soft/swift/0.92/bin/../lib/log4j-1.2
>>>>>>>>>>> .8.jar:/soft/swift/0.92/bin/../lib/naming-common.jar:/soft/swift/0.92/bin/../lib/naming-factory.jar:/soft/swift/0.92/bin/../lib/naming-java.jar:/soft/swift/0.92/bin/../lib/naming-resources.jar:/soft/swift/0.92/bin/../lib/opensaml.jar:/soft/swift/0.92/bin/../lib/puretls.jar:/soft/swift/0.92/bin/../lib/resolver.jar:/soft/swift/0.92/bin/../lib/saaj.jar:/soft/swift/0.92/bin/../lib/stringtemplate.jar:/soft/swift/0.92/bin/../lib/vdldefinitions.jar:/soft/swift/0.92/bin/../lib/wsdl4j.jar:/soft/swift/0.92/bin/../lib/wsrf_core.jar:/soft/swift/0.92/bin/../lib/wsrf_core_stubs.jar:/soft/swift/0.92/bin/../lib/wsrf_mds_index_stubs.jar:/soft/swift/0.92/bin/../lib/wsrf_mds_usefulrp_schema_stubs.jar:/soft/swift/0.92/bin/../lib/wsrf_provider_jce.jar:/soft/swift/0.92/bin/../lib/wsrf_tools.jar:/soft/swift/0.92/bin/../lib/wss4j.jar:/soft/swift/0.92/bin/../lib/xalan.jar:/soft/swift/0.92/bin/../lib/xbean.jar:/soft/swift/0.92/bin/../lib/xbean_xpath.jar:/soft/swift/0.92/bin/../lib/xercesImpl.jar:/soft
>>>>>>>>>>> /swift/0.92/bin/../lib/xml-apis.jar:/soft/swift/0.92/bin/../lib/xmlsec.jar:/soft/swift/0.92/bin/../lib/xpp3-1.1.3.4d_b4_min.jar:/soft/swift/0.92/bin/../lib/xstream-1.1.1-patched.jar:
>>>>>>>>>>> org.griphyn.vdl.karajan.Loader '-config' 'cf' '-tc.file' 'tc' '-sites.file'
>>>>>>>>>>> 'beagle-coaster.xml' 'catsn.swift' '-n=1''
>>>>>>>>>>>
>>>>>>>>>>> I there something else I need to load on beagle to make swift
>>>>>>>>>>> run accordingly?
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>>
>>>>>>>>>>> Any intelligent fool can make things bigger and more complex...
>>>>>>>>>>> It takes a touch of genius - and a lot of courage to move in the opposite
>>>>>>>>>>> direction.
>>>>>>>>>>>
>>>>>>>>>>> - Albert Einstein
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>> Any intelligent fool can make things bigger and more complex... It
>>>>>>>>> takes a touch of genius - and a lot of courage to move in the opposite
>>>>>>>>> direction.
>>>>>>>>>
>>>>>>>>> - Albert Einstein
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> Any intelligent fool can make things bigger and more complex... It
>>>>>>>> takes a touch of genius - and a lot of courage to move in the opposite
>>>>>>>> direction.
>>>>>>>>
>>>>>>>> - Albert Einstein
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>> Any intelligent fool can make things bigger and more complex... It
>>>>>>> takes a touch of genius - and a lot of courage to move in the opposite
>>>>>>> direction.
>>>>>>>
>>>>>>> - Albert Einstein
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Any intelligent fool can make things bigger and more complex... It
>>>>>> takes a touch of genius - and a lot of courage to move in the opposite
>>>>>> direction.
>>>>>>
>>>>>> - Albert Einstein
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Any intelligent fool can make things bigger and more complex... It
>>>>> takes a touch of genius - and a lot of courage to move in the opposite
>>>>> direction.
>>>>>
>>>>> - Albert Einstein
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>>
>>> Any intelligent fool can make things bigger and more complex... It takes
>>> a touch of genius - and a lot of courage to move in the opposite direction.
>>>
>>> - Albert Einstein
>>>
>>>
>>
>
>
> --
>
> Any intelligent fool can make things bigger and more complex... It takes a
> touch of genius - and a lot of courage to move in the opposite direction.
>
> - Albert Einstein
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110604/bca5eb07/attachment.html>
More information about the Swift-devel
mailing list