[Swift-devel] Error in Coaster test on Clemson-IT site

Zhao Zhang zhaozhang at uchicago.edu
Wed May 13 13:09:26 CDT 2009


Hi, Ben

I rerun it with the following sites.xml, it still failed
                                  
<config>
  <!-- CLEMSON-IT -->
  <pool handle="CLEMSON-IT" >
    <gridftp url="gsiftp://osggate.clemson.edu/" />
    <jobmanager universe="vanilla" 
url="osggate.clemson.edu/jobmanager-condor" \
major="2" minor="2" patch="4" />
    <workdirectory >/scratch/data/osg/tmp/CLEMSON-IT</workdirectory>
  </pool>h
</config>

[zzhang at tp-grid1 sites]$ ./run-site regular/CLEMSON-IT.xml
testing site configuration: regular/CLEMSON-IT.xml
Removing files from previous runs
Running test 061-cattwo at Wed May 13 13:06:51 CDT 2009
Swift svn swift-r2896 cog-r2392

RunID: 20090513-1306-yiec15sd
Progress:
Progress:  Stage in:1
Progress:  Submitting:1
Progress:  Submitted:1
Progress:  Submitted:1
Progress:  Active:1
Failed to transfer wrapper log from 
061-cattwo-20090513-1306-yiec15sd/info/g on CLEMSON-IT
Progress:  Submitted:1
Progress:  Submitted:1
Progress:  Active:1
Failed to transfer wrapper log from 
061-cattwo-20090513-1306-yiec15sd/info/i on CLEMSON-IT
Progress:  Stage in:1
Progress:  Active:1
Failed to transfer wrapper log from 
061-cattwo-20090513-1306-yiec15sd/info/k on CLEMSON-IT
Progress:  Failed:1
Execution failed:
        Exception in cat:
Arguments: [061-cattwo.1.in, 061-cattwo.2.in]
Host: CLEMSON-IT
Directory: 061-cattwo-20090513-1306-yiec15sd/jobs/k/cat-k8dqsqaj
stderr.txt:

stdout.txt:

----

Caused by:
        No status file was found. Check the shared filesystem on CLEMSON-IT
SWIFT RETURN CODE NON-ZERO - test 061-cattwo


Ben Clifford wrote:
> OK. But try with plain swift + gt2, using a <jobmanager> element in the 
> sites file. No condor-g, no coasters.
>
> On Wed, 13 May 2009, Zhao Zhang wrote:
>
>   
>> ok, I ran the same test case with condor-g, it failed.
>>
>> [zzhang at tp-grid1 sites]$ ./run-site condor-g_back/CLEMSON-IT.xml
>> testing site configuration: condor-g_back/CLEMSON-IT.xml
>> Removing files from previous runs
>> Running test 061-cattwo at Wed May 13 11:14:31 CDT 2009
>> Swift svn swift-r2896 cog-r2392
>>
>> RunID: 20090513-1114-0tvjyz67
>> Progress:  uninitialized:1
>> Progress:  Stage in:1
>> Progress:  Submitting:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Active:1
>> Progress:  Active:1
>> Progress:  Active:1
>> Progress: Failed but can retry:1
>> Failed to transfer wrapper log from 061-cattwo-20090513-1114-0tvjyz67/info/6
>> on CLEMSON-IT
>> Progress:  Stage in:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Active:1
>> Progress:  Active:1
>> Progress:  Checking status:1
>> Failed to transfer wrapper log from 061-cattwo-20090513-1114-0tvjyz67/info/8
>> on CLEMSON-IT
>> Progress:  Stage in:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Submitted:1
>> Progress:  Active:1
>> Progress:  Active:1
>> Progress:  Active:1
>> Progress:  Checking status:1
>> Failed to transfer wrapper log from 061-cattwo-20090513-1114-0tvjyz67/info/a
>> on CLEMSON-IT
>> Progress:  Failed:1
>> Execution failed:
>>        Exception in cat:
>> Arguments: [061-cattwo.1.in, 061-cattwo.2.in]
>> Host: CLEMSON-IT
>> Directory: 061-cattwo-20090513-1114-0tvjyz67/jobs/a/cat-as69oqaj
>> stderr.txt:
>>
>> stdout.txt:
>>
>> ----
>>
>> Caused by:
>>        No status file was found. Check the shared filesystem on CLEMSON-IT
>>
>>
>> Ben Clifford wrote:
>>     
>>> I meant to also make a sites file for Swift that does not use coasters. That
>>> will find some problems that I think the below tests will not find.
>>>
>>> On Wed, 13 May 2009, Zhao Zhang wrote:
>>>
>>>   
>>>       
>>>> Ah, yes, I ran them, here are the results.
>>>> [zzhang at tp-grid1 coaster_test]$ globus-job-run osggate.clemson.edu
>>>> /usr/bin/id
>>>> uid=145767(osg) gid=10000(cuuser) groups=10000(cuuser)
>>>> [zzhang at tp-grid1 coaster_test]$ globus-job-run
>>>> osggate.clemson.edu/jobmanager-condor /usr/bin/id
>>>> uid=145767(osg) gid=94175(osg) groups=94175(osg)
>>>>
>>>> [zzhang at tp-grid1 sites]$ globus-url-copy
>>>> gsiftp://osggate.clemson.edu/home/osg/logs_clemson.tar
>>>> file://`pwd`/logs_clemson.tar
>>>>
>>>> So both globus-job-run and globus-url-copy are working.
>>>>
>>>> zhao
>>>>
>>>> Ben Clifford wrote:
>>>>     
>>>>         
>>>>> When you tests these sites with coasters, and they fail, it would be
>>>>> useful
>>>>> perhaps to also test them without coasters and report if that works.
>>>>> This
>>>>> also gives more testing for the non-coaster case generally.
>>>>>
>>>>> On Wed, 13 May 2009, Zhao Zhang wrote:
>>>>>
>>>>>         
>>>>>           
>>>>>> Hi, Mihael
>>>>>>
>>>>>> I got a error returned for the language-behavior test on Clemson-IT
>>>>>> site
>>>>>> with
>>>>>> coaster.
>>>>>> All gram logs are at
>>>>>> /home/zzhang/swift_coaster/cog/modules/swift/tests/sites/logs_clemson.
>>>>>> Could you help on checking that error there is.
>>>>>>
>>>>>> sites.xml
>>>>>> [zzhang at tp-grid1 sites]$ cat coaster_test/CLEMSON-IT.xml
>>>>>> <config>
>>>>>>  <!-- CLEMSON-IT -->
>>>>>>  <pool handle="CLEMSON-IT" >
>>>>>>    <gridftp  url="gsiftp://osggate.clemson.edu/" />
>>>>>>    <execution  provider="coaster" url="osggate.clemson.edu"
>>>>>> jobManager="gt2:gt2:condor"/>
>>>>>>    <workdirectory >/scratch/data/osg/tmp/CLEMSON-IT</workdirectory>
>>>>>>  </pool>
>>>>>> </config>
>>>>>>
>>>>>>
>>>>>> Here is the stdout:
>>>>>>
>>>>>> testing site configuration: coaster_test/CLEMSON-IT.xml
>>>>>> Removing files from previous runs
>>>>>> Running test 061-cattwo at Wed May 13 10:27:04 CDT 2009
>>>>>> Swift svn swift-r2896 cog-r2392
>>>>>>
>>>>>> RunID: 20090513-1027-d406ke07
>>>>>> Progress:
>>>>>> Progress:  Stage in:1
>>>>>> Progress:  Submitting:1
>>>>>> Progress:  Submitting:1
>>>>>> Progress:  Submitted:1
>>>>>> Progress:  Active:1
>>>>>> Failed to transfer wrapper log from
>>>>>> 061-cattwo-20090513-1027-d406ke07/info/u
>>>>>> on CLEMSON-IT
>>>>>> Progress:  Submitted:1
>>>>>> Progress:  Active:1
>>>>>> Failed to transfer wrapper log from
>>>>>> 061-cattwo-20090513-1027-d406ke07/info/x
>>>>>> on CLEMSON-IT
>>>>>> Progress:  Stage in:1
>>>>>> Progress:  Submitted:1
>>>>>> Progress:  Active:1
>>>>>> Failed to transfer wrapper log from
>>>>>> 061-cattwo-20090513-1027-d406ke07/info/z
>>>>>> on CLEMSON-IT
>>>>>> Progress:  Failed:1
>>>>>> Execution failed:
>>>>>>        Exception in cat:
>>>>>> Arguments: [061-cattwo.1.in, 061-cattwo.2.in]
>>>>>> Host: CLEMSON-IT
>>>>>> Directory: 061-cattwo-20090513-1027-d406ke07/jobs/z/cat-zsqcmqaj
>>>>>> stderr.txt:
>>>>>>
>>>>>> stdout.txt:
>>>>>>
>>>>>> ----
>>>>>>
>>>>>> Caused by:
>>>>>>        Failed to start worker: Worker ended prematurely
>>>>>> Cleaning up...
>>>>>> Shutting down service at https://130.127.11.89:43784
>>>>>> Got channel MetaChannel: 1707082587 -> GSSSChannel-null(1)
>>>>>> - Done
>>>>>> SWIFT RETURN CODE NON-ZERO - test 061-cattwo
>>>>>>
>>>>>>
>>>>>> zhao
>>>>>> _______________________________________________
>>>>>> Swift-devel mailing list
>>>>>> Swift-devel at ci.uchicago.edu
>>>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>>>>>
>>>>>>
>>>>>>             
>>>>>>             
>>>>>         
>>>>>           
>>>>     
>>>>         
>>>   
>>>       
>>     
>
>   



More information about the Swift-devel mailing list