[Swift-user] debug log not being produced
Ioan Raicu
iraicu at cs.uchicago.edu
Sat Mar 29 18:30:45 CDT 2008
Hi,
There is nothing Java 1.5 specific in Falkon, and have run it many times
with 1.4. If Java 1.4 runs OK on the BG/P for Swift, Falkon should also
be OK.
Ioan
Michael Wilde wrote:
> Rebuilt with the native Java 1.4, the BGP produces the Swift log just
> fine.
>
> Ioan, where did the Java 1.5 in /home/falkon come from, and it it
> needed to make Falkon run correctly?
>
> - Mike
>
>
> On 3/29/08 9:25 AM, Michael Wilde wrote:
>> I rebuild a clean swift from r1773 from scratch, without deef, on
>> both terminable and the bgp, then tested with a simple "swift
>> first.swift" in examples/vdsk.
>>
>> On terminable I get the log file fine, on the bgp I dont.
>>
>>
>>
>> On 3/29/08 8:27 AM, Mihael Hategan wrote:
>>> log4j.properties looks fine.
>>>
>>> What's in amps2-20080328-1720-6jit1g59.d and what does swift.out say?
>>
>> The *.d dir was empty. That swift.out said:
>>
>> Swift script amps2.swift starting at Fri Mar 28 17:20:12 CDT 2008
>> running on sites: bgps
>>
>> Swift svn swift-r1771 cog-r1953
>>
>> RunID: 20080328-1720-6jit1g59
>> Progress:
>> runam6 started
>> error: Notification(int timeout): socket = new
>> ServerSocket(recvPort); Address already in use
>> error: Notification(int timeout): socket = new
>> ServerSocket(recvPort); Address already in use
>> 2008-03-28 17:20:27,788 WARN submitQueue.NonBlockingSubmit
>> [pool-1-thread-1,notifyPreviousQueue:71] Warning: Task handler throws
>> exception and also sets status
>> runam6 failed
>> Final status: Failed:1
>> The following errors have occurred:
>> 1. Application "runam6" failed (Task failed)
>> Arguments: "000000, 0.200000, 0.000391, 0.204419, 0.200000,
>> 0.000391, 0.204419, 10"
>> Host: bgps
>> Directory: amps2-20080328-1720-6jit1g59/jobs/a/runam6-a9750gqi
>> STDERR:
>> STDOUT:
>>
>> Swift Script amps2.swift ended at Fri Mar 28 17:20:28 CDT 2008 with
>> exit code 0
>>
>> --
>> it was that error that I was going after, and couldn't get the log file.
>>
>> --
>> For the test I did on a fresh clean build of 1773 on the bgp, swift
>> stdout/err gave:
>>
>> bg$ $s/bin/swift first.swift
>> Swift svn swift-r1771 cog-r1953
>>
>> RunID: 20080329-0913-xdviok1a
>> Progress:
>> echo started
>> echo completed
>> Final status: Finished successfully:1
>> bg$ ls
>> anonymous.swift default.dtm first.xml
>> helloworld_named.dtm regexp.swift
>> array_index.dtm diamond.dtm fixedarray.swift
>> manyparam.swift tutorial
>> array_iteration.dtm file_counter.dtm foreach.swift
>> parameter.swift types.swift
>> array_wildcard.dtm first.kml hello.txt q16.txt
>> arraymapper.dtm first.swift helloworld.dtm range.dtm
>> bg$ pwd
>> /home/wilde/swift/rev/1773c/examples/vdsk
>> bg$
>>
>> --
>>
>> Im using this java:
>>
>> bg$ echo $JAVA_HOME
>> /home/falkon/java
>> bg$ which java
>> /home/falkon/java/bin/java
>> bg$ java -version
>> java version "1.5.0"
>> Java(TM) 2 Runtime Environment, Standard Edition (build
>> pxp64dev-20070511(SR5))
>> IBM J9 VM (build 2.3, J2RE 1.5.0 IBM J9 2.3 Linux ppc64-64
>> j9vmxp6423-20070426 (JIT enabled)
>> J9VM - 20070420_12448_BHdSMr
>> JIT - 20070419_1806_r8
>> GC - 200704_19)
>> JCL - 20070511
>> bg$
>>
>> bg$ ls -l $JAVA_HOME
>> lrwxrwxrwx 1 wilde falkon 32 Mar 26 15:18 /home/falkon/java ->
>> /home/falkon/ibm-java2-ppc64-50/
>>
>> --
>>
>> - Mike
>>
>>
>>
>>>
>>> Mihael
>>>
>>> On Sat, 2008-03-29 at 07:22 -0500, Michael Wilde wrote:
>>>> Im not getting a swift <runid>.log file on the BGP after rebuilding
>>>> swift to 1771 with provider-deef.
>>>>
>>>> Im backtracking and debugging now, but does anyone know of recent
>>>> changes in this area, or of what I might have done wrong?
>>>>
>>>> (I lost access to many files when my sicortex NFS client host
>>>> crashed and then went into limited access mode, so I may have
>>>> mis-configured things)
>>>>
>>>> Does anyone see a cause?
>>>>
>>>> Thanks,
>>>>
>>>> Mike
>>>>
>>>> -- Im running swift with this script:
>>>>
>>>> WORKFLOW=$1
>>>> shift
>>>>
>>>> site $* >sites.xml
>>>>
>>>> ( echo Swift script $WORKFLOW.swift starting at `date`
>>>> echo running on sites: $*
>>>> echo
>>>> swift \
>>>> -sites.file ./sites.xml \
>>>> -tc.file ./tc.data \
>>>> $WORKFLOW.swift
>>>> echo
>>>> echo Swift Script $WORKFLOW.swift ended at `date` with exit code $?
>>>> ) >swift.out 2>&1
>>>>
>>>> -- etc/log4j.properties
>>>>
>>>> bg$ cat log4j.properties
>>>> # Set root category priority to WARN and its appenders to CONSOLE
>>>> and FILE.
>>>> log4j.rootCategory=INFO, CONSOLE, FILE
>>>>
>>>> log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender
>>>> log4j.appender.CONSOLE.layout=org.apache.log4j.PatternLayout
>>>> log4j.appender.CONSOLE.Threshold=INFO
>>>> log4j.appender.CONSOLE.layout.ConversionPattern=%m%n
>>>>
>>>> log4j.appender.FILE=org.apache.log4j.FileAppender
>>>> log4j.appender.FILE.File=swift.log
>>>> log4j.appender.FILE.layout=org.apache.log4j.PatternLayout
>>>> log4j.appender.FILE.layout.ConversionPattern=%d{yyyy-MM-dd
>>>> HH:mm:ss,SSSZZZZZ} %-5p %c{1} %m%n
>>>>
>>>> log4j.logger.swift=DEBUG
>>>>
>>>> log4j.logger.org.globus.swift.trace=INFO
>>>>
>>>> log4j.logger.org.griphyn.vdl.karajan.Loader=DEBUG
>>>> log4j.logger.org.globus.cog.karajan.workflow.events.WorkerSweeper=WARN
>>>> log4j.logger.org.globus.cog.karajan.workflow.nodes.FlowNode=WARN
>>>> log4j.logger.org.globus.cog.karajan.scheduler.WeightedHostScoreScheduler=DEBUG
>>>>
>>>> log4j.logger.org.griphyn.vdl.toolkit.VDLt2VDLx=DEBUG
>>>> log4j.logger.org.griphyn.vdl.karajan.VDL2ExecutionContext=DEBUG
>>>> log4j.logger.org.globus.cog.abstraction.impl.common.task.TaskImpl=DEBUG
>>>>
>>>> log4j.logger.org.griphyn.vdl.karajan.lib.GetFieldValue=DEBUG
>>>> log4j.logger.org.griphyn.vdl.engine.Karajan=INFO
>>>>
>>>> -- ~/.swift/swift.properties
>>>>
>>>> sitedir.keep=true
>>>> wrapperlog.always.transfer=true
>>>> lazy.errors=true
>>>> execution.retries=0
>>>>
>>>> #kickstart.always.transfer=true
>>>>
>>>> throttle.submit=off
>>>> throttle.host.submit=off
>>>> throttle.transfers=20
>>>> throttle.file.operations=20
>>>> throttle.score.job.factor=1000000
>>>>
>>>> -- run dir after a swift run - no .log file!
>>>>
>>>> bg$ cd ~/mars/run01
>>>> bg$ ls -lt
>>>> total 1280
>>>> -rw-r--r-- 1 wilde users 908 Mar 28 17:20 swift.out
>>>> -rw-r--r-- 1 wilde users 48 Mar 28 17:20
>>>> amps2-20080328-1720-6jit1g59.0.rlog
>>>> drwxr-xr-x 2 wilde users 131072 Mar 28 17:20
>>>> amps2-20080328-1720-6jit1g59.d
>>>> -rw-r--r-- 1 wilde users 7859 Mar 28 17:20 amps2.kml
>>>> -rw-r--r-- 1 wilde users 4397 Mar 28 17:20 amps2.xml
>>>> -rw-r--r-- 1 wilde users 422 Mar 28 17:20 sites.xml
>>>> -rw-r--r-- 1 wilde users 103 Mar 28 16:02 paramlist
>>>> -rw-r--r-- 1 wilde users 1432 Mar 28 14:48 tc.data
>>>> -rw-r--r-- 1 wilde users 654 Mar 28 14:36 amps2.swift
>>>> bg$
>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Swift-user mailing list
>>>> Swift-user at ci.uchicago.edu
>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>>>
>>>
>>>
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>
>>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>
--
===================================================
Ioan Raicu
Ph.D. Candidate
===================================================
Distributed Systems Laboratory
Computer Science Department
University of Chicago
1100 E. 58th Street, Ryerson Hall
Chicago, IL 60637
===================================================
Email: iraicu at cs.uchicago.edu
Web: http://www.cs.uchicago.edu/~iraicu
http://dev.globus.org/wiki/Incubator/Falkon
http://dsl-wiki.cs.uchicago.edu/index.php/Main_Page
===================================================
===================================================
More information about the Swift-user
mailing list