[Swift-user] debug log not being produced

Michael Wilde wilde at mcs.anl.gov
Sat Mar 29 11:15:40 CDT 2008 

Rebuilt with the native Java 1.4, the BGP produces the Swift log just fine.

Ioan, where did the Java 1.5 in /home/falkon come from, and it it needed 
  to make Falkon run correctly?

- Mike


On 3/29/08 9:25 AM, Michael Wilde wrote:
> I rebuild a clean swift from r1773 from scratch, without deef, on both 
> terminable and the bgp, then tested with a simple "swift first.swift" in 
> examples/vdsk.
> 
> On terminable I get the log file fine, on the bgp I dont.
> 
> 
> 
> On 3/29/08 8:27 AM, Mihael Hategan wrote:
>> log4j.properties looks fine.
>>
>> What's in amps2-20080328-1720-6jit1g59.d and what does swift.out say?
> 
> The *.d dir was empty.  That swift.out said:
> 
> Swift script amps2.swift starting at Fri Mar 28 17:20:12 CDT 2008
> running on sites: bgps
> 
> Swift svn swift-r1771 cog-r1953
> 
> RunID: 20080328-1720-6jit1g59
> Progress:
> runam6 started
> error: Notification(int timeout): socket = new ServerSocket(recvPort); 
> Address already in use
> error: Notification(int timeout): socket = new ServerSocket(recvPort); 
> Address already in use
> 2008-03-28 17:20:27,788 WARN  submitQueue.NonBlockingSubmit 
> [pool-1-thread-1,notifyPreviousQueue:71] Warning: Task handler throws 
> exception and also sets status
> runam6 failed
> Final status:  Failed:1
> The following errors have occurred:
> 1. Application "runam6" failed (Task failed)
>         Arguments: "000000, 0.200000, 0.000391, 0.204419, 0.200000, 
> 0.000391, 0.204419, 10"
>         Host: bgps
>         Directory: amps2-20080328-1720-6jit1g59/jobs/a/runam6-a9750gqi
>         STDERR:
>         STDOUT:
> 
> Swift Script amps2.swift ended at Fri Mar 28 17:20:28 CDT 2008 with exit 
> code 0
> 
> -- 
> it was that error that I was going after, and couldn't get the log file.
> 
> -- 
> For the test I did on a fresh clean build of 1773 on the bgp, swift 
> stdout/err gave:
> 
> bg$ $s/bin/swift first.swift
> Swift svn swift-r1771 cog-r1953
> 
> RunID: 20080329-0913-xdviok1a
> Progress:
> echo started
> echo completed
> Final status:  Finished successfully:1
> bg$ ls
> anonymous.swift      default.dtm       first.xml helloworld_named.dtm  
> regexp.swift
> array_index.dtm      diamond.dtm       fixedarray.swift  manyparam.swift 
>       tutorial
> array_iteration.dtm  file_counter.dtm  foreach.swift     parameter.swift 
>       types.swift
> array_wildcard.dtm   first.kml         hello.txt         q16.txt
> arraymapper.dtm      first.swift       helloworld.dtm    range.dtm
> bg$ pwd
> /home/wilde/swift/rev/1773c/examples/vdsk
> bg$
> 
> -- 
> 
> Im using this java:
> 
> bg$ echo $JAVA_HOME
> /home/falkon/java
> bg$ which java
> /home/falkon/java/bin/java
> bg$ java -version
> java version "1.5.0"
> Java(TM) 2 Runtime Environment, Standard Edition (build 
> pxp64dev-20070511(SR5))
> IBM J9 VM (build 2.3, J2RE 1.5.0 IBM J9 2.3 Linux ppc64-64 
> j9vmxp6423-20070426 (JIT enabled)
> J9VM - 20070420_12448_BHdSMr
> JIT  - 20070419_1806_r8
> GC   - 200704_19)
> JCL  - 20070511
> bg$
> 
> bg$ ls -l $JAVA_HOME
> lrwxrwxrwx 1 wilde falkon 32 Mar 26 15:18 /home/falkon/java -> 
> /home/falkon/ibm-java2-ppc64-50/
> 
> -- 
> 
> - Mike
> 
> 
> 
>>
>> Mihael
>>
>> On Sat, 2008-03-29 at 07:22 -0500, Michael Wilde wrote:
>>> Im not getting a swift <runid>.log file on the BGP after rebuilding 
>>> swift to 1771 with provider-deef.
>>>
>>> Im backtracking and debugging now, but does anyone know of recent 
>>> changes in this area, or of what I might have done wrong?
>>>
>>> (I lost access to many files when my sicortex NFS client host crashed 
>>> and then went into limited access mode, so I may have mis-configured 
>>> things)
>>>
>>> Does anyone see a cause?
>>>
>>> Thanks,
>>>
>>> Mike
>>>
>>> -- Im running swift with this script:
>>>
>>> WORKFLOW=$1
>>> shift
>>>
>>> site $* >sites.xml
>>>
>>> ( echo Swift script $WORKFLOW.swift starting at `date`
>>>    echo   running on sites: $*
>>>    echo
>>>    swift \
>>>     -sites.file ./sites.xml \
>>>     -tc.file ./tc.data \
>>>     $WORKFLOW.swift
>>>    echo
>>>    echo Swift Script $WORKFLOW.swift ended at `date` with exit code $?
>>> ) >swift.out 2>&1
>>>
>>> -- etc/log4j.properties
>>>
>>> bg$ cat log4j.properties
>>> # Set root category priority to WARN and its appenders to CONSOLE and 
>>> FILE.
>>> log4j.rootCategory=INFO, CONSOLE, FILE
>>>
>>> log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender
>>> log4j.appender.CONSOLE.layout=org.apache.log4j.PatternLayout
>>> log4j.appender.CONSOLE.Threshold=INFO
>>> log4j.appender.CONSOLE.layout.ConversionPattern=%m%n
>>>
>>> log4j.appender.FILE=org.apache.log4j.FileAppender
>>> log4j.appender.FILE.File=swift.log
>>> log4j.appender.FILE.layout=org.apache.log4j.PatternLayout
>>> log4j.appender.FILE.layout.ConversionPattern=%d{yyyy-MM-dd 
>>> HH:mm:ss,SSSZZZZZ} %-5p %c{1} %m%n
>>>
>>> log4j.logger.swift=DEBUG
>>>
>>> log4j.logger.org.globus.swift.trace=INFO
>>>
>>> log4j.logger.org.griphyn.vdl.karajan.Loader=DEBUG
>>> log4j.logger.org.globus.cog.karajan.workflow.events.WorkerSweeper=WARN
>>> log4j.logger.org.globus.cog.karajan.workflow.nodes.FlowNode=WARN
>>> log4j.logger.org.globus.cog.karajan.scheduler.WeightedHostScoreScheduler=DEBUG 
>>>
>>> log4j.logger.org.griphyn.vdl.toolkit.VDLt2VDLx=DEBUG
>>> log4j.logger.org.griphyn.vdl.karajan.VDL2ExecutionContext=DEBUG
>>> log4j.logger.org.globus.cog.abstraction.impl.common.task.TaskImpl=DEBUG
>>> log4j.logger.org.griphyn.vdl.karajan.lib.GetFieldValue=DEBUG
>>> log4j.logger.org.griphyn.vdl.engine.Karajan=INFO
>>>
>>> -- ~/.swift/swift.properties
>>>
>>> sitedir.keep=true
>>> wrapperlog.always.transfer=true
>>> lazy.errors=true
>>> execution.retries=0
>>>
>>> #kickstart.always.transfer=true
>>>
>>> throttle.submit=off
>>> throttle.host.submit=off
>>> throttle.transfers=20
>>> throttle.file.operations=20
>>> throttle.score.job.factor=1000000
>>>
>>> -- run dir after a swift run - no .log file!
>>>
>>> bg$ cd ~/mars/run01
>>> bg$ ls -lt
>>> total 1280
>>> -rw-r--r-- 1 wilde users    908 Mar 28 17:20 swift.out
>>> -rw-r--r-- 1 wilde users     48 Mar 28 17:20 
>>> amps2-20080328-1720-6jit1g59.0.rlog
>>> drwxr-xr-x 2 wilde users 131072 Mar 28 17:20 
>>> amps2-20080328-1720-6jit1g59.d
>>> -rw-r--r-- 1 wilde users   7859 Mar 28 17:20 amps2.kml
>>> -rw-r--r-- 1 wilde users   4397 Mar 28 17:20 amps2.xml
>>> -rw-r--r-- 1 wilde users    422 Mar 28 17:20 sites.xml
>>> -rw-r--r-- 1 wilde users    103 Mar 28 16:02 paramlist
>>> -rw-r--r-- 1 wilde users   1432 Mar 28 14:48 tc.data
>>> -rw-r--r-- 1 wilde users    654 Mar 28 14:36 amps2.swift
>>> bg$
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Swift-user mailing list
>>> Swift-user at ci.uchicago.edu
>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>>
>>
>>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
> 
>

More information about the Swift-user mailing list