[Swift-user] debug log not being produced

Michael Wilde wilde at mcs.anl.gov
Sat Mar 29 09:25:10 CDT 2008


I rebuild a clean swift from r1773 from scratch, without deef, on both 
terminable and the bgp, then tested with a simple "swift first.swift" in 
examples/vdsk.

On terminable I get the log file fine, on the bgp I dont.



On 3/29/08 8:27 AM, Mihael Hategan wrote:
> log4j.properties looks fine.
> 
> What's in amps2-20080328-1720-6jit1g59.d and what does swift.out say?

The *.d dir was empty.  That swift.out said:

Swift script amps2.swift starting at Fri Mar 28 17:20:12 CDT 2008
running on sites: bgps

Swift svn swift-r1771 cog-r1953

RunID: 20080328-1720-6jit1g59
Progress:
runam6 started
error: Notification(int timeout): socket = new ServerSocket(recvPort); 
Address already in use
error: Notification(int timeout): socket = new ServerSocket(recvPort); 
Address already in use
2008-03-28 17:20:27,788 WARN  submitQueue.NonBlockingSubmit 
[pool-1-thread-1,notifyPreviousQueue:71] Warning: Task handler throws 
exception and also sets status
runam6 failed
Final status:  Failed:1
The following errors have occurred:
1. Application "runam6" failed (Task failed)
         Arguments: "000000, 0.200000, 0.000391, 0.204419, 0.200000, 
0.000391, 0.204419, 10"
         Host: bgps
         Directory: amps2-20080328-1720-6jit1g59/jobs/a/runam6-a9750gqi
         STDERR:
         STDOUT:

Swift Script amps2.swift ended at Fri Mar 28 17:20:28 CDT 2008 with exit 
code 0

--
it was that error that I was going after, and couldn't get the log file.

--
For the test I did on a fresh clean build of 1773 on the bgp, swift 
stdout/err gave:

bg$ $s/bin/swift first.swift
Swift svn swift-r1771 cog-r1953

RunID: 20080329-0913-xdviok1a
Progress:
echo started
echo completed
Final status:  Finished successfully:1
bg$ ls
anonymous.swift      default.dtm       first.xml 
helloworld_named.dtm  regexp.swift
array_index.dtm      diamond.dtm       fixedarray.swift  manyparam.swift 
       tutorial
array_iteration.dtm  file_counter.dtm  foreach.swift     parameter.swift 
       types.swift
array_wildcard.dtm   first.kml         hello.txt         q16.txt
arraymapper.dtm      first.swift       helloworld.dtm    range.dtm
bg$ pwd
/home/wilde/swift/rev/1773c/examples/vdsk
bg$

--

Im using this java:

bg$ echo $JAVA_HOME
/home/falkon/java
bg$ which java
/home/falkon/java/bin/java
bg$ java -version
java version "1.5.0"
Java(TM) 2 Runtime Environment, Standard Edition (build 
pxp64dev-20070511(SR5))
IBM J9 VM (build 2.3, J2RE 1.5.0 IBM J9 2.3 Linux ppc64-64 
j9vmxp6423-20070426 (JIT enabled)
J9VM - 20070420_12448_BHdSMr
JIT  - 20070419_1806_r8
GC   - 200704_19)
JCL  - 20070511
bg$

bg$ ls -l $JAVA_HOME
lrwxrwxrwx 1 wilde falkon 32 Mar 26 15:18 /home/falkon/java -> 
/home/falkon/ibm-java2-ppc64-50/

--

- Mike



> 
> Mihael
> 
> On Sat, 2008-03-29 at 07:22 -0500, Michael Wilde wrote:
>> Im not getting a swift <runid>.log file on the BGP after rebuilding 
>> swift to 1771 with provider-deef.
>>
>> Im backtracking and debugging now, but does anyone know of recent 
>> changes in this area, or of what I might have done wrong?
>>
>> (I lost access to many files when my sicortex NFS client host crashed 
>> and then went into limited access mode, so I may have mis-configured things)
>>
>> Does anyone see a cause?
>>
>> Thanks,
>>
>> Mike
>>
>> -- Im running swift with this script:
>>
>> WORKFLOW=$1
>> shift
>>
>> site $* >sites.xml
>>
>> ( echo Swift script $WORKFLOW.swift starting at `date`
>>    echo   running on sites: $*
>>    echo
>>    swift \
>>     -sites.file ./sites.xml \
>>     -tc.file ./tc.data \
>>     $WORKFLOW.swift
>>    echo
>>    echo Swift Script $WORKFLOW.swift ended at `date` with exit code $?
>> ) >swift.out 2>&1
>>
>> -- etc/log4j.properties
>>
>> bg$ cat log4j.properties
>> # Set root category priority to WARN and its appenders to CONSOLE and FILE.
>> log4j.rootCategory=INFO, CONSOLE, FILE
>>
>> log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender
>> log4j.appender.CONSOLE.layout=org.apache.log4j.PatternLayout
>> log4j.appender.CONSOLE.Threshold=INFO
>> log4j.appender.CONSOLE.layout.ConversionPattern=%m%n
>>
>> log4j.appender.FILE=org.apache.log4j.FileAppender
>> log4j.appender.FILE.File=swift.log
>> log4j.appender.FILE.layout=org.apache.log4j.PatternLayout
>> log4j.appender.FILE.layout.ConversionPattern=%d{yyyy-MM-dd 
>> HH:mm:ss,SSSZZZZZ} %-5p %c{1} %m%n
>>
>> log4j.logger.swift=DEBUG
>>
>> log4j.logger.org.globus.swift.trace=INFO
>>
>> log4j.logger.org.griphyn.vdl.karajan.Loader=DEBUG
>> log4j.logger.org.globus.cog.karajan.workflow.events.WorkerSweeper=WARN
>> log4j.logger.org.globus.cog.karajan.workflow.nodes.FlowNode=WARN
>> log4j.logger.org.globus.cog.karajan.scheduler.WeightedHostScoreScheduler=DEBUG
>> log4j.logger.org.griphyn.vdl.toolkit.VDLt2VDLx=DEBUG
>> log4j.logger.org.griphyn.vdl.karajan.VDL2ExecutionContext=DEBUG
>> log4j.logger.org.globus.cog.abstraction.impl.common.task.TaskImpl=DEBUG
>> log4j.logger.org.griphyn.vdl.karajan.lib.GetFieldValue=DEBUG
>> log4j.logger.org.griphyn.vdl.engine.Karajan=INFO
>>
>> -- ~/.swift/swift.properties
>>
>> sitedir.keep=true
>> wrapperlog.always.transfer=true
>> lazy.errors=true
>> execution.retries=0
>>
>> #kickstart.always.transfer=true
>>
>> throttle.submit=off
>> throttle.host.submit=off
>> throttle.transfers=20
>> throttle.file.operations=20
>> throttle.score.job.factor=1000000
>>
>> -- run dir after a swift run - no .log file!
>>
>> bg$ cd ~/mars/run01
>> bg$ ls -lt
>> total 1280
>> -rw-r--r-- 1 wilde users    908 Mar 28 17:20 swift.out
>> -rw-r--r-- 1 wilde users     48 Mar 28 17:20 
>> amps2-20080328-1720-6jit1g59.0.rlog
>> drwxr-xr-x 2 wilde users 131072 Mar 28 17:20 amps2-20080328-1720-6jit1g59.d
>> -rw-r--r-- 1 wilde users   7859 Mar 28 17:20 amps2.kml
>> -rw-r--r-- 1 wilde users   4397 Mar 28 17:20 amps2.xml
>> -rw-r--r-- 1 wilde users    422 Mar 28 17:20 sites.xml
>> -rw-r--r-- 1 wilde users    103 Mar 28 16:02 paramlist
>> -rw-r--r-- 1 wilde users   1432 Mar 28 14:48 tc.data
>> -rw-r--r-- 1 wilde users    654 Mar 28 14:36 amps2.swift
>> bg$
>>
>>
>>
>>
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user
>>
> 
> 



More information about the Swift-user mailing list