2008-02-22 11:35:21,949-0600 INFO Loader 02.sort.swift: source file is new. Recompiling. 2008-02-22 11:35:23,302-0600 INFO Karajan Validation of XML intermediate file was successful 2008-02-22 11:35:24,647-0600 INFO unknown Using sites file: sites.xml 2008-02-22 11:35:24,647-0600 INFO unknown Using tc.data: tc.data 2008-02-22 11:35:25,777-0600 INFO unknown Swift v0.3 r1319 (modified locally) 2008-02-22 11:35:25,779-0600 INFO unknown RunID: 20080222-1135-24yc9v3e 2008-02-22 11:35:26,018-0600 INFO vdl:execute START thread=0-1 tr=sort 2008-02-22 11:35:26,018-0600 INFO vdl:execute START thread=0-2 tr=sort 2008-02-22 11:35:26,036-0600 INFO vdl:initshareddir START host=localhost - Initializing shared directory 2008-02-22 11:35:26,137-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724092) setting status to Active 2008-02-22 11:35:26,286-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724092) setting status to Completed 2008-02-22 11:35:26,331-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724094) setting status to Submitted 2008-02-22 11:35:26,405-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724094) setting status to Active 2008-02-22 11:35:26,414-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724094) setting status to Completed 2008-02-22 11:35:26,417-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724099) setting status to Submitted 2008-02-22 11:35:26,417-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724099) setting status to Active 2008-02-22 11:35:26,422-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724099) setting status to Completed 2008-02-22 11:35:26,424-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724103) setting status to Active 2008-02-22 11:35:26,425-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724103) setting status to Completed 2008-02-22 11:35:26,428-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724105) setting status to Active 2008-02-22 11:35:26,429-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724105) setting status to Completed 2008-02-22 11:35:26,432-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724107) setting status to Active 2008-02-22 11:35:26,433-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724107) setting status to Completed 2008-02-22 11:35:26,435-0600 INFO vdl:initshareddir END host=localhost - Done initializing shared directory 2008-02-22 11:35:26,437-0600 DEBUG vdl:execute2 THREAD_ASSOCIATION jobid=sort-xxqk3soi thread=0-2 host=localhost 2008-02-22 11:35:26,438-0600 DEBUG vdl:execute2 THREAD_ASSOCIATION jobid=sort-yxqk3soi thread=0-1 host=localhost 2008-02-22 11:35:26,494-0600 INFO vdl:createdirset START jobid=sort-xxqk3soi host=localhost - Initializing directory structure 2008-02-22 11:35:26,494-0600 INFO vdl:createdirset START jobid=sort-yxqk3soi host=localhost - Initializing directory structure 2008-02-22 11:35:26,497-0600 INFO vdl:createdirs Creating directory structure ./data in 02.sort-20080222-1135-24yc9v3e/shared (02.sort-20080222-1135-24yc9v3e/shared/./data) 2008-02-22 11:35:26,498-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724109) setting status to Active 2008-02-22 11:35:26,499-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724109) setting status to Completed 2008-02-22 11:35:26,503-0600 INFO vdl:createdirs Creating directory structure in 02.sort-20080222-1135-24yc9v3e/shared (02.sort-20080222-1135-24yc9v3e/shared/) 2008-02-22 11:35:26,504-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724111) setting status to Active 2008-02-22 11:35:26,504-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724111) setting status to Completed 2008-02-22 11:35:26,505-0600 INFO vdl:createdirset END jobid=sort-xxqk3soi - Done initializing directory structure 2008-02-22 11:35:26,506-0600 INFO vdl:createdirset END jobid=sort-yxqk3soi - Done initializing directory structure 2008-02-22 11:35:26,507-0600 INFO vdl:dostagein START jobid=sort-xxqk3soi - Staging in files 2008-02-22 11:35:26,507-0600 INFO vdl:dostagein START jobid=sort-yxqk3soi - Staging in files 2008-02-22 11:35:26,511-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724113) setting status to Active 2008-02-22 11:35:26,512-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724113) setting status to Completed 2008-02-22 11:35:26,513-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1-1203701724116) setting status to Active 2008-02-22 11:35:26,513-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1-1203701724116) setting status to Completed 2008-02-22 11:35:26,522-0600 DEBUG vdl:dostagein FILE_STAGE_IN_START file=file://localhost/./data/sdata0000000000 srchost=localhost srcdir=./data srcname=sdata0000000000 desthost=localhost destdir=02.sort-20080222-1135-24yc9v3e/shared/./data provider=file 2008-02-22 11:35:26,522-0600 DEBUG vdl:dostagein FILE_STAGE_IN_START file=file://localhost/./data/sdata0000000001 srchost=localhost srcdir=./data srcname=sdata0000000001 desthost=localhost destdir=02.sort-20080222-1135-24yc9v3e/shared/./data provider=file 2008-02-22 11:35:26,525-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1-1203701724119) setting status to Submitted 2008-02-22 11:35:26,525-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1-1203701724119) setting status to Active 2008-02-22 11:35:26,526-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1-1203701724122) setting status to Submitted 2008-02-22 11:35:26,527-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1-1203701724122) setting status to Active 2008-02-22 11:35:26,529-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1-1203701724119) setting status to Completed 2008-02-22 11:35:26,530-0600 DEBUG vdl:dostagein FILE_STAGE_IN_END file=file://localhost/./data/sdata0000000000 srchost=localhost srcdir=./data srcname=sdata0000000000 desthost=localhost destdir=02.sort-20080222-1135-24yc9v3e/shared/./data provider=file 2008-02-22 11:35:26,531-0600 INFO vdl:dostagein END jobid=sort-yxqk3soi - Staging in finished 2008-02-22 11:35:26,532-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1-1203701724122) setting status to Completed 2008-02-22 11:35:26,533-0600 DEBUG vdl:execute2 JOB_START jobid=sort-yxqk3soi tr=sort arguments=[-n, ./data/sdata0000000000] tmpdir=02.sort-20080222-1135-24yc9v3e/sort-yxqk3soi host=localhost 2008-02-22 11:35:26,534-0600 DEBUG vdl:dostagein FILE_STAGE_IN_END file=file://localhost/./data/sdata0000000001 srchost=localhost srcdir=./data srcname=sdata0000000001 desthost=localhost destdir=02.sort-20080222-1135-24yc9v3e/shared/./data provider=file 2008-02-22 11:35:26,534-0600 INFO vdl:dostagein END jobid=sort-xxqk3soi - Staging in finished 2008-02-22 11:35:26,539-0600 DEBUG vdl:execute2 JOB_START jobid=sort-xxqk3soi tr=sort arguments=[-n, ./data/sdata0000000001] tmpdir=02.sort-20080222-1135-24yc9v3e/sort-xxqk3soi host=localhost 2008-02-22 11:35:30,841-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-0-1203701724131) setting status to Submitted 2008-02-22 11:35:30,841-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724127) setting status to Submitted 2008-02-22 11:35:30,841-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724129) setting status to Submitted 2008-02-22 11:35:36,025-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-0-1203701724131) setting status to Active 2008-02-22 11:35:36,026-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724127) setting status to Active 2008-02-22 11:35:36,026-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724129) setting status to Active 2008-02-22 11:36:07,251-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-0-1203701724131) setting status to Completed 2008-02-22 11:36:07,251-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724127) setting status to Completed 2008-02-22 11:36:07,252-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724129) setting status to Completed 2008-02-22 11:36:07,255-0600 DEBUG vdl:checkjobstatus START jobid=sort-yxqk3soi 2008-02-22 11:36:07,255-0600 DEBUG vdl:checkjobstatus START jobid=sort-xxqk3soi 2008-02-22 11:36:07,257-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724133) setting status to Active 2008-02-22 11:36:07,257-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724135) setting status to Active 2008-02-22 11:36:07,284-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724133) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: /home/quanpt/swift-run-dir//02.sort-20080222-1135-24yc9v3e/status/sort-yxqk3soi-success not found. 2008-02-22 11:36:07,286-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724135) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: /home/quanpt/swift-run-dir//02.sort-20080222-1135-24yc9v3e/status/sort-xxqk3soi-success not found. 2008-02-22 11:36:07,287-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724138) setting status to Active 2008-02-22 11:36:07,287-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724138) setting status to Completed 2008-02-22 11:36:07,287-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724140) setting status to Active 2008-02-22 11:36:07,293-0600 INFO vdl:checkjobstatus NO_STATUS_FILE jobid=sort-yxqk3soi - Both status files are missing 2008-02-22 11:36:07,297-0600 DEBUG vdl:execute2 APPLICATION_EXCEPTION jobid=sort-yxqk3soi - Application exception: No status file was found. Check the shared filesystem on localhost sys:throw @ vdl-int.k, line: 96 sys:else @ vdl-int.k, line: 94 sys:if @ vdl-int.k, line: 82 sys:try @ vdl-int.k, line: 70 vdl:checkjobstatus @ vdl-int.k, line: 377 sys:sequential @ vdl-int.k, line: 353 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e 2008-02-22 11:36:07,302-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724142) setting status to Submitted 2008-02-22 11:36:07,303-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724140) setting status to Completed 2008-02-22 11:36:07,303-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724142) setting status to Active 2008-02-22 11:36:07,347-0600 INFO vdl:checkjobstatus FAILURE jobid=sort-xxqk3soi - Failure file found 2008-02-22 11:36:07,348-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724146) setting status to Submitted 2008-02-22 11:36:07,349-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724146) setting status to Active 2008-02-22 11:36:07,352-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724142) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-yxqk3soi/stderr.txt 2008-02-22 11:36:07,354-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724150) setting status to Active 2008-02-22 11:36:07,354-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724150) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-yxqk3soi-stderr.txt not found. 2008-02-22 11:36:07,356-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724153) setting status to Submitted 2008-02-22 11:36:07,356-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724153) setting status to Active 2008-02-22 11:36:07,357-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724153) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-yxqk3soi/out0000.txt 2008-02-22 11:36:07,358-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724157) setting status to Active 2008-02-22 11:36:07,359-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724157) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-yxqk3soi-out0000.txt not found. 2008-02-22 11:36:07,365-0600 DEBUG vdl:execute2 THREAD_ASSOCIATION jobid=sort-zxqk3soi thread=0-1 host=localhost 2008-02-22 11:36:07,367-0600 INFO vdl:createdirset START jobid=sort-zxqk3soi host=localhost - Initializing directory structure 2008-02-22 11:36:07,368-0600 INFO vdl:createdirset END jobid=sort-zxqk3soi - Done initializing directory structure 2008-02-22 11:36:07,368-0600 INFO vdl:dostagein START jobid=sort-zxqk3soi - Staging in files 2008-02-22 11:36:07,370-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1-1203701724161) setting status to Active 2008-02-22 11:36:07,370-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1-1203701724161) setting status to Completed 2008-02-22 11:36:07,371-0600 INFO vdl:dostagein END jobid=sort-zxqk3soi - Staging in finished 2008-02-22 11:36:07,372-0600 DEBUG vdl:execute2 JOB_START jobid=sort-zxqk3soi tr=sort arguments=[-n, ./data/sdata0000000000] tmpdir=02.sort-20080222-1135-24yc9v3e/sort-zxqk3soi host=localhost 2008-02-22 11:36:07,378-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724146) setting status to Completed 2008-02-22 11:36:07,380-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-0-1203701724166) setting status to Active 2008-02-22 11:36:07,382-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724168) setting status to Active 2008-02-22 11:36:07,383-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724168) setting status to Completed 2008-02-22 11:36:07,418-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-0-1203701724166) setting status to Completed 2008-02-22 11:36:07,420-0600 DEBUG vdl:execute2 APPLICATION_EXCEPTION jobid=sort-xxqk3soi - Application exception: Missing -if argument sys:throw @ vdl-int.k, line: 92 sys:then @ vdl-int.k, line: 83 sys:if @ vdl-int.k, line: 82 sys:try @ vdl-int.k, line: 70 vdl:checkjobstatus @ vdl-int.k, line: 377 sys:sequential @ vdl-int.k, line: 353 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e 2008-02-22 11:36:07,423-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724171) setting status to Submitted 2008-02-22 11:36:07,423-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724171) setting status to Active 2008-02-22 11:36:07,423-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724171) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-xxqk3soi/stderr.txt 2008-02-22 11:36:07,425-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724175) setting status to Active 2008-02-22 11:36:07,425-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724175) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-xxqk3soi-stderr.txt not found. 2008-02-22 11:36:07,427-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724178) setting status to Submitted 2008-02-22 11:36:07,427-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724178) setting status to Active 2008-02-22 11:36:07,427-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724178) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-xxqk3soi/out0001.txt 2008-02-22 11:36:07,429-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724182) setting status to Active 2008-02-22 11:36:07,429-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724182) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-xxqk3soi-out0001.txt not found. 2008-02-22 11:36:07,437-0600 DEBUG vdl:execute2 THREAD_ASSOCIATION jobid=sort-0yqk3soi thread=0-2 host=localhost 2008-02-22 11:36:07,440-0600 INFO vdl:createdirset START jobid=sort-0yqk3soi host=localhost - Initializing directory structure 2008-02-22 11:36:07,441-0600 INFO vdl:createdirset END jobid=sort-0yqk3soi - Done initializing directory structure 2008-02-22 11:36:07,441-0600 INFO vdl:dostagein START jobid=sort-0yqk3soi - Staging in files 2008-02-22 11:36:07,443-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724186) setting status to Active 2008-02-22 11:36:07,444-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724186) setting status to Completed 2008-02-22 11:36:07,444-0600 INFO vdl:dostagein END jobid=sort-0yqk3soi - Staging in finished 2008-02-22 11:36:07,444-0600 DEBUG vdl:execute2 JOB_START jobid=sort-0yqk3soi tr=sort arguments=[-n, ./data/sdata0000000001] tmpdir=02.sort-20080222-1135-24yc9v3e/sort-0yqk3soi host=localhost 2008-02-22 11:36:10,743-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-1-1203701724191) setting status to Submitted 2008-02-22 11:36:10,743-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724164) setting status to Submitted 2008-02-22 11:36:10,743-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724189) setting status to Submitted 2008-02-22 11:36:17,407-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-1-1203701724191) setting status to Active 2008-02-22 11:36:17,408-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724164) setting status to Active 2008-02-22 11:36:17,408-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724189) setting status to Active 2008-02-22 11:36:38,384-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-1-1203701724191) setting status to Completed 2008-02-22 11:36:38,384-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724164) setting status to Completed 2008-02-22 11:36:38,385-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724189) setting status to Completed 2008-02-22 11:36:38,386-0600 DEBUG vdl:checkjobstatus START jobid=sort-zxqk3soi 2008-02-22 11:36:38,387-0600 DEBUG vdl:checkjobstatus START jobid=sort-0yqk3soi 2008-02-22 11:36:38,388-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724193) setting status to Active 2008-02-22 11:36:38,388-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724195) setting status to Active 2008-02-22 11:36:38,407-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724193) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: /home/quanpt/swift-run-dir//02.sort-20080222-1135-24yc9v3e/status/sort-zxqk3soi-success not found. 2008-02-22 11:36:38,408-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724195) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: /home/quanpt/swift-run-dir//02.sort-20080222-1135-24yc9v3e/status/sort-0yqk3soi-success not found. 2008-02-22 11:36:38,429-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724199) setting status to Active 2008-02-22 11:36:38,429-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724197) setting status to Active 2008-02-22 11:36:38,435-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724199) setting status to Completed 2008-02-22 11:36:38,436-0600 INFO vdl:checkjobstatus FAILURE jobid=sort-0yqk3soi - Failure file found 2008-02-22 11:36:38,437-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724201) setting status to Submitted 2008-02-22 11:36:38,437-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724201) setting status to Active 2008-02-22 11:36:38,438-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724197) setting status to Completed 2008-02-22 11:36:38,439-0600 INFO vdl:checkjobstatus NO_STATUS_FILE jobid=sort-zxqk3soi - Both status files are missing 2008-02-22 11:36:38,440-0600 DEBUG vdl:execute2 APPLICATION_EXCEPTION jobid=sort-zxqk3soi - Application exception: No status file was found. Check the shared filesystem on localhost sys:throw @ vdl-int.k, line: 96 sys:else @ vdl-int.k, line: 94 sys:if @ vdl-int.k, line: 82 sys:try @ vdl-int.k, line: 70 vdl:checkjobstatus @ vdl-int.k, line: 377 sys:sequential @ vdl-int.k, line: 353 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e 2008-02-22 11:36:38,443-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724205) setting status to Submitted 2008-02-22 11:36:38,444-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724205) setting status to Active 2008-02-22 11:36:38,445-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724205) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-zxqk3soi/stderr.txt 2008-02-22 11:36:38,446-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724209) setting status to Active 2008-02-22 11:36:38,446-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724209) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-zxqk3soi-stderr.txt not found. 2008-02-22 11:36:38,448-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724212) setting status to Submitted 2008-02-22 11:36:38,449-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724212) setting status to Active 2008-02-22 11:36:38,449-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724212) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-zxqk3soi/out0000.txt 2008-02-22 11:36:38,450-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724216) setting status to Active 2008-02-22 11:36:38,451-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724216) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-zxqk3soi-out0000.txt not found. 2008-02-22 11:36:38,456-0600 DEBUG vdl:execute2 THREAD_ASSOCIATION jobid=sort-1yqk3soi thread=0-1 host=localhost 2008-02-22 11:36:38,459-0600 INFO vdl:createdirset START jobid=sort-1yqk3soi host=localhost - Initializing directory structure 2008-02-22 11:36:38,460-0600 INFO vdl:createdirset END jobid=sort-1yqk3soi - Done initializing directory structure 2008-02-22 11:36:38,460-0600 INFO vdl:dostagein START jobid=sort-1yqk3soi - Staging in files 2008-02-22 11:36:38,461-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724201) setting status to Completed 2008-02-22 11:36:38,463-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-0-1203701724220) setting status to Active 2008-02-22 11:36:38,464-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724222) setting status to Active 2008-02-22 11:36:38,466-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724222) setting status to Completed 2008-02-22 11:36:38,466-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1-1203701724225) setting status to Active 2008-02-22 11:36:38,467-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1-1203701724225) setting status to Completed 2008-02-22 11:36:38,468-0600 INFO vdl:dostagein END jobid=sort-1yqk3soi - Staging in finished 2008-02-22 11:36:38,469-0600 DEBUG vdl:execute2 JOB_START jobid=sort-1yqk3soi tr=sort arguments=[-n, ./data/sdata0000000000] tmpdir=02.sort-20080222-1135-24yc9v3e/sort-1yqk3soi host=localhost 2008-02-22 11:36:38,470-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-0-1203701724220) setting status to Completed 2008-02-22 11:36:38,472-0600 DEBUG vdl:execute2 APPLICATION_EXCEPTION jobid=sort-0yqk3soi - Application exception: Missing -if argument sys:throw @ vdl-int.k, line: 92 sys:then @ vdl-int.k, line: 83 sys:if @ vdl-int.k, line: 82 sys:try @ vdl-int.k, line: 70 vdl:checkjobstatus @ vdl-int.k, line: 377 sys:sequential @ vdl-int.k, line: 353 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e 2008-02-22 11:36:38,478-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724228) setting status to Submitted 2008-02-22 11:36:38,485-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724228) setting status to Active 2008-02-22 11:36:38,486-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724228) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-0yqk3soi/stderr.txt 2008-02-22 11:36:38,487-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724234) setting status to Active 2008-02-22 11:36:38,488-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724234) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-0yqk3soi-stderr.txt not found. 2008-02-22 11:36:38,490-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724237) setting status to Submitted 2008-02-22 11:36:38,490-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724237) setting status to Active 2008-02-22 11:36:38,491-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724237) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-0yqk3soi/out0001.txt 2008-02-22 11:36:38,493-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724241) setting status to Active 2008-02-22 11:36:38,493-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724241) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-0yqk3soi-out0001.txt not found. 2008-02-22 11:36:38,497-0600 DEBUG vdl:execute2 THREAD_ASSOCIATION jobid=sort-2yqk3soi thread=0-2 host=localhost 2008-02-22 11:36:38,500-0600 INFO vdl:createdirset START jobid=sort-2yqk3soi host=localhost - Initializing directory structure 2008-02-22 11:36:38,501-0600 INFO vdl:createdirset END jobid=sort-2yqk3soi - Done initializing directory structure 2008-02-22 11:36:38,501-0600 INFO vdl:dostagein START jobid=sort-2yqk3soi - Staging in files 2008-02-22 11:36:38,503-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724245) setting status to Active 2008-02-22 11:36:38,503-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724245) setting status to Completed 2008-02-22 11:36:38,504-0600 INFO vdl:dostagein END jobid=sort-2yqk3soi - Staging in finished 2008-02-22 11:36:38,504-0600 DEBUG vdl:execute2 JOB_START jobid=sort-2yqk3soi tr=sort arguments=[-n, ./data/sdata0000000001] tmpdir=02.sort-20080222-1135-24yc9v3e/sort-2yqk3soi host=localhost 2008-02-22 11:36:38,778-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-2-1203701724250) setting status to Submitted 2008-02-22 11:36:38,778-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724231) setting status to Submitted 2008-02-22 11:36:38,778-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724248) setting status to Submitted 2008-02-22 11:36:48,585-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-2-1203701724250) setting status to Active 2008-02-22 11:36:48,585-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724231) setting status to Active 2008-02-22 11:36:48,585-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724248) setting status to Active 2008-02-22 11:37:45,493-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:cluster-2-1203701724250) setting status to Completed 2008-02-22 11:37:45,493-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-1-1203701724231) setting status to Completed 2008-02-22 11:37:45,494-0600 DEBUG TaskImpl Task(type=JOB_SUBMISSION, identity=urn:0-2-1203701724248) setting status to Completed 2008-02-22 11:37:45,495-0600 DEBUG vdl:checkjobstatus START jobid=sort-1yqk3soi 2008-02-22 11:37:45,495-0600 DEBUG vdl:checkjobstatus START jobid=sort-2yqk3soi 2008-02-22 11:37:45,497-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724252) setting status to Active 2008-02-22 11:37:45,498-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724252) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: /home/quanpt/swift-run-dir//02.sort-20080222-1135-24yc9v3e/status/sort-1yqk3soi-success not found. 2008-02-22 11:37:45,498-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724254) setting status to Active 2008-02-22 11:37:45,498-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724254) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: /home/quanpt/swift-run-dir//02.sort-20080222-1135-24yc9v3e/status/sort-2yqk3soi-success not found. 2008-02-22 11:37:45,500-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724256) setting status to Active 2008-02-22 11:37:45,500-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724256) setting status to Completed 2008-02-22 11:37:45,501-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724258) setting status to Active 2008-02-22 11:37:45,501-0600 INFO vdl:checkjobstatus FAILURE jobid=sort-2yqk3soi - Failure file found 2008-02-22 11:37:45,501-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724258) setting status to Completed 2008-02-22 11:37:45,502-0600 INFO vdl:checkjobstatus NO_STATUS_FILE jobid=sort-1yqk3soi - Both status files are missing 2008-02-22 11:37:45,502-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724260) setting status to Submitted 2008-02-22 11:37:45,502-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724260) setting status to Active 2008-02-22 11:37:45,503-0600 DEBUG vdl:execute2 APPLICATION_EXCEPTION jobid=sort-1yqk3soi - Application exception: No status file was found. Check the shared filesystem on localhost sys:throw @ vdl-int.k, line: 96 sys:else @ vdl-int.k, line: 94 sys:if @ vdl-int.k, line: 82 sys:try @ vdl-int.k, line: 70 vdl:checkjobstatus @ vdl-int.k, line: 377 sys:sequential @ vdl-int.k, line: 353 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e 2008-02-22 11:37:45,504-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724260) setting status to Completed 2008-02-22 11:37:45,506-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724264) setting status to Submitted 2008-02-22 11:37:45,514-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724264) setting status to Active 2008-02-22 11:37:45,515-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724264) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-1yqk3soi/stderr.txt 2008-02-22 11:37:45,517-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724268) setting status to Active 2008-02-22 11:37:45,517-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724268) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-1yqk3soi-stderr.txt not found. 2008-02-22 11:37:45,519-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724271) setting status to Submitted 2008-02-22 11:37:45,519-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724271) setting status to Active 2008-02-22 11:37:45,520-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-1-1203701724271) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-1yqk3soi/out0000.txt 2008-02-22 11:37:45,521-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724275) setting status to Active 2008-02-22 11:37:45,522-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-1-1203701724275) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-1yqk3soi-out0000.txt not found. 2008-02-22 11:37:45,525-0600 INFO vdl:execute END_FAILURE thread=0-1 tr=sort 2008-02-22 11:37:45,531-0600 DEBUG VDL2ExecutionContext Exception in sort: Arguments: [-n, ./data/sdata0000000000] Host: localhost Directory: 02.sort-20080222-1135-24yc9v3e/sort-1yqk3soi stderr.txt: stdout.txt: ---- Exception in sort: Arguments: [-n, ./data/sdata0000000000] Host: localhost Directory: 02.sort-20080222-1135-24yc9v3e/sort-1yqk3soi stderr.txt: stdout.txt: ---- sys:exception @ vdl-int.k, line: 416 sys:throw @ vdl-int.k, line: 415 sys:catch @ vdl-int.k, line: 393 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e Caused by: No status file was found. Check the shared filesystem on localhost sys:throw @ vdl-int.k, line: 96 sys:else @ vdl-int.k, line: 94 sys:if @ vdl-int.k, line: 82 sys:try @ vdl-int.k, line: 70 vdl:checkjobstatus @ vdl-int.k, line: 377 sys:sequential @ vdl-int.k, line: 353 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e at org.globus.cog.karajan.workflow.nodes.functions.KException.function(KException.java:29) at org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:45) at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.childCompleted(AbstractSequentialWithArguments.java:192) at org.globus.cog.karajan.workflow.nodes.Sequential.notificationEvent(Sequential.java:33) at org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:335) at org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:123) at org.globus.cog.karajan.workflow.events.EventBus.sendHooked(EventBus.java:97) at org.globus.cog.karajan.workflow.nodes.FlowNode.fireNotificationEvent(FlowNode.java:173) at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:299) at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58) at org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:46) at org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:51) at org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:27) at org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.executeChildren(AbstractFunction.java:40) at org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63) at org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:240) at org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:281) at org.globus.cog.karajan.workflow.nodes.FlowNode.controlEvent(FlowNode.java:393) at org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:332) at org.globus.cog.karajan.workflow.FlowElementWrapper.event(FlowElementWrapper.java:227) at org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:123) at org.globus.cog.karajan.workflow.events.EventBus.sendHooked(EventBus.java:97) at org.globus.cog.karajan.workflow.events.EventWorker.run(EventWorker.java:69) Caused by: No status file was found. Check the shared filesystem on localhost sys:throw @ vdl-int.k, line: 96 sys:else @ vdl-int.k, line: 94 sys:if @ vdl-int.k, line: 82 sys:try @ vdl-int.k, line: 70 vdl:checkjobstatus @ vdl-int.k, line: 377 sys:sequential @ vdl-int.k, line: 353 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e at org.globus.cog.karajan.workflow.nodes.FlowNode.fail(FlowNode.java:413) at org.globus.cog.karajan.workflow.nodes.FlowNode.fail(FlowNode.java:417) at org.globus.cog.karajan.workflow.nodes.GenerateErrorNode.post(GenerateErrorNode.java:28) ... 21 more 2008-02-22 11:37:45,535-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724280) setting status to Active 2008-02-22 11:37:45,534-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-0-1203701724278) setting status to Active 2008-02-22 11:37:45,537-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1-1203701724280) setting status to Completed 2008-02-22 11:37:45,578-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-0-1203701724278) setting status to Completed 2008-02-22 11:37:45,579-0600 DEBUG vdl:execute2 APPLICATION_EXCEPTION jobid=sort-2yqk3soi - Application exception: Missing -if argument sys:throw @ vdl-int.k, line: 92 sys:then @ vdl-int.k, line: 83 sys:if @ vdl-int.k, line: 82 sys:try @ vdl-int.k, line: 70 vdl:checkjobstatus @ vdl-int.k, line: 377 sys:sequential @ vdl-int.k, line: 353 sys:try @ vdl-int.k, line: 352 task:allocatehost @ vdl-int.k, line: 334 vdl:execute2 @ execute-default.k, line: 23 sys:restartonerror @ execute-default.k, line: 21 sys:sequential @ execute-default.k, line: 19 sys:try @ execute-default.k, line: 18 sys:if @ execute-default.k, line: 17 sys:then @ execute-default.k, line: 16 sys:if @ execute-default.k, line: 15 vdl:execute @ 02.sort.kml, line: 20 sortfiles @ 02.sort.kml, line: 51 sys:parallelfor @ 02.sort.kml, line: 43 main @ 02.sort.kml, line: 87 vdl:mainp @ 02.sort.kml, line: 86 mainp @ vdl.k, line: 144 vdl:mains @ 02.sort.kml, line: 85 vdl:mains @ 02.sort.kml, line: 85 rlog:restartlog @ 02.sort.kml, line: 83 kernel:project @ 02.sort.kml, line: 2 02.sort-20080222-1135-24yc9v3e 2008-02-22 11:37:45,582-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724283) setting status to Submitted 2008-02-22 11:37:45,582-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724283) setting status to Active 2008-02-22 11:37:45,583-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724283) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-2yqk3soi/stderr.txt 2008-02-22 11:37:45,584-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724287) setting status to Active 2008-02-22 11:37:45,584-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724287) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-2yqk3soi-stderr.txt not found. 2008-02-22 11:37:45,586-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724290) setting status to Submitted 2008-02-22 11:37:45,586-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724290) setting status to Active 2008-02-22 11:37:45,587-0600 DEBUG TaskImpl Task(type=FILE_TRANSFER, identity=urn:0-2-1203701724290) setting status to Failed File not found: /home/quanpt/swift-run-dir/02.sort-20080222-1135-24yc9v3e/sort-2yqk3soi/out0001.txt 2008-02-22 11:37:45,588-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724294) setting status to Active 2008-02-22 11:37:45,588-0600 DEBUG TaskImpl Task(type=FILE_OPERATION, identity=urn:0-2-1203701724294) setting status to Failed org.globus.cog.abstraction.impl.file.FileNotFoundException: sort-2yqk3soi-out0001.txt not found. 2008-02-22 11:37:45,591-0600 INFO vdl:execute END_FAILURE thread=0-2 tr=sort 2008-02-22 11:37:45,756-0600 DEBUG Loader Swift finished - workflow had errors