<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">So this looks like a problem in the Swift code. The hang checker is activated at the start of the execution which is not good. Could you point me to where you ran this? Was this on surveyor? If it was not on surveyor I can give it a try. It looks like the projection phase is trying to project empty files. This could be due to the files actually being empty(I sent corrupted data) or Swift cannot find the files but ran mProjectPP anyways.<div><br><div><div>On Apr 12, 2012, at 12:44 AM, Emalayan Vairavanathan wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div><div style="color:#000; background-color:#fff; font-family:times new roman, new york, times, serif;font-size:12pt"><div>Hi Jon,</div><div><br></div><div>I tired to run the large Montage-workload which I got from you recently on both PVFS and MosaStore. With both systems the workload failed (I copied the standard output messages below). I guess this is due to the problem with the workload (because the system works with the small workloads). <br></div><div>Do you have any idea ? Did this workload work for you ?<br></div><div><br></div><div>Thank you</div><div>Emalayan<br></div><div><br></div><div><br></div><div><span style="color: rgb(0, 0, 127); font-style: italic;">Swift trunk swift-r5704 (swift modified locally) cog-r3361 (cog modified locally)</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">RunID:
20120412-0530-vj96mfz5</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">No events in 10s.</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Registered futures:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Waiting threads:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">No
events in 10s.</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Registered futures:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Waiting threads:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">No events in 10s.</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Registered futures:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Waiting threads:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">No events in 10s.</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Registered futures:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Waiting threads:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;"> (input): found 4116 files</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">No events in 10s.</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Registered futures:</span><br style="color: rgb(0, 0, 127); font-style:
italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Waiting threads:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">----</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Failed to acquire exclusive lock on log file.</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Progress: time: Thu, 12 Apr 2012 05:31:02 +0000</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Progress: time: Progress: time: Thu, 12 Apr 2012 05:31:11
+0000Thu, 12 Apr 2012 05:31:11 +0000 Initializing:2 Initializing:2</span><br style="color: rgb(0, 0, 127); font-style: italic;"><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Progress: time: Thu, 12 Apr 2012 05:31:12 +0000 Initializing:1023 Selecting site:1</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Progress: time: Thu, 12 Apr 2012 05:31:13 +0000 Selecting site:1020 Initializing site shared directory:1 Stage in:3</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Progress: time: Thu, 12 Apr 2012 05:31:15 +0000 Selecting site:1018 Stage in:5 Submitting:1</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style:
italic;">Find: <a href="http://172.17.3.12:12346">http://172.17.3.12:12346</a></span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Find: keepalive(120), reconnect - <a href="http://172.17.3.12:12346">http://172.17.3.12:12346</a></span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Passive queue processor initialized. Callback URI is <a href="http://172.17.3.12:12345">http://172.17.3.12:12345</a></span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Progress: time: Thu, 12 Apr 2012 05:31:16 +0000 Selecting site:1018 Active:6</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Progress: time: Thu, 12 Apr 2012 05:31:24 +0000 Selecting site:1018 Active:5 Failed but can retry:1</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127);
font-style: italic;">EXCEPTION Exception in mProjectPP_wrap:</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Arguments: [-X, raw_dir/2mass-atlas-991207s-j1130256.fits, proj_dir/proj_2mass-atlas-991207s-j1130256.fits, header.hdr]</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Host: persistent-coasters</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">Directory: SwiftMontage-20120412-0530-vj96mfz5/jobs/e/mProjectPP_wrap-eozxvrpk</span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">stderr.txt: </span><br style="color: rgb(0, 0, 127); font-style: italic;"><span style="color: rgb(0, 0, 127); font-style: italic;">stdout.txt: [struct stat="ERROR", msg="All pixels are
blank."]</span></div></div></div>_______________________________________________<br>Swift-devel mailing list<br><a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel<br></blockquote></div><br></div></body></html>