<html><body><div style="color:#000; background-color:#fff; font-family:times new roman, new york, times, serif;font-size:12pt"><div>Hi All,</div><div><br></div><div>I tired to run my pipeline-swift benchmark on GPFS+PVFS with 128 compute nodes (Surveyor), JOB_THROTTLE = 1000 and JOBS_PER_NODE = 4. <br></div><div>I used GPFS as the central storage and PVFS as the intermediate storage. The benchmark did not make any progress and I found the following messages in the log file. (This happened even with MosaStore)</div><div><br></div><div><br><span style="font-style: italic; color: rgb(0, 0, 191);">2012-04-10 18:18:36,710+0000 WARN HangChecke No events in 10s.</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">2012-04-10 18:18:36,717+0000 WARN HangChecker</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">Registered
futures:</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">file stage_2_output - F/stage_2_output[95]:file - Open</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">file stage_1_output - F/stage_1_output[85]:file - Open</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">file stage_3_output - F/stage_3_output[62]:file - Open</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">file stage_3_output - F/stage_3_output[44]:file - Open</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">file stage_1_output - F/stage_1_output[4]:file - Open</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic;
color: rgb(0, 0, 191);">file stage_2_output - F/stage_2_output[3]:file - Open</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">file input_data - F/input_data[121]:file - Open</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">file stage_1_output - F/stage_1_output[113]:file - Open</span><br style="font-style: italic; color: rgb(0, 0, 191);"><span style="font-style: italic; color: rgb(0, 0, 191);">file stage_1_output - F/stage_1_output[98]:file - Open</span></div><div><br></div><div>I am using the swift version that I took from Justin's home directory 3 weeks before. <br></div><div><br></div><div>Do you have any idea ? Does swift has problem with high throttling rate / jobs-per-node ? I have attached swift log file and the benchmark with this mail. I highly appreciate your suggestions.<br></div><div><br></div><div>Thank
you</div><div>Emalayan<br></div></div></body></html>