From abejan at ci.uchicago.edu Mon Oct 13 20:40:45 2008 From: abejan at ci.uchicago.edu (Alina Bejan) Date: Mon, 13 Oct 2008 20:40:45 -0500 Subject: [Swift-user] Re: swift guts doc with many diagrams and graphs In-Reply-To: References: <20081013170003.EBCC52C0043@mail.ci.uchicago.edu> <48F3C248.1030308@ci.uchicago.edu> Message-ID: <48F3F89D.1060600@ci.uchicago.edu> Ok -- I am continuing this discussion on the user list. Here's where I put the .log file and the output of the swift-plot-log command on this file. http://www.ci.uchicago.edu/~abejan/swift-logs/ Alina Ben Clifford wrote: > On Mon, 13 Oct 2008, Alina Bejan wrote: > > >> Please tell me if the instructions below are still accurate, or if anything >> changed -- basically the 'report-abc' directory fails to being created. >> > > Probably the thing to do is make a report to eithe r this or the users > list with the following: a URL or filesystem path where we can see the log > file; the output of running swoft-plot-log. > > This guide isn't intended to contain basic user instructions for that - > the page that you looked at before (with the below instructions) is. Those > instructions that you pasted below should still work. > > >> "On a computer such as communicado, type: >> >> svn co https://svn.ci.uchicago.edu/svn/vdl2/log-processing >> cd log-processing/bin >> export PATH=$(pwd):$PATH >> swift-plot-log mylog-01234456-8922-abcdef.log >> >> This will give you a directory report-mylog-01234456-8922-abcdef/ >> >> I usually then >> >> mv report-mylog-01234456-8922-abcdef ~benc/public_html/ >> >> so that I can view it with a web browser at >> http://www.ci.uchicago.edu/~benc/report-mylog-01234456-8922-abcdef/ >> " >> > > From benc at hawaga.org.uk Mon Oct 13 21:12:11 2008 From: benc at hawaga.org.uk (Ben Clifford) Date: Tue, 14 Oct 2008 02:12:11 +0000 (GMT) Subject: [Swift-user] Re: swift guts doc with many diagrams and graphs In-Reply-To: <48F3F89D.1060600@ci.uchicago.edu> References: <20081013170003.EBCC52C0043@mail.ci.uchicago.edu> <48F3C248.1030308@ci.uchicago.edu> <48F3F89D.1060600@ci.uchicago.edu> Message-ID: Try log-processing r2293 (type 'svn update' in the log-processing directory and check that it says you have r2293 or higher) That fixes the problem for me. On Mon, 13 Oct 2008, Alina Bejan wrote: > > Ok -- I am continuing this discussion on the user list. > > Here's where I put the .log file and the output of the swift-plot-log command > on this file. > > http://www.ci.uchicago.edu/~abejan/swift-logs/ > > > Alina > > > Ben Clifford wrote: > > On Mon, 13 Oct 2008, Alina Bejan wrote: > > > > > > > Please tell me if the instructions below are still accurate, or if > > > anything > > > changed -- basically the 'report-abc' directory fails to being created. > > > > Probably the thing to do is make a report to eithe r this or the users list > > with the following: a URL or filesystem path where we can see the log file; > > the output of running swoft-plot-log. > > > > This guide isn't intended to contain basic user instructions for that - the > > page that you looked at before (with the below instructions) is. Those > > instructions that you pasted below should still work. > > > > > > > "On a computer such as communicado, type: > > > > > > svn co https://svn.ci.uchicago.edu/svn/vdl2/log-processing > > > cd log-processing/bin > > > export PATH=$(pwd):$PATH > > > swift-plot-log mylog-01234456-8922-abcdef.log > > > > > > This will give you a directory report-mylog-01234456-8922-abcdef/ > > > > > > I usually then > > > > > > mv report-mylog-01234456-8922-abcdef ~benc/public_html/ > > > > > > so that I can view it with a web browser at > > > http://www.ci.uchicago.edu/~benc/report-mylog-01234456-8922-abcdef/ > > > " > > > > > > > > > From abejan at ci.uchicago.edu Tue Oct 14 09:34:37 2008 From: abejan at ci.uchicago.edu (Alina Bejan) Date: Tue, 14 Oct 2008 09:34:37 -0500 Subject: [Swift-user] Re: swift guts doc with many diagrams and graphs In-Reply-To: References: <20081013170003.EBCC52C0043@mail.ci.uchicago.edu> <48F3C248.1030308@ci.uchicago.edu> <48F3F89D.1060600@ci.uchicago.edu> Message-ID: <48F4ADFD.9000507@ci.uchicago.edu> yes, it worked, thanks. One more problem I noticed: 'readdata' does not work under Swift 0.6 (so I went back to use Swift 0.5). This might be a known problem, but thought I'd mention it. Alina Ben Clifford wrote: > Try log-processing r2293 (type 'svn update' in the log-processing > directory and check that it says you have r2293 or higher) > > That fixes the problem for me. > > On Mon, 13 Oct 2008, Alina Bejan wrote: > > >> Ok -- I am continuing this discussion on the user list. >> >> Here's where I put the .log file and the output of the swift-plot-log command >> on this file. >> >> http://www.ci.uchicago.edu/~abejan/swift-logs/ >> >> >> Alina >> >> >> Ben Clifford wrote: >> >>> On Mon, 13 Oct 2008, Alina Bejan wrote: >>> >>> >>> >>>> Please tell me if the instructions below are still accurate, or if >>>> anything >>>> changed -- basically the 'report-abc' directory fails to being created. >>>> >>> Probably the thing to do is make a report to eithe r this or the users list >>> with the following: a URL or filesystem path where we can see the log file; >>> the output of running swoft-plot-log. >>> >>> This guide isn't intended to contain basic user instructions for that - the >>> page that you looked at before (with the below instructions) is. Those >>> instructions that you pasted below should still work. >>> >>> >>> >>>> "On a computer such as communicado, type: >>>> >>>> svn co https://svn.ci.uchicago.edu/svn/vdl2/log-processing >>>> cd log-processing/bin >>>> export PATH=$(pwd):$PATH >>>> swift-plot-log mylog-01234456-8922-abcdef.log >>>> >>>> This will give you a directory report-mylog-01234456-8922-abcdef/ >>>> >>>> I usually then >>>> >>>> mv report-mylog-01234456-8922-abcdef ~benc/public_html/ >>>> >>>> so that I can view it with a web browser at >>>> http://www.ci.uchicago.edu/~benc/report-mylog-01234456-8922-abcdef/ >>>> " >>>> >>>> >>> >>> >> From wilde at mcs.anl.gov Tue Oct 14 09:49:32 2008 From: wilde at mcs.anl.gov (Michael Wilde) Date: Tue, 14 Oct 2008 09:49:32 -0500 Subject: [Swift-user] Re: swift guts doc with many diagrams and graphs In-Reply-To: <48F4ADFD.9000507@ci.uchicago.edu> References: <20081013170003.EBCC52C0043@mail.ci.uchicago.edu> <48F3C248.1030308@ci.uchicago.edu> <48F3F89D.1060600@ci.uchicago.edu> <48F4ADFD.9000507@ci.uchicago.edu> Message-ID: <48F4B17C.7070905@mcs.anl.gov> I think its spelled readData(), or was there another problem with it? - Mike On 10/14/08 9:34 AM, Alina Bejan wrote: > > yes, it worked, thanks. > > One more problem I noticed: 'readdata' does not work under Swift 0.6 (so > I went back to use Swift 0.5). This might be a known problem, but > thought I'd mention it. > > Alina > > Ben Clifford wrote: >> Try log-processing r2293 (type 'svn update' in the log-processing >> directory and check that it says you have r2293 or higher) >> >> That fixes the problem for me. >> >> On Mon, 13 Oct 2008, Alina Bejan wrote: >> >> >>> Ok -- I am continuing this discussion on the user list. >>> >>> Here's where I put the .log file and the output of the swift-plot-log >>> command >>> on this file. >>> >>> http://www.ci.uchicago.edu/~abejan/swift-logs/ >>> >>> >>> Alina >>> >>> >>> Ben Clifford wrote: >>> >>>> On Mon, 13 Oct 2008, Alina Bejan wrote: >>>> >>>> >>>>> Please tell me if the instructions below are still accurate, or if >>>>> anything >>>>> changed -- basically the 'report-abc' directory fails to being >>>>> created. >>>> Probably the thing to do is make a report to eithe r this or the >>>> users list >>>> with the following: a URL or filesystem path where we can see the >>>> log file; >>>> the output of running swoft-plot-log. >>>> >>>> This guide isn't intended to contain basic user instructions for >>>> that - the >>>> page that you looked at before (with the below instructions) is. Those >>>> instructions that you pasted below should still work. >>>> >>>> >>>>> "On a computer such as communicado, type: >>>>> >>>>> svn co https://svn.ci.uchicago.edu/svn/vdl2/log-processing >>>>> cd log-processing/bin >>>>> export PATH=$(pwd):$PATH >>>>> swift-plot-log mylog-01234456-8922-abcdef.log >>>>> >>>>> This will give you a directory report-mylog-01234456-8922-abcdef/ >>>>> >>>>> I usually then >>>>> >>>>> mv report-mylog-01234456-8922-abcdef ~benc/public_html/ >>>>> >>>>> so that I can view it with a web browser at >>>>> http://www.ci.uchicago.edu/~benc/report-mylog-01234456-8922-abcdef/ >>>>> " >>>>> >>>> >>> > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user From abejan at ci.uchicago.edu Tue Oct 14 10:28:35 2008 From: abejan at ci.uchicago.edu (Alina Bejan) Date: Tue, 14 Oct 2008 10:28:35 -0500 Subject: [Swift-user] Re: swift guts doc with many diagrams and graphs In-Reply-To: <48F4B17C.7070905@mcs.anl.gov> References: <20081013170003.EBCC52C0043@mail.ci.uchicago.edu> <48F3C248.1030308@ci.uchicago.edu> <48F3F89D.1060600@ci.uchicago.edu> <48F4ADFD.9000507@ci.uchicago.edu> <48F4B17C.7070905@mcs.anl.gov> Message-ID: <48F4BAA3.9020306@ci.uchicago.edu> Alright -- I am not able to re-create the problem, so might have been a problem of mine. It does compile now fine with 0.6, but I am facing other wrapper file tranferring problems now (which I did not have yesterday with 0.5). If the problem persists, I will get back with another email. Thanks, Alina Michael Wilde wrote: > I think its spelled readData(), or was there another problem with it? > > - Mike > > > On 10/14/08 9:34 AM, Alina Bejan wrote: >> >> yes, it worked, thanks. >> >> One more problem I noticed: 'readdata' does not work under Swift 0.6 >> (so I went back to use Swift 0.5). This might be a known problem, but >> thought I'd mention it. >> >> Alina >> >> Ben Clifford wrote: >>> Try log-processing r2293 (type 'svn update' in the log-processing >>> directory and check that it says you have r2293 or higher) >>> >>> That fixes the problem for me. >>> >>> On Mon, 13 Oct 2008, Alina Bejan wrote: >>> >>> >>>> Ok -- I am continuing this discussion on the user list. >>>> >>>> Here's where I put the .log file and the output of the >>>> swift-plot-log command >>>> on this file. >>>> >>>> http://www.ci.uchicago.edu/~abejan/swift-logs/ >>>> >>>> >>>> Alina >>>> >>>> >>>> Ben Clifford wrote: >>>> >>>>> On Mon, 13 Oct 2008, Alina Bejan wrote: >>>>> >>>>> >>>>>> Please tell me if the instructions below are still accurate, or if >>>>>> anything >>>>>> changed -- basically the 'report-abc' directory fails to being >>>>>> created. >>>>> Probably the thing to do is make a report to eithe r this or the >>>>> users list >>>>> with the following: a URL or filesystem path where we can see the >>>>> log file; >>>>> the output of running swoft-plot-log. >>>>> >>>>> This guide isn't intended to contain basic user instructions for >>>>> that - the >>>>> page that you looked at before (with the below instructions) is. >>>>> Those >>>>> instructions that you pasted below should still work. >>>>> >>>>> >>>>>> "On a computer such as communicado, type: >>>>>> >>>>>> svn co https://svn.ci.uchicago.edu/svn/vdl2/log-processing >>>>>> cd log-processing/bin >>>>>> export PATH=$(pwd):$PATH >>>>>> swift-plot-log mylog-01234456-8922-abcdef.log >>>>>> >>>>>> This will give you a directory report-mylog-01234456-8922-abcdef/ >>>>>> >>>>>> I usually then >>>>>> >>>>>> mv report-mylog-01234456-8922-abcdef ~benc/public_html/ >>>>>> >>>>>> so that I can view it with a web browser at >>>>>> http://www.ci.uchicago.edu/~benc/report-mylog-01234456-8922-abcdef/ >>>>>> " >>>>>> >>>>> >>>> >> _______________________________________________ >> Swift-user mailing list >> Swift-user at ci.uchicago.edu >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user From iraicu at cs.uchicago.edu Wed Oct 15 13:06:39 2008 From: iraicu at cs.uchicago.edu (Ioan Raicu) Date: Wed, 15 Oct 2008 13:06:39 -0500 Subject: [Swift-user] "Megajobs: How to Run One Million Jobs" at SC08 Message-ID: <48F6312F.7060700@cs.uchicago.edu> Dear all, We'd like to solicit your participation in the "Megajobs: How to Run One Million Jobs" BOF, which will be held at Supercomputing in Austin Texas on November 18th, 2008. We are looking for short, piquant presentations (5-10 minutes) from people who have worked on this problem or have a problem like this that needs to be worked on. If you are interested, please send a brief title and abstract (250 words) to Marlon Pierce . Please feel free to contact us if you have questions. More information about the BOF can be found online at http://gridfarm007.ucs.indiana.edu/megajobBOF/index.php/Main_Page. Ioan, on behalf of the BOF co-organizers -- =================================================== Ioan Raicu Ph.D. Candidate =================================================== Distributed Systems Laboratory Computer Science Department University of Chicago 1100 E. 58th Street, Ryerson Hall Chicago, IL 60637 =================================================== Email: iraicu at cs.uchicago.edu Web: http://www.cs.uchicago.edu/~iraicu http://dev.globus.org/wiki/Incubator/Falkon http://dsl-wiki.cs.uchicago.edu/index.php/Main_Page =================================================== =================================================== From tiberius at ci.uchicago.edu Wed Oct 29 11:35:19 2008 From: tiberius at ci.uchicago.edu (Tiberiu Stef-Praun) Date: Wed, 29 Oct 2008 11:35:19 -0500 Subject: [Swift-user] Failed to transfer wrapper log from Message-ID: Hi guys I have noticed that I am getting the error: "Failed to transfer wrapper log from" when there is something bad with the execution of my application (such as a "Segmentation Fault"). The swift error is not extremely descriptive, I had to dig quite a lot to find the SegmentationFault error message. You might want to document this somewhere Tibi -- Tiberiu (Tibi) Stef-Praun, PhD Computational Sciences Researcher Computation Institute 5640 S. Ellis Ave, #405 University of Chicago http://www-unix.mcs.anl.gov/~tiberius/ From zhaozhang at uchicago.edu Wed Oct 29 13:13:47 2008 From: zhaozhang at uchicago.edu (Zhao Zhang) Date: Wed, 29 Oct 2008 13:13:47 -0500 Subject: [Swift-user] Failed to transfer wrapper log from In-Reply-To: References: Message-ID: <4908A7DB.7020204@uchicago.edu> Hi, Tibi That is because the swift on BGP is a customized version. So the information from the swift stdout might not be the real things happen on Compute Node. zhao Tiberiu Stef-Praun wrote: > Hi guys > > I have noticed that I am getting the error: "Failed to transfer > wrapper log from" when there is something bad with the execution of my > application (such as a "Segmentation Fault"). > The swift error is not extremely descriptive, I had to dig quite a lot > to find the SegmentationFault error message. > > You might want to document this somewhere > > Tibi > > From hategan at mcs.anl.gov Wed Oct 29 15:00:30 2008 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 29 Oct 2008 15:00:30 -0500 Subject: [Swift-user] Failed to transfer wrapper log from In-Reply-To: <4908A7DB.7020204@uchicago.edu> References: <4908A7DB.7020204@uchicago.edu> Message-ID: <1225310430.28266.1.camel@localhost> This is actually a generic problem with Swift, and Tibi has identified it correctly. I keep wanting to fix it... On Wed, 2008-10-29 at 13:13 -0500, Zhao Zhang wrote: > Hi, Tibi > > That is because the swift on BGP is a customized version. So the > information from the swift stdout might not be > the real things happen on Compute Node. > > zhao > > Tiberiu Stef-Praun wrote: > > Hi guys > > > > I have noticed that I am getting the error: "Failed to transfer > > wrapper log from" when there is something bad with the execution of my > > application (such as a "Segmentation Fault"). > > The swift error is not extremely descriptive, I had to dig quite a lot > > to find the SegmentationFault error message. > > > > You might want to document this somewhere > > > > Tibi > > > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user From benc at hawaga.org.uk Wed Oct 29 21:00:43 2008 From: benc at hawaga.org.uk (Ben Clifford) Date: Thu, 30 Oct 2008 02:00:43 +0000 (GMT) Subject: [Swift-user] Failed to transfer wrapper log from In-Reply-To: <1225310430.28266.1.camel@localhost> References: <4908A7DB.7020204@uchicago.edu> <1225310430.28266.1.camel@localhost> Message-ID: On Wed, 29 Oct 2008, Mihael Hategan wrote: > This is actually a generic problem with Swift, and Tibi has identified > it correctly. I keep wanting to fix it... me too... --