From hategan at mcs.anl.gov Sun Apr 5 21:17:23 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Sun, 5 Apr 2015 19:17:23 -0700 Subject: [Swift-devel] assertEqual Message-ID: <1428286643.8235.2.camel@echo> Hi, I found it useful to have a tolerance parameter for assertEqual(float, float). Checks like assertEqual(tan(x), sin(x) / cos(x)) are otherwise not going to work very well. Mihael From tim.g.armstrong at gmail.com Mon Apr 6 09:38:03 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Mon, 6 Apr 2015 09:38:03 -0500 Subject: [Swift-devel] assertEqual In-Reply-To: <1428286643.8235.2.camel@echo> References: <1428286643.8235.2.camel@echo> Message-ID: Right, the tests for those things in the Swift test suite are like: assert(abs(sin(PI/2) - 1.0) < 1e-15, "sin"); Which is a little less convenient. I think if we want almost equal semantics we could have assertAlmostEqual with a tolerance parameter -Tim On 5 April 2015 at 21:17, Mihael Hategan wrote: > Hi, > > I found it useful to have a tolerance parameter for assertEqual(float, > float). > > Checks like assertEqual(tan(x), sin(x) / cos(x)) are otherwise not going > to work very well. > > Mihael > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Mon Apr 6 12:14:23 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Mon, 6 Apr 2015 10:14:23 -0700 Subject: [Swift-devel] assertEqual In-Reply-To: References: <1428286643.8235.2.camel@echo> Message-ID: <1428340463.17969.0.camel@echo> On Mon, 2015-04-06 at 09:38 -0500, Tim Armstrong wrote: > Right, the tests for those things in the Swift test suite are like: > > assert(abs(sin(PI/2) - 1.0) < 1e-15, "sin"); > > Which is a little less convenient. > > I think if we want almost equal semantics we could have assertAlmostEqual > with a tolerance parameter That's a choice. I personally think that approximate equality in numerics is such a widespread issue, that there wouldn't be much confusion. Mihael > > -Tim > > On 5 April 2015 at 21:17, Mihael Hategan wrote: > > > Hi, > > > > I found it useful to have a tolerance parameter for assertEqual(float, > > float). > > > > Checks like assertEqual(tan(x), sin(x) / cos(x)) are otherwise not going > > to work very well. > > > > Mihael > > > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > From iraicu at cs.iit.edu Tue Apr 7 23:28:53 2015 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Tue, 07 Apr 2015 23:28:53 -0500 Subject: [Swift-devel] IEEE Cluster 2015 - Call for Posters Message-ID: <5524AE85.40508@cs.iit.edu> April 7, 2015 Release IEEE International Conference on Cluster Computing September 8-11, 2015 Chicago, IL, USA http://www.mcs.anl.gov/ieeecluster2015/ *** CALL FOR POSTERS *** The IEEE Cluster 2015 provides a forum for both academia and industry professionals to present their latest research findings in all aspects of cluster, cloud, and grid technologies in the form of a posters, which will be included in the conference proceedings. Posters will be presented during the same session, during the conference. Additionally, authors may submit posters for publication on the web. *** TOPICS OF INTEREST *** The topics of interest are the same as in the Call for Papers. Area 1: Application, Algorithms, and Libraries * HPC Applications on Clusters * Performance Modeling and Measurement * Novel Algorithms on Clusters * Hybrid programming techniques (MPI+OpenMP, MPI+OpenCL, etc.) * Cluster Benchmarks * Application-level libraries on clusters * Effective use of clusters in novel applications * Performance evaluation tools Area 2: Architecture, Network/Communications, and Management * Energy-efficient cluster architectures * Node and system architecture * Packaging, power and cooling * GPU/ManyCore and heterogeneous clusters * Interconnect/memory architectures * Single system image clusters * Administration and maintenance tools Area 3: Programming and System Software * Cluster System Software/Operating Systems * Cloud-enabling cluster technologies and virtualization * Energy-efficient middleware * Cluster system-level Protocols and APIs * Cluster Security * Resource and job management * Programming and Software Development Environment on Clusters * Fault tolerance and high-availability Area 4: Data, Storage, and Visualization * Cluster Architecture for Big Data storage and processing * Middleware for Big Data management * Cluster-based Cloud Architecture for Big Data * File systems and I/O libraries * Support and Integration of Non-Volatile Memory * Visualization clusters and tiled displays * Big Data visualization tools * Programming models for Big Data processing * Big Data Application studies on cluster architectures *** TYPES OF POSTERS *** Participants submitting proceedings-published posters are required to submit a short paper (2 pages) describing the poster content, the research supporting it, and the relevance and importance to the cluster, cloud, and grid computing community. If accepted, this short paper will be published in the proceedings of the conference. Participants submitting web-published posters are required to submit a short 1-page extended abstract. These abstracts will not be included in the conference proceedings. Both proceedings-published and web-published posters will be displayed during the conference. We encourage accepted authors of demos to prepare a poster to accompany their demo. All accepted posters (including posters prepared for demos) will be posted on the conference website. *** DISPLAY POSTER SIZE *** The recommended poster size is A1 (594mm by 841mm, portrait). *** SUBMISSION GUIDELINES *** Submitted manuscripts should be structured as technical papers and may not exceed 1 (web published) or 2 (proceedings published) letter size (8.5 x 11) pages including figures, tables and references using the IEEE format for conference proceedings. See formatting templates for details: * LaTex Package ZIP ftp://pubftp.computer.org/Press/Outgoing/proceedings/IEEE_CS_Latex8.5x11x2.zip * Word Template DOC and PDF ftp://pubftp.computer.org/Press/Outgoing/proceedings/instruct8.5x11x2.doc ftp://pubftp.computer.org/Press/Outgoing/proceedings/instruct8.5x11x2.pdf Please submit your posters via the EasyChair submission system: https://easychair.org/conferences/?conf=ieeecluster2015 *** IMPORTANT DATES *** May 15, 2015 (extended) Posters Submission Deadline May 9, 2015 Papers Acceptance Notification *** STUDENT TRAVEL AWARDS *** Several travel awards are sponsored by the National Science Foundation for students enrolled in American institutions who participates in the Student Mentoring Program (http://www.mcs.anl.gov/ieeecluster2015/student-program/). Students with accepted posters or papers must also apply to and participate in the Student Mentoring Program to be eligible for the travel award. The deadlines for the Student Mentoring Program application are at http://www.mcs.anl.gov/ieeecluster2015/author-information/important-dates/. Notice of travel awards will be made prior to the conference. The travel awards will be distributed post-conference in the form of reimbursements against actual travel, registration, and accommodation expenses submitted by the student. The travel award will be contingent on the participating of the awarded student in the Student Mentoring Program at Cluster 2015. *** CLUSTER 2015 POSTER CHAIR *** Seetharami Seelam, IBM T. J. Watson Research Center (sseelam AT us.ibm.com). ---------------------------------------------- ...Follow us on Facebook athttps://www.facebook.com/ieee.cluster ...Follow us on Twitter athttps://twitter.com/IEEECluster ...Follow us on Linkedin at https://www.linkedin.com/groups/IEEE-International-Conference-on-Cluster-7428925 ...Follow us on RenRen athttp://page.renren.com/601871401 ---------------------------------------------- -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Editor: IEEE TCC, Springer Cluster, Springer JoCCASA Chair: IEEE/ACM MTAGS, ACM ScienceCloud ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ LinkedIn: http://www.linkedin.com/in/ioanraicu Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ ================================================================= ================================================================= -------------- next part -------------- An HTML attachment was scrubbed... URL: From tim.g.armstrong at gmail.com Wed Apr 8 11:08:12 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Wed, 8 Apr 2015 11:08:12 -0500 Subject: [Swift-devel] Swift/T BNF grammar Message-ID: I just finished working on a draft BNF grammar for Swift/T. I thought I'd share with the list to get feedback and because there have been some requests for this in the past. I just extracted the pages from my thesis for now, but we can put it into a standalone document at some point. I'm not sure how far diverged Swift/K is from this. - Tim -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: swiftt-bnf.pdf Type: application/pdf Size: 167867 bytes Desc: not available URL: From tim.g.armstrong at gmail.com Wed Apr 8 11:48:25 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Wed, 8 Apr 2015 11:48:25 -0500 Subject: [Swift-devel] assertEqual In-Reply-To: <1428340463.17969.0.camel@echo> References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> Message-ID: Reviving this thread... Probably the options are to either add an overload: assertEqual(float v1, float v2, float tolerance, string msg) or something like assertAlmostEqual(float v1, float v2, float tolerance, string msg) assertApproxEqual(float v1, float v2, float tolerance, string msg) assertApprox(float v1, float v2, float tolerance, string msg) I don't think there's much of a reason to break compatibility in Swift/T with the (float, float, string) form, so I think we should keep that in. - Tim On 6 April 2015 at 12:14, Mihael Hategan wrote: > On Mon, 2015-04-06 at 09:38 -0500, Tim Armstrong wrote: > > Right, the tests for those things in the Swift test suite are like: > > > > assert(abs(sin(PI/2) - 1.0) < 1e-15, "sin"); > > > > Which is a little less convenient. > > > > I think if we want almost equal semantics we could have assertAlmostEqual > > with a tolerance parameter > > That's a choice. > > I personally think that approximate equality in numerics is such a > widespread issue, that there wouldn't be much confusion. > > Mihael > > > > > -Tim > > > > On 5 April 2015 at 21:17, Mihael Hategan wrote: > > > > > Hi, > > > > > > I found it useful to have a tolerance parameter for assertEqual(float, > > > float). > > > > > > Checks like assertEqual(tan(x), sin(x) / cos(x)) are otherwise not > going > > > to work very well. > > > > > > Mihael > > > > > > _______________________________________________ > > > Swift-devel mailing list > > > Swift-devel at ci.uchicago.edu > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From wilde at anl.gov Wed Apr 8 12:21:39 2015 From: wilde at anl.gov (Michael Wilde) Date: Wed, 8 Apr 2015 12:21:39 -0500 Subject: [Swift-devel] Swift/T BNF grammar In-Reply-To: References: Message-ID: <552563A3.9000804@anl.gov> Tim, thanks for posting - its great to see this. At some point, can we copy this to the Swift/T repo? It would be good to convert it to asciidoc, and also adapt to Swift/K. Of further interest would be to see a diff between two two dialects as seen through the BNF. - Mike On 4/8/15 11:08 AM, Tim Armstrong wrote: > I just finished working on a draft BNF grammar for Swift/T. I thought > I'd share with the list to get feedback and because there have been > some requests for this in the past. > > I just extracted the pages from my thesis for now, but we can put it > into a standalone document at some point. > > I'm not sure how far diverged Swift/K is from this. > > - Tim > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago -------------- next part -------------- An HTML attachment was scrubbed... URL: From wozniak at mcs.anl.gov Wed Apr 8 12:56:00 2015 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Wed, 8 Apr 2015 12:56:00 -0500 Subject: [Swift-devel] Swift/T BNF grammar In-Reply-To: References: Message-ID: <55256BB0.60007@mcs.anl.gov> Nice! On 04/08/2015 11:08 AM, Tim Armstrong wrote: > I just finished working on a draft BNF grammar for Swift/T. I thought > I'd share with the list to get feedback and because there have been > some requests for this in the past. > > I just extracted the pages from my thesis for now, but we can put it > into a standalone document at some point. > > I'm not sure how far diverged Swift/K is from this. > > - Tim > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Justin M Wozniak -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Wed Apr 8 13:08:18 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 8 Apr 2015 11:08:18 -0700 Subject: [Swift-devel] assertEqual In-Reply-To: References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> Message-ID: <1428516498.478.0.camel@echo> I went with an optional. It keeps backwards compatibility and makes it clear what that number is. Mihael On Wed, 2015-04-08 at 11:48 -0500, Tim Armstrong wrote: > Reviving this thread... Probably the options are to either add an overload: > > assertEqual(float v1, float v2, float tolerance, string msg) > > or something like > > assertAlmostEqual(float v1, float v2, float tolerance, string msg) > assertApproxEqual(float v1, float v2, float tolerance, string msg) > assertApprox(float v1, float v2, float tolerance, string msg) > > I don't think there's much of a reason to break compatibility in Swift/T > with the (float, float, string) form, so I think we should keep that in. > > - Tim > > On 6 April 2015 at 12:14, Mihael Hategan wrote: > > > On Mon, 2015-04-06 at 09:38 -0500, Tim Armstrong wrote: > > > Right, the tests for those things in the Swift test suite are like: > > > > > > assert(abs(sin(PI/2) - 1.0) < 1e-15, "sin"); > > > > > > Which is a little less convenient. > > > > > > I think if we want almost equal semantics we could have assertAlmostEqual > > > with a tolerance parameter > > > > That's a choice. > > > > I personally think that approximate equality in numerics is such a > > widespread issue, that there wouldn't be much confusion. > > > > Mihael > > > > > > > > -Tim > > > > > > On 5 April 2015 at 21:17, Mihael Hategan wrote: > > > > > > > Hi, > > > > > > > > I found it useful to have a tolerance parameter for assertEqual(float, > > > > float). > > > > > > > > Checks like assertEqual(tan(x), sin(x) / cos(x)) are otherwise not > > going > > > > to work very well. > > > > > > > > Mihael > > > > > > > > _______________________________________________ > > > > Swift-devel mailing list > > > > Swift-devel at ci.uchicago.edu > > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > > > > > > > > From tim.g.armstrong at gmail.com Wed Apr 8 13:57:25 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Wed, 8 Apr 2015 13:57:25 -0500 Subject: [Swift-devel] assertEqual In-Reply-To: <1428516498.478.0.camel@echo> References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> <1428516498.478.0.camel@echo> Message-ID: So assertEqual(float, float, string, float tolerance=0.0) ? On 8 April 2015 at 13:08, Mihael Hategan wrote: > I went with an optional. It keeps backwards compatibility and makes it > clear what that number is. > > Mihael > > On Wed, 2015-04-08 at 11:48 -0500, Tim Armstrong wrote: > > Reviving this thread... Probably the options are to either add an > overload: > > > > assertEqual(float v1, float v2, float tolerance, string msg) > > > > or something like > > > > assertAlmostEqual(float v1, float v2, float tolerance, string msg) > > assertApproxEqual(float v1, float v2, float tolerance, string msg) > > assertApprox(float v1, float v2, float tolerance, string msg) > > > > I don't think there's much of a reason to break compatibility in Swift/T > > with the (float, float, string) form, so I think we should keep that in. > > > > - Tim > > > > On 6 April 2015 at 12:14, Mihael Hategan wrote: > > > > > On Mon, 2015-04-06 at 09:38 -0500, Tim Armstrong wrote: > > > > Right, the tests for those things in the Swift test suite are like: > > > > > > > > assert(abs(sin(PI/2) - 1.0) < 1e-15, "sin"); > > > > > > > > Which is a little less convenient. > > > > > > > > I think if we want almost equal semantics we could have > assertAlmostEqual > > > > with a tolerance parameter > > > > > > That's a choice. > > > > > > I personally think that approximate equality in numerics is such a > > > widespread issue, that there wouldn't be much confusion. > > > > > > Mihael > > > > > > > > > > > -Tim > > > > > > > > On 5 April 2015 at 21:17, Mihael Hategan > wrote: > > > > > > > > > Hi, > > > > > > > > > > I found it useful to have a tolerance parameter for > assertEqual(float, > > > > > float). > > > > > > > > > > Checks like assertEqual(tan(x), sin(x) / cos(x)) are otherwise not > > > going > > > > > to work very well. > > > > > > > > > > Mihael > > > > > > > > > > _______________________________________________ > > > > > Swift-devel mailing list > > > > > Swift-devel at ci.uchicago.edu > > > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > > > > > > > > > > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From tim.g.armstrong at gmail.com Wed Apr 8 13:58:14 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Wed, 8 Apr 2015 13:58:14 -0500 Subject: [Swift-devel] assertEqual In-Reply-To: References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> <1428516498.478.0.camel@echo> Message-ID: That might not actually work in Swift/T since we don't support overloading in combination with optional args. - Tim On 8 April 2015 at 13:57, Tim Armstrong wrote: > So assertEqual(float, float, string, float tolerance=0.0) ? > > On 8 April 2015 at 13:08, Mihael Hategan wrote: > >> I went with an optional. It keeps backwards compatibility and makes it >> clear what that number is. >> >> Mihael >> >> On Wed, 2015-04-08 at 11:48 -0500, Tim Armstrong wrote: >> > Reviving this thread... Probably the options are to either add an >> overload: >> > >> > assertEqual(float v1, float v2, float tolerance, string msg) >> > >> > or something like >> > >> > assertAlmostEqual(float v1, float v2, float tolerance, string msg) >> > assertApproxEqual(float v1, float v2, float tolerance, string msg) >> > assertApprox(float v1, float v2, float tolerance, string msg) >> > >> > I don't think there's much of a reason to break compatibility in Swift/T >> > with the (float, float, string) form, so I think we should keep that in. >> > >> > - Tim >> > >> > On 6 April 2015 at 12:14, Mihael Hategan wrote: >> > >> > > On Mon, 2015-04-06 at 09:38 -0500, Tim Armstrong wrote: >> > > > Right, the tests for those things in the Swift test suite are like: >> > > > >> > > > assert(abs(sin(PI/2) - 1.0) < 1e-15, "sin"); >> > > > >> > > > Which is a little less convenient. >> > > > >> > > > I think if we want almost equal semantics we could have >> assertAlmostEqual >> > > > with a tolerance parameter >> > > >> > > That's a choice. >> > > >> > > I personally think that approximate equality in numerics is such a >> > > widespread issue, that there wouldn't be much confusion. >> > > >> > > Mihael >> > > >> > > > >> > > > -Tim >> > > > >> > > > On 5 April 2015 at 21:17, Mihael Hategan >> wrote: >> > > > >> > > > > Hi, >> > > > > >> > > > > I found it useful to have a tolerance parameter for >> assertEqual(float, >> > > > > float). >> > > > > >> > > > > Checks like assertEqual(tan(x), sin(x) / cos(x)) are otherwise not >> > > going >> > > > > to work very well. >> > > > > >> > > > > Mihael >> > > > > >> > > > > _______________________________________________ >> > > > > Swift-devel mailing list >> > > > > Swift-devel at ci.uchicago.edu >> > > > > >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >> > > > > >> > > >> > > >> > > >> >> >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Wed Apr 8 18:18:46 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 8 Apr 2015 16:18:46 -0700 Subject: [Swift-devel] assertEqual In-Reply-To: References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> <1428516498.478.0.camel@echo> Message-ID: <1428535126.3353.0.camel@echo> On Wed, 2015-04-08 at 13:57 -0500, Tim Armstrong wrote: > So assertEqual(float, float, string, float tolerance=0.0) ? Yes. From hategan at mcs.anl.gov Wed Apr 8 18:19:18 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 8 Apr 2015 16:19:18 -0700 Subject: [Swift-devel] assertEqual In-Reply-To: References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> <1428516498.478.0.camel@echo> Message-ID: <1428535158.3353.1.camel@echo> On Wed, 2015-04-08 at 13:58 -0500, Tim Armstrong wrote: > That might not actually work in Swift/T since we don't support overloading > in combination with optional args. :( From hategan at mcs.anl.gov Thu Apr 9 14:25:40 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Thu, 9 Apr 2015 12:25:40 -0700 Subject: [Swift-devel] assertEqual In-Reply-To: References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> Message-ID: <1428607540.12506.1.camel@echo> On Wed, 2015-04-08 at 11:48 -0500, Tim Armstrong wrote: > Reviving this thread... Probably the options are to either add an overload: > > assertEqual(float v1, float v2, float tolerance, string msg) > > or something like > > assertAlmostEqual(float v1, float v2, float tolerance, string msg) OK, let's go with assertAlmostEqual. Although I would like to lobby for overloading support with keywords, but that can wait. Mihael From hategan at mcs.anl.gov Fri Apr 10 13:02:26 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 10 Apr 2015 11:02:26 -0700 Subject: [Swift-devel] assertEqual In-Reply-To: <1428607540.12506.1.camel@echo> References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> <1428607540.12506.1.camel@echo> Message-ID: <1428688946.28239.1.camel@echo> wait, wouldn't assertEqual(float, float, float, msg = ) be a doable overload in /T to assertEqual(float, float, msg =)? Or do we want it to be assertAlmostEqual because we think that's a better name for it? Mihael On Thu, 2015-04-09 at 12:25 -0700, Mihael Hategan wrote: > On Wed, 2015-04-08 at 11:48 -0500, Tim Armstrong wrote: > > Reviving this thread... Probably the options are to either add an overload: > > > > assertEqual(float v1, float v2, float tolerance, string msg) > > > > or something like > > > > assertAlmostEqual(float v1, float v2, float tolerance, string msg) > > OK, let's go with assertAlmostEqual. > > Although I would like to lobby for overloading support with keywords, > but that can wait. > > Mihael > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel From tim.g.armstrong at gmail.com Fri Apr 10 14:08:12 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Fri, 10 Apr 2015 14:08:12 -0500 Subject: [Swift-devel] assertEqual In-Reply-To: <1428688946.28239.1.camel@echo> References: <1428286643.8235.2.camel@echo> <1428340463.17969.0.camel@echo> <1428607540.12506.1.camel@echo> <1428688946.28239.1.camel@echo> Message-ID: Yep that would be a doable overload. I don't have a strong opinion on the name. - Tim On 10 April 2015 at 13:02, Mihael Hategan wrote: > wait, wouldn't assertEqual(float, float, float, msg = ) be a doable > overload in /T to assertEqual(float, float, msg =)? > > Or do we want it to be assertAlmostEqual because we think that's a > better name for it? > > Mihael > > On Thu, 2015-04-09 at 12:25 -0700, Mihael Hategan wrote: > > On Wed, 2015-04-08 at 11:48 -0500, Tim Armstrong wrote: > > > Reviving this thread... Probably the options are to either add an > overload: > > > > > > assertEqual(float v1, float v2, float tolerance, string msg) > > > > > > or something like > > > > > > assertAlmostEqual(float v1, float v2, float tolerance, string msg) > > > > OK, let's go with assertAlmostEqual. > > > > Although I would like to lobby for overloading support with keywords, > > but that can wait. > > > > Mihael > > > > > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Fri Apr 10 22:15:20 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 10 Apr 2015 20:15:20 -0700 Subject: [Swift-devel] format function Message-ID: <1428722120.16502.1.camel@echo> Hi, How exactly do we want the format function to work? I know Mike has expressed some dissatisfaction with trace(), so maybe this is a good time to talk about standardizing the formatting functions. Mihael From tim.g.armstrong at gmail.com Mon Apr 13 13:52:15 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Mon, 13 Apr 2015 13:52:15 -0500 Subject: [Swift-devel] format function In-Reply-To: <1428722120.16502.1.camel@echo> References: <1428722120.16502.1.camel@echo> Message-ID: I think the most pragmatic choice might just be to defer to the underlying Java/Tcl formatting functions. The commonly used formats I think are the same, although there are probably lots of minor differences. Getting the behavior to match exactly between T and K would require writing our own implementations from scratch as far as I can see. https://www.tcl.tk/man/tcl8.6/TclCmd/format.htm http://docs.oracle.com/javase/7/docs/api/java/util/Formatter.html#syntax In T we have a few places it's used: printf(),sprintf(), and the % format operator. All just use the Tcl format function. - Tim On 10 April 2015 at 22:15, Mihael Hategan wrote: > Hi, > > How exactly do we want the format function to work? I know Mike has > expressed some dissatisfaction with trace(), so maybe this is a good > time to talk about standardizing the formatting functions. > > Mihael > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Wed Apr 15 14:07:26 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 15 Apr 2015 12:07:26 -0700 Subject: [Swift-devel] the any type Message-ID: <1429124846.23832.5.camel@echo> Hi, There is an "any" type in /K. I think it was initially meant to be used for library functions that can take any argument, like trace(). However, I discovered that it is also exposed to the script in that one can do things like: any[string] a = {"a": "str", b: 1}; I don't have a problem with that in general. There are places where such heterogeneous arrays are useful. But I am not sure about the name "any". Ideas? Mihael From iraicu at cs.iit.edu Wed Apr 15 18:48:32 2015 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Wed, 15 Apr 2015 18:48:32 -0500 Subject: [Swift-devel] CFP: 2nd IEEE/ACM International Symposium on Big Data Computing (BDC) 2015 -- co-located with IEEE/ACM UCC 2015 Message-ID: <552EF8D0.4020508@cs.iit.edu> CALL FOR PAPERS --------------------------------------------------------------------------------------- 2nd IEEE/ACM International Symposium on Big Data Computing (BDC) 2015 http://datasys.cs.iit.edu/events/BDC2015/ --------------------------------------------------------------------------------------- December 7-10, 2015 St. Raphael Resort, Limassol, Cyprus Co-located with 8th IEEE/ACM International Conference on Utility and Cloud Computing ======================================================================================= Rapid advances in digital sensors, networks, storage, and computation along with their availability at low cost is leading to the creation of huge collections of data -- dubbed as Big Data. This data has the potential for enabling new insights that can change the way business, science, and governments deliver services to their consumers and can impact society as a whole. This has led to the emergence of the Big Data Computing paradigm focusing on sensing, collection, storage, management and analysis of data from variety of sources to enable new value and insights. To realize the full potential of Big Data Computing, we need to address several challenges and develop suitable conceptual and technological solutions for dealing them. These include life-cycle management of data, large-scale storage, flexible processing infrastructure, data modeling, scalable machine learning and data analysis algorithms, techniques for sampling and making trade-off between data processing time and accuracy, and dealing with privacy and ethical issues involved in data sensing, storage, processing, and actions. The International Symposium on Big Data Computing (BDC) 2015 -- held in conjunction with 8th IEEE/ACM International Conference on Utility and Cloud Computing (UCC) 2015, December 7-10, 2015, St. Raphael Resort, Limassol, Cyprus, aims at bringing together international researchers, developers, policy makers, and users and to provide an international forum to present leading research activities, technical solutions, and results on a broad range of topics related to Big Data Computing paradigms, platforms and their applications. The conference features keynotes, technical presentations, posters, and workshops. TOPICS: --------------------------------------------------------------------------------------- I. Big Data Science * Analytics * Algorithms for Big Data * Energy-efficient Algorithms * Big Data Search * Big Data Acquisition, Integration, Cleaning, and Best Practices * Visualization of Big Data II. Big Data Infrastructures and Platforms * Programming Systems * Cyber-Infrastructure * Performance evaluation * Fault tolerance and reliability * I/O and Data management * Storage Systems (including file systems, NoSQL, and RDBMS) * Resource management * Many-Task Computing * Many-core computing and accelerators III. Big Data Security and Policy * Management Policies * Data Privacy * Data Security * Big Data Archival and Preservation * Big Data Provenance IV. Big Data Applications * Scientific application cases studies on Cloud infrastructure * Big Data Applications at Scale * Experience Papers with Big Data Application Deployments * Data streaming applications * Big Data in Social Networks * Healthcare Applications * Enterprise Applications IMPORTANT DATES --------------------------------------------------------------------------------------- Papers: * Papers Due: 03 July, 2015 * Author Notifications: 21 August, 2015 * Final Papers Due: 21 September, 2015 Posters * Proceedings-published posters due: 28 August, 2015 * Notification of acceptance: 18 September, 2015 * Camera-ready posters due: 21 September, 2015 PAPER SUBMISSION --------------------------------------------------------------------------------------- Authors are invited to submit papers electronically. Submitted manuscripts should be structured as technical papers and may not exceed 10 letter size (8.5 x 11) pages including figures, tables and references using the following templates (latex, pdf, doc). Authors should submit the manuscript in PDF format and make sure that the file will print on a printer that uses letter size (8.5 x 11) paper. The official language of the meeting is English. All manuscripts will be reviewed and will be judged on correctness, originality, technical strength, significance, quality of presentation, and interest and relevance to the conference attendees. Papers conforming to the above guidelines can be submitted through the BDC 2015 paper submission system (https://www.easychair.org/conferences/?conf=bdc2015). Submitted papers must represent original unpublished research that is not currently under review for any other conference or journal. Papers not following these guidelines will be rejected without review and further action may be taken, including (but not limited to) notifications sent to the heads of the institutions of the authors and sponsors of the conference. Submissions received after the due date, exceeding length limit, or not appropriately structured may also not be considered. Authors may contact the conference PC Chair for more information. Selected papers from BDC 2015 will be invited to extend and submit to the Special Issue on Big Data Computing in the IEEE Transaction on Cloud Computing. ORGANIZATION --------------------------------------------------------------------------------------- General Chairs * Rajkumar Buyya, University of Melbourne, Australia * George Angelos Papadopoulos,University of Cyprus, Cyprus Program Committee Chairs (bdc15-chairs at datasys.cs.iit.edu) * Ioan Raicu, Illinois Institute of Technology & Argonne National Laboratory, USA * Amy Apon, National Science Foundation, USA * Manish Parashar, Rutgers University, USA Program Committee Vice Chairs * Omer Rana, Cardiff University, UK * Ilkay Altintas, University of California, San Diego, USA Program Committee Members * Alexander Rasin, DePaul University, USA * Alok Choudhary, Northwestern University, USA * Abhishek Chandra, University of Minnesota, USA * Andre Luckow, BMW IT Research Center, USA * Daniel Katz, University of Chicago and Argonne National Lab, USA * Dongfang Zhao, Illinois Institute of Technology, USA * Douglas Thain, University of Notre Dame, USA * Florian Schintke, Zuse Institute Berlin, Germany * Giuliano Casale, Imperial College London, UK * Jaliya Ekanayake, Microsoft, USA * Jessica Chen-Burger, Heriot-Watt University, UK * Judy Qiu, Indiana University, USA * Justin Wozniak, Argonne National Lab, USA * Ke Wang, Illinois Institute of Technology, USA * Kesheng (John) Wu, Lawrence Berkeley National Lab, USA * Kyle Chard, University of Chicago and Argonne National Lab, USA * Lavanya Ramakrishnan, Lawrence Berkeley National Laboratory, USA * Marco Netto, IBM Research, Brazil * Matei Ripeanu, University of British Columbia, Canada * Matei Stroila, HERE, USA * Nagiza Samatova, North Carolina State University, USA * Paolo Missier, Newcastle University, UK * Paul Watson, NewCastle University, UK * Peter Burnap, Cardiff University, UK * Rahul Potharaju, Microsoft, USA * Rajkumar Kettimuthu, Argonne National Lab and University of Chicago, USA * Robert Ross, Argonne National Lab, USA * Samer Al-Kiswany, University of British Columbia, Canada * Scott Klasky, Oak Ridge National Lab, USA * Wei Tang, Argonne National Lab, USA * Weidong Shi, University of Houston, USA * Xiaolin (Andy) Li, University of Florida, USA * Yanlong Yin, Bloomberg, USA * Yong Chen, Texas Tech University, USA * Yong Zhao, University of Electronic Science and Technology, China * Zhao Zhang, University of California, Berkeley, USA Cyber Co-Chairs * Dongfang Zhao, Illinois Institute of Technology, USA Local Organizing Committee * George Angelos Papadopoulos, University of Cyprus, Cyprus SPONSORSHIP --------------------------------------------------------------------------------------- IEEE*, ACM*, and IIT* *Final approval on sponsorship is pending. -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Editor: IEEE TCC, Springer Cluster, Springer JoCCASA Chair: IEEE/ACM MTAGS, ACM ScienceCloud ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ LinkedIn: http://www.linkedin.com/in/ioanraicu Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ ================================================================= ================================================================= From hategan at mcs.anl.gov Fri Apr 17 19:25:08 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 17 Apr 2015 17:25:08 -0700 Subject: [Swift-devel] commits Message-ID: <1429316708.28898.5.camel@echo> Hi, I committed the following: 1. standard library stuff. There are some tests for it too. You can use it by saying import "stdlib.v2"; (the exact form of the string "stdlib.v2" is open to discussion). 2. Function/procedure overloading. 3. Structure/sparse array initializers. You can now say mystruct v = {a: 1, b: 3.4}, etc. For sparse arrays, you can say int[] a = {0: 1, 100: 2, 1000: 3} or int[string] b = {"a": 1, "b": 2, ...}. 4. The documentation formatting updates. Since I last mentioned this, I made a small change that makes the header look more like the swift site header (except smaller in size). Mihael From hategan at mcs.anl.gov Fri Apr 17 22:18:43 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 17 Apr 2015 20:18:43 -0700 Subject: [Swift-devel] intermediate XML Message-ID: <1429327123.28898.17.camel@echo> Hi, I think we should remove the intermediate XML (aka. swiftx). It was initially meant to be an abstract representation (like Java bytecode) so that multiple backends could be implemented easily. However, the reality is that the XML is a direct representation of the swift/K parse tree. The other reality is that the only potential place that could have used this as intended (swift/T) didn't. Here's what happens in the code: 1. swift parser parses the .swift code and generates a representation of the parse tree as StringTemplate objects. 2. the StringTemplate tree gets serialized to XML using swiftscript.stg (a template collection). This gets saved to disk. 3. XML beans are generated from the schema and the generated XML is loaded into a tree of XML Beans. 4. The Karajan class traverses the XML Beans tree and generates karajan code (using StringTemplate objects). I think that everything between steps 1 and 4 is just Rube Goldberg code. It translates the same data structure between StringTemplate to XML to XML Beans. It could all (easily I might add) be replaced with nice Java classes representing the parse tree. Opinions? Mihael From tim.g.armstrong at gmail.com Fri Apr 17 23:25:55 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Fri, 17 Apr 2015 23:25:55 -0500 Subject: [Swift-devel] commits In-Reply-To: <1429316708.28898.5.camel@echo> References: <1429316708.28898.5.camel@echo> Message-ID: Cool :) On 17 April 2015 at 19:25, Mihael Hategan wrote: > Hi, > > I committed the following: > > 1. standard library stuff. There are some tests for it too. You can use > it by saying > > import "stdlib.v2"; > > (the exact form of the string "stdlib.v2" is open to discussion). > > > 2. Function/procedure overloading. > > 3. Structure/sparse array initializers. You can now say mystruct v = {a: > 1, b: 3.4}, etc. For sparse arrays, you can say int[] a = {0: 1, 100: 2, > 1000: 3} or int[string] b = {"a": 1, "b": 2, ...}. > > 4. The documentation formatting updates. Since I last mentioned this, I > made a small change that makes the header look more like the swift site > header (except smaller in size). > > Mihael > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From tim.g.armstrong at gmail.com Fri Apr 17 23:31:00 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Fri, 17 Apr 2015 23:31:00 -0500 Subject: [Swift-devel] intermediate XML In-Reply-To: <1429327123.28898.17.camel@echo> References: <1429327123.28898.17.camel@echo> Message-ID: Makes sense to me if it simplifies the code - I'm not sure how much ongoing maintenance overhead it is to keep up the additional transformations. - Tim On 17 April 2015 at 22:18, Mihael Hategan wrote: > Hi, > > I think we should remove the intermediate XML (aka. swiftx). > > It was initially meant to be an abstract representation (like Java > bytecode) so that multiple backends could be implemented easily. > However, the reality is that the XML is a direct representation of the > swift/K parse tree. The other reality is that the only potential place > that could have used this as intended (swift/T) didn't. > > Here's what happens in the code: > > 1. swift parser parses the .swift code and generates a representation of > the parse tree as StringTemplate objects. > > 2. the StringTemplate tree gets serialized to XML using swiftscript.stg > (a template collection). This gets saved to disk. > > 3. XML beans are generated from the schema and the generated XML is > loaded into a tree of XML Beans. > > 4. The Karajan class traverses the XML Beans tree and generates karajan > code (using StringTemplate objects). > > I think that everything between steps 1 and 4 is just Rube Goldberg > code. It translates the same data structure between StringTemplate to > XML to XML Beans. It could all (easily I might add) be replaced with > nice Java classes representing the parse tree. > > Opinions? > > Mihael > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From wilde at mcs.anl.gov Sat Apr 18 00:38:40 2015 From: wilde at mcs.anl.gov (Michael Wilde) Date: Sat, 18 Apr 2015 00:38:40 -0500 Subject: [Swift-devel] intermediate XML In-Reply-To: <1cfc6453c17542f59fe5ec02f888b12e@NAGURSKI.anl.gov> References: <1429327123.28898.17.camel@echo> <1cfc6453c17542f59fe5ec02f888b12e@NAGURSKI.anl.gov> Message-ID: Mihael, Weren't you at one time looking into using the Swift/T parser for Swift/K? Or the Swift/T ANTLR grammar? I thought this was at least mentioned in a Swift team meeting. - Mike On Fri, Apr 17, 2015 at 11:31 PM, Tim Armstrong wrote: > Makes sense to me if it simplifies the code - I'm not sure how much > ongoing maintenance overhead it is to keep up the additional > transformations. > > - Tim > > On 17 April 2015 at 22:18, Mihael Hategan wrote: > >> Hi, >> >> I think we should remove the intermediate XML (aka. swiftx). >> >> It was initially meant to be an abstract representation (like Java >> bytecode) so that multiple backends could be implemented easily. >> However, the reality is that the XML is a direct representation of the >> swift/K parse tree. The other reality is that the only potential place >> that could have used this as intended (swift/T) didn't. >> >> Here's what happens in the code: >> >> 1. swift parser parses the .swift code and generates a representation of >> the parse tree as StringTemplate objects. >> >> 2. the StringTemplate tree gets serialized to XML using swiftscript.stg >> (a template collection). This gets saved to disk. >> >> 3. XML beans are generated from the schema and the generated XML is >> loaded into a tree of XML Beans. >> >> 4. The Karajan class traverses the XML Beans tree and generates karajan >> code (using StringTemplate objects). >> >> I think that everything between steps 1 and 4 is just Rube Goldberg >> code. It translates the same data structure between StringTemplate to >> XML to XML Beans. It could all (easily I might add) be replaced with >> nice Java classes representing the parse tree. >> >> Opinions? >> >> Mihael >> >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >> > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Sat Apr 18 00:42:02 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 17 Apr 2015 22:42:02 -0700 Subject: [Swift-devel] intermediate XML In-Reply-To: References: <1429327123.28898.17.camel@echo> <1cfc6453c17542f59fe5ec02f888b12e@NAGURSKI.anl.gov> Message-ID: <1429335722.2912.2.camel@echo> Hi, Yes. I made some progress in that direction, but other things eventually got in the way and I stopped working on it. In the mean time, we do have to work with the existing parser. Mihael On Sat, 2015-04-18 at 00:38 -0500, Michael Wilde wrote: > Mihael, > > Weren't you at one time looking into using the Swift/T parser for Swift/K? > > Or the Swift/T ANTLR grammar? > > I thought this was at least mentioned in a Swift team meeting. > > - Mike > > > On Fri, Apr 17, 2015 at 11:31 PM, Tim Armstrong > wrote: > > > Makes sense to me if it simplifies the code - I'm not sure how much > > ongoing maintenance overhead it is to keep up the additional > > transformations. > > > > - Tim > > > > On 17 April 2015 at 22:18, Mihael Hategan wrote: > > > >> Hi, > >> > >> I think we should remove the intermediate XML (aka. swiftx). > >> > >> It was initially meant to be an abstract representation (like Java > >> bytecode) so that multiple backends could be implemented easily. > >> However, the reality is that the XML is a direct representation of the > >> swift/K parse tree. The other reality is that the only potential place > >> that could have used this as intended (swift/T) didn't. > >> > >> Here's what happens in the code: > >> > >> 1. swift parser parses the .swift code and generates a representation of > >> the parse tree as StringTemplate objects. > >> > >> 2. the StringTemplate tree gets serialized to XML using swiftscript.stg > >> (a template collection). This gets saved to disk. > >> > >> 3. XML beans are generated from the schema and the generated XML is > >> loaded into a tree of XML Beans. > >> > >> 4. The Karajan class traverses the XML Beans tree and generates karajan > >> code (using StringTemplate objects). > >> > >> I think that everything between steps 1 and 4 is just Rube Goldberg > >> code. It translates the same data structure between StringTemplate to > >> XML to XML Beans. It could all (easily I might add) be replaced with > >> nice Java classes representing the parse tree. > >> > >> Opinions? > >> > >> Mihael > >> > >> _______________________________________________ > >> Swift-devel mailing list > >> Swift-devel at ci.uchicago.edu > >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > >> > > > > From tim.g.armstrong at gmail.com Sun Apr 19 21:55:14 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Sun, 19 Apr 2015 21:55:14 -0500 Subject: [Swift-devel] intermediate XML In-Reply-To: <1429335722.2912.2.camel@echo> References: <1429327123.28898.17.camel@echo> <1cfc6453c17542f59fe5ec02f888b12e@NAGURSKI.anl.gov> <1429335722.2912.2.camel@echo> Message-ID: Yeah the Swift/T work was integrating at a slight different point The Swift/T compiler's pipeline is essentially Antlr Parser -> [AST] -> Frontend (Typechecking, semantic analysis, etc) -> [IR-1] -> Middleend (optimisation, etc) -> [IR-2] -> Code Generation -> [Tcl] The Swift/K compiler's pipeline is: Antlr Parser -> [AST] -> serialisation -> [XML] -> Swift/K frontend -> Code Generation -> [Karajan] Mihael is talking about cutting out the first few steps from Swift/K that don't achieve much. The other, larger, project is to add a backend to Swift/T that generates karajan, i.e. graft it on alongside the Tcl code generation step much later in the process. - Tim On 18 April 2015 at 00:42, Mihael Hategan wrote: > Hi, > > Yes. I made some progress in that direction, but other things eventually > got in the way and I stopped working on it. > > In the mean time, we do have to work with the existing parser. > > Mihael > > On Sat, 2015-04-18 at 00:38 -0500, Michael Wilde wrote: > > Mihael, > > > > Weren't you at one time looking into using the Swift/T parser for > Swift/K? > > > > Or the Swift/T ANTLR grammar? > > > > I thought this was at least mentioned in a Swift team meeting. > > > > - Mike > > > > > > On Fri, Apr 17, 2015 at 11:31 PM, Tim Armstrong < > tim.g.armstrong at gmail.com> > > wrote: > > > > > Makes sense to me if it simplifies the code - I'm not sure how much > > > ongoing maintenance overhead it is to keep up the additional > > > transformations. > > > > > > - Tim > > > > > > On 17 April 2015 at 22:18, Mihael Hategan wrote: > > > > > >> Hi, > > >> > > >> I think we should remove the intermediate XML (aka. swiftx). > > >> > > >> It was initially meant to be an abstract representation (like Java > > >> bytecode) so that multiple backends could be implemented easily. > > >> However, the reality is that the XML is a direct representation of the > > >> swift/K parse tree. The other reality is that the only potential place > > >> that could have used this as intended (swift/T) didn't. > > >> > > >> Here's what happens in the code: > > >> > > >> 1. swift parser parses the .swift code and generates a representation > of > > >> the parse tree as StringTemplate objects. > > >> > > >> 2. the StringTemplate tree gets serialized to XML using > swiftscript.stg > > >> (a template collection). This gets saved to disk. > > >> > > >> 3. XML beans are generated from the schema and the generated XML is > > >> loaded into a tree of XML Beans. > > >> > > >> 4. The Karajan class traverses the XML Beans tree and generates > karajan > > >> code (using StringTemplate objects). > > >> > > >> I think that everything between steps 1 and 4 is just Rube Goldberg > > >> code. It translates the same data structure between StringTemplate to > > >> XML to XML Beans. It could all (easily I might add) be replaced with > > >> nice Java classes representing the parse tree. > > >> > > >> Opinions? > > >> > > >> Mihael > > >> > > >> _______________________________________________ > > >> Swift-devel mailing list > > >> Swift-devel at ci.uchicago.edu > > >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > >> > > > > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From foster at anl.gov Mon Apr 20 04:30:22 2015 From: foster at anl.gov (Foster, Ian T.) Date: Mon, 20 Apr 2015 09:30:22 +0000 Subject: [Swift-devel] Fwd: The FizzBuzz from Outer Space Explained References: Message-ID: <2C2AB3B5-F041-4687-8525-762D31328DC0@anl.gov> Should Swift support V-- ? > > http://www.stilldrinking.org/the-fizzbuzz-from-outer-space-explained From tim.g.armstrong at gmail.com Mon Apr 20 10:33:37 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Mon, 20 Apr 2015 10:33:37 -0500 Subject: [Swift-devel] Paper: Making Sense of Performance in Data Analytics Frameworks Message-ID: I thought I would share this summary of a paper in NSDI that's worth reading: http://blog.acolyer.org/2015/04/20/making-sense-of-performance-in-data-analytics-frameworks/ The overall message is that in systems like Hadoop or Spark (as used nowadays for analytics or data warehousing), the performance bottleneck is mainly CPU time rather than disk or network I/O. This is a result of widespread application of compression techniques in file formats used - they reduce I/O requirements but increase CPU requirements. SSDs also give you a lot more I/O bandwidth at the cost of capacity (so you need to compress more). Even basic stuff like gzipping parts of files is somewhat effective, but then there are open source projects like Parquet and closed source projects like Google's ColumnIO that are even more effective. This matches my experience at Facebook - CPU was the bottleneck on their Hive workloads and disk space (rather than I/O operations) was becoming the bottleneck for their MySQL workloads. I think some people in industry have been aware of this trend for a while now, but I think academia has mainly been thinking mainly about optimising I/O or network usage. Worth thinking about, maybe not so much for Swift right now since the architecture and workloads are different, but for future research plans. - Tim -------------- next part -------------- An HTML attachment was scrubbed... URL: From ketan at mcs.anl.gov Tue Apr 21 11:59:06 2015 From: ketan at mcs.anl.gov (Ketan Maheshwari) Date: Tue, 21 Apr 2015 11:59:06 -0500 Subject: [Swift-devel] C++ parallel algorithms Message-ID: Attached is a slide from Finkel's talk on C++: a list of proposed parallel algorithms to be part of the standard. May be useful/relevant to Swift. --Ketan -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: IMG_20150421_114251.jpg Type: image/jpeg Size: 1012507 bytes Desc: not available URL: From wozniak at mcs.anl.gov Tue Apr 21 15:58:45 2015 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Tue, 21 Apr 2015 15:58:45 -0500 Subject: [Swift-devel] Fwd: The FizzBuzz from Outer Space Explained In-Reply-To: <2C2AB3B5-F041-4687-8525-762D31328DC0@anl.gov> References: <2C2AB3B5-F041-4687-8525-762D31328DC0@anl.gov> Message-ID: <5536BA05.3050601@mcs.anl.gov> If it will run on any of our coffee machines, no problem! On 04/20/2015 04:30 AM, Foster, Ian T. wrote: > Should Swift support V-- ? > >> http://www.stilldrinking.org/the-fizzbuzz-from-outer-space-explained > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Justin M Wozniak From hategan at mcs.anl.gov Tue Apr 21 16:10:56 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 21 Apr 2015 14:10:56 -0700 Subject: [Swift-devel] Fwd: The FizzBuzz from Outer Space Explained In-Reply-To: <5536BA05.3050601@mcs.anl.gov> References: <2C2AB3B5-F041-4687-8525-762D31328DC0@anl.gov> <5536BA05.3050601@mcs.anl.gov> Message-ID: <1429650656.10504.0.camel@echo> ... provided that you insert the logarithm of 50 cents in the coin receptacle On Tue, 2015-04-21 at 15:58 -0500, Justin M Wozniak wrote: > If it will run on any of our coffee machines, no problem! > > On 04/20/2015 04:30 AM, Foster, Ian T. wrote: > > Should Swift support V-- ? > > > >> http://www.stilldrinking.org/the-fizzbuzz-from-outer-space-explained > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > From foster at anl.gov Tue Apr 21 16:24:28 2015 From: foster at anl.gov (Foster, Ian T.) Date: Tue, 21 Apr 2015 21:24:28 +0000 Subject: [Swift-devel] The FizzBuzz from Outer Space Explained In-Reply-To: <1429650656.10504.0.camel@echo> References: <2C2AB3B5-F041-4687-8525-762D31328DC0@anl.gov> <5536BA05.3050601@mcs.anl.gov> <1429650656.10504.0.camel@echo> Message-ID: I must admit that being able to include star charts so concisely is nice > On Apr 21, 2015, at 4:10 PM, Mihael Hategan wrote: > > ... provided that you insert the logarithm of 50 cents in the coin > receptacle > > On Tue, 2015-04-21 at 15:58 -0500, Justin M Wozniak wrote: >> If it will run on any of our coffee machines, no problem! >> >> On 04/20/2015 04:30 AM, Foster, Ian T. wrote: >>> Should Swift support V-- ? >>> >>>> http://www.stilldrinking.org/the-fizzbuzz-from-outer-space-explained >>> _______________________________________________ >>> Swift-devel mailing list >>> Swift-devel at ci.uchicago.edu >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >> >> > > From hategan at mcs.anl.gov Tue Apr 21 17:13:27 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 21 Apr 2015 15:13:27 -0700 Subject: [Swift-devel] The FizzBuzz from Outer Space Explained In-Reply-To: References: <2C2AB3B5-F041-4687-8525-762D31328DC0@anl.gov> <5536BA05.3050601@mcs.anl.gov> <1429650656.10504.0.camel@echo> Message-ID: <1429654407.19322.1.camel@echo> I don't know what you are suggesting, but we've had the ability to include star charts in Complex Star Vector format for a while now through readData(). On Tue, 2015-04-21 at 16:24 -0500, Foster, Ian T. wrote: > I must admit that being able to include star charts so concisely is nice > > > On Apr 21, 2015, at 4:10 PM, Mihael Hategan wrote: > > > > ... provided that you insert the logarithm of 50 cents in the coin > > receptacle > > > > On Tue, 2015-04-21 at 15:58 -0500, Justin M Wozniak wrote: > >> If it will run on any of our coffee machines, no problem! > >> > >> On 04/20/2015 04:30 AM, Foster, Ian T. wrote: > >>> Should Swift support V-- ? > >>> > >>>> http://www.stilldrinking.org/the-fizzbuzz-from-outer-space-explained > >>> _______________________________________________ > >>> Swift-devel mailing list > >>> Swift-devel at ci.uchicago.edu > >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > >> > >> > > > > > From foster at anl.gov Wed Apr 22 12:18:49 2015 From: foster at anl.gov (Foster, Ian T.) Date: Wed, 22 Apr 2015 17:18:49 +0000 Subject: [Swift-devel] Prabhat from NERSC Message-ID: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> Dear all: Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. Ian From dsk at uchicago.edu Wed Apr 22 12:29:07 2015 From: dsk at uchicago.edu (Daniel S. Katz) Date: Wed, 22 Apr 2015 13:29:07 -0400 Subject: [Swift-devel] Prabhat from NERSC In-Reply-To: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> References: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> Message-ID: <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> Yes. We've started talking with them (Yesterday) about getting Swift installed at NERSC and making it officially supported. There is also some possibility that NERSC might eventually contribute effort to Swift as well. I also talked to LANL folks yesterday about Swift and they are also potentially interested in installing it, but they are a step behind NERSC, having done an initial comparison of tools, with Swift showing up near the top. Both of these discussions were at the workflow workshop. Dan > On Apr 22, 2015, at 13:18, Foster, Ian T. wrote: > > Dear all: > > Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. > > Ian > > > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel From wozniak at mcs.anl.gov Wed Apr 22 12:51:29 2015 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Wed, 22 Apr 2015 12:51:29 -0500 Subject: [Swift-devel] Prabhat from NERSC In-Reply-To: <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> References: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> Message-ID: <5537DFA1.4050109@mcs.anl.gov> Great- we are hosting two ExMatEx people from LANL in early May. Tim Germann has run Swift. On 04/22/2015 12:29 PM, Daniel S. Katz wrote: > Yes. We've started talking with them (Yesterday) about getting Swift installed at NERSC and making it officially supported. There is also some possibility that NERSC might eventually contribute effort to Swift as well. > > I also talked to LANL folks yesterday about Swift and they are also potentially interested in installing it, but they are a step behind NERSC, having done an initial comparison of tools, with Swift showing up near the top. > > Both of these discussions were at the workflow workshop. > > Dan > >> On Apr 22, 2015, at 13:18, Foster, Ian T. wrote: >> >> Dear all: >> >> Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. >> >> Ian >> >> >> >> >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Justin M Wozniak From dsk at uchicago.edu Wed Apr 22 12:54:32 2015 From: dsk at uchicago.edu (Daniel S. Katz) Date: Wed, 22 Apr 2015 13:54:32 -0400 Subject: [Swift-devel] Prabhat from NERSC In-Reply-To: <5537DFA1.4050109@mcs.anl.gov> References: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> <5537DFA1.4050109@mcs.anl.gov> Message-ID: <43CF752F-05C1-4997-B47D-F7D95DE6C305@uchicago.edu> I did suggest that the LANL folks talk to Tim about his experiences. Dan > On Apr 22, 2015, at 13:51, Justin M Wozniak wrote: > > > Great- we are hosting two ExMatEx people from LANL in early May. Tim Germann has run Swift. > >> On 04/22/2015 12:29 PM, Daniel S. Katz wrote: >> Yes. We've started talking with them (Yesterday) about getting Swift installed at NERSC and making it officially supported. There is also some possibility that NERSC might eventually contribute effort to Swift as well. >> >> I also talked to LANL folks yesterday about Swift and they are also potentially interested in installing it, but they are a step behind NERSC, having done an initial comparison of tools, with Swift showing up near the top. >> >> Both of these discussions were at the workflow workshop. >> >> Dan >> >>> On Apr 22, 2015, at 13:18, Foster, Ian T. wrote: >>> >>> Dear all: >>> >>> Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. >>> >>> Ian >>> >>> >>> >>> >>> _______________________________________________ >>> Swift-devel mailing list >>> Swift-devel at ci.uchicago.edu >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > -- > Justin M Wozniak > From dsk at uchicago.edu Wed Apr 22 16:31:28 2015 From: dsk at uchicago.edu (Daniel S. Katz) Date: Wed, 22 Apr 2015 17:31:28 -0400 Subject: [Swift-devel] Prabhat from NERSC In-Reply-To: <5537DFA1.4050109@mcs.anl.gov> References: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> <5537DFA1.4050109@mcs.anl.gov> Message-ID: One of the LANL people was David Montoya. The other was a woman whose name I didn?t get and can?t find immediately. Dan > On Apr 22, 2015, at 1:51 PM, Justin M Wozniak wrote: > > > Great- we are hosting two ExMatEx people from LANL in early May. Tim Germann has run Swift. > > On 04/22/2015 12:29 PM, Daniel S. Katz wrote: >> Yes. We've started talking with them (Yesterday) about getting Swift installed at NERSC and making it officially supported. There is also some possibility that NERSC might eventually contribute effort to Swift as well. >> >> I also talked to LANL folks yesterday about Swift and they are also potentially interested in installing it, but they are a step behind NERSC, having done an initial comparison of tools, with Swift showing up near the top. >> >> Both of these discussions were at the workflow workshop. >> >> Dan >> >>> On Apr 22, 2015, at 13:18, Foster, Ian T. wrote: >>> >>> Dear all: >>> >>> Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. >>> >>> Ian >>> >>> >>> >>> >>> _______________________________________________ >>> Swift-devel mailing list >>> Swift-devel at ci.uchicago.edu >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > -- > Justin M Wozniak > -- Daniel S. Katz University of Chicago (773) 834-7186 (voice) (773) 834-6818 (fax) d.katz at ieee.org or dsk at uchicago.edu http://www.ci.uchicago.edu/~dsk/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From dsk at uchicago.edu Wed Apr 22 16:50:39 2015 From: dsk at uchicago.edu (Daniel S. Katz) Date: Wed, 22 Apr 2015 17:50:39 -0400 Subject: [Swift-devel] Prabhat from NERSC In-Reply-To: References: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> <5537DFA1.4050109@mcs.anl.gov> Message-ID: <864368E3-2A0B-487E-AA37-BAF031D6942A@uchicago.edu> The other was Christine Sweeney Dan > On Apr 22, 2015, at 5:31 PM, Daniel S. Katz wrote: > > One of the LANL people was David Montoya. The other was a woman whose name I didn?t get and can?t find immediately. > > Dan > > >> On Apr 22, 2015, at 1:51 PM, Justin M Wozniak > wrote: >> >> >> Great- we are hosting two ExMatEx people from LANL in early May. Tim Germann has run Swift. >> >> On 04/22/2015 12:29 PM, Daniel S. Katz wrote: >>> Yes. We've started talking with them (Yesterday) about getting Swift installed at NERSC and making it officially supported. There is also some possibility that NERSC might eventually contribute effort to Swift as well. >>> >>> I also talked to LANL folks yesterday about Swift and they are also potentially interested in installing it, but they are a step behind NERSC, having done an initial comparison of tools, with Swift showing up near the top. >>> >>> Both of these discussions were at the workflow workshop. >>> >>> Dan >>> >>>> On Apr 22, 2015, at 13:18, Foster, Ian T. > wrote: >>>> >>>> Dear all: >>>> >>>> Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. >>>> >>>> Ian >>>> >>>> >>>> >>>> >>>> _______________________________________________ >>>> Swift-devel mailing list >>>> Swift-devel at ci.uchicago.edu >>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >>> _______________________________________________ >>> Swift-devel mailing list >>> Swift-devel at ci.uchicago.edu >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >> >> >> -- >> Justin M Wozniak >> > > -- > Daniel S. Katz > University of Chicago > (773) 834-7186 (voice) > (773) 834-6818 (fax) > d.katz at ieee.org or dsk at uchicago.edu > http://www.ci.uchicago.edu/~dsk/ > > > > -- Daniel S. Katz University of Chicago (773) 834-7186 (voice) (773) 834-6818 (fax) d.katz at ieee.org or dsk at uchicago.edu http://www.ci.uchicago.edu/~dsk/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From foster at anl.gov Wed Apr 22 17:03:16 2015 From: foster at anl.gov (Foster, Ian T.) Date: Wed, 22 Apr 2015 22:03:16 +0000 Subject: [Swift-devel] Prabhat from NERSC In-Reply-To: <864368E3-2A0B-487E-AA37-BAF031D6942A@uchicago.edu> References: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> <5537DFA1.4050109@mcs.anl.gov> <864368E3-2A0B-487E-AA37-BAF031D6942A@uchicago.edu> Message-ID: <3F37CA2F-3254-49A8-B09A-F89CBBA88BBE@anl.gov> Christine works on their ?Legion? project I think On Apr 22, 2015, at 4:50 PM, Daniel S. Katz > wrote: The other was Christine Sweeney Dan On Apr 22, 2015, at 5:31 PM, Daniel S. Katz > wrote: One of the LANL people was David Montoya. The other was a woman whose name I didn?t get and can?t find immediately. Dan On Apr 22, 2015, at 1:51 PM, Justin M Wozniak > wrote: Great- we are hosting two ExMatEx people from LANL in early May. Tim Germann has run Swift. On 04/22/2015 12:29 PM, Daniel S. Katz wrote: Yes. We've started talking with them (Yesterday) about getting Swift installed at NERSC and making it officially supported. There is also some possibility that NERSC might eventually contribute effort to Swift as well. I also talked to LANL folks yesterday about Swift and they are also potentially interested in installing it, but they are a step behind NERSC, having done an initial comparison of tools, with Swift showing up near the top. Both of these discussions were at the workflow workshop. Dan On Apr 22, 2015, at 13:18, Foster, Ian T. > wrote: Dear all: Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. Ian _______________________________________________ Swift-devel mailing list Swift-devel at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel _______________________________________________ Swift-devel mailing list Swift-devel at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Justin M Wozniak -- Daniel S. Katz University of Chicago (773) 834-7186 (voice) (773) 834-6818 (fax) d.katz at ieee.org or dsk at uchicago.edu http://www.ci.uchicago.edu/~dsk/ -- Daniel S. Katz University of Chicago (773) 834-7186 (voice) (773) 834-6818 (fax) d.katz at ieee.org or dsk at uchicago.edu http://www.ci.uchicago.edu/~dsk/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From dsk at uchicago.edu Wed Apr 22 18:01:18 2015 From: dsk at uchicago.edu (Daniel S. Katz) Date: Wed, 22 Apr 2015 19:01:18 -0400 Subject: [Swift-devel] Prabhat from NERSC In-Reply-To: <3F37CA2F-3254-49A8-B09A-F89CBBA88BBE@anl.gov> References: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> <5537DFA1.4050109@mcs.anl.gov> <864368E3-2A0B-487E-AA37-BAF031D6942A@uchicago.edu> <3F37CA2F-3254-49A8-B09A-F89CBBA88BBE@anl.gov> Message-ID: <2F9DD1C7-3FDE-4084-93CD-A5BE168B3416@uchicago.edu> Yes, she did mention that, then I got confused trying to figure out why Legion was still active. > On Apr 22, 2015, at 18:03, Foster, Ian T. wrote: > > Christine works on their ?Legion? project I think > >> On Apr 22, 2015, at 4:50 PM, Daniel S. Katz wrote: >> >> The other was Christine Sweeney >> >> Dan >> >>> On Apr 22, 2015, at 5:31 PM, Daniel S. Katz wrote: >>> >>> One of the LANL people was David Montoya. The other was a woman whose name I didn?t get and can?t find immediately. >>> >>> Dan >>> >>> >>>> On Apr 22, 2015, at 1:51 PM, Justin M Wozniak wrote: >>>> >>>> >>>> Great- we are hosting two ExMatEx people from LANL in early May. Tim Germann has run Swift. >>>> >>>>> On 04/22/2015 12:29 PM, Daniel S. Katz wrote: >>>>> Yes. We've started talking with them (Yesterday) about getting Swift installed at NERSC and making it officially supported. There is also some possibility that NERSC might eventually contribute effort to Swift as well. >>>>> >>>>> I also talked to LANL folks yesterday about Swift and they are also potentially interested in installing it, but they are a step behind NERSC, having done an initial comparison of tools, with Swift showing up near the top. >>>>> >>>>> Both of these discussions were at the workflow workshop. >>>>> >>>>> Dan >>>>> >>>>>> On Apr 22, 2015, at 13:18, Foster, Ian T. wrote: >>>>>> >>>>>> Dear all: >>>>>> >>>>>> Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. >>>>>> >>>>>> Ian >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Swift-devel mailing list >>>>>> Swift-devel at ci.uchicago.edu >>>>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >>>>> _______________________________________________ >>>>> Swift-devel mailing list >>>>> Swift-devel at ci.uchicago.edu >>>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel >>>> >>>> >>>> -- >>>> Justin M Wozniak >>>> >>> >>> -- >>> Daniel S. Katz >>> University of Chicago >>> (773) 834-7186 (voice) >>> (773) 834-6818 (fax) >>> d.katz at ieee.org or dsk at uchicago.edu >>> http://www.ci.uchicago.edu/~dsk/ >>> >>> >>> >>> >> >> -- >> Daniel S. Katz >> University of Chicago >> (773) 834-7186 (voice) >> (773) 834-6818 (fax) >> d.katz at ieee.org or dsk at uchicago.edu >> http://www.ci.uchicago.edu/~dsk/ >> >> >> >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: From foster at anl.gov Wed Apr 22 18:07:12 2015 From: foster at anl.gov (Foster, Ian T.) Date: Wed, 22 Apr 2015 23:07:12 +0000 Subject: [Swift-devel] Prabhat from NERSC In-Reply-To: <2F9DD1C7-3FDE-4084-93CD-A5BE168B3416@uchicago.edu> References: <8B60F80C-1A41-4C2C-AFC6-BD3212DDC964@anl.gov> <9CB447E8-0A19-41B3-985F-186D33797E37@uchicago.edu> <5537DFA1.4050109@mcs.anl.gov> <864368E3-2A0B-487E-AA37-BAF031D6942A@uchicago.edu> <3F37CA2F-3254-49A8-B09A-F89CBBA88BBE@anl.gov> <2F9DD1C7-3FDE-4084-93CD-A5BE168B3416@uchicago.edu> Message-ID: <16AB7774-477C-417A-8D0E-1AE98CC6E753@anl.gov> I set her straight, and I imagine you did too :) On Apr 22, 2015, at 6:01 PM, Daniel S. Katz > wrote: Yes, she did mention that, then I got confused trying to figure out why Legion was still active. On Apr 22, 2015, at 18:03, Foster, Ian T. > wrote: Christine works on their ?Legion? project I think On Apr 22, 2015, at 4:50 PM, Daniel S. Katz > wrote: The other was Christine Sweeney Dan On Apr 22, 2015, at 5:31 PM, Daniel S. Katz > wrote: One of the LANL people was David Montoya. The other was a woman whose name I didn?t get and can?t find immediately. Dan On Apr 22, 2015, at 1:51 PM, Justin M Wozniak > wrote: Great- we are hosting two ExMatEx people from LANL in early May. Tim Germann has run Swift. On 04/22/2015 12:29 PM, Daniel S. Katz wrote: Yes. We've started talking with them (Yesterday) about getting Swift installed at NERSC and making it officially supported. There is also some possibility that NERSC might eventually contribute effort to Swift as well. I also talked to LANL folks yesterday about Swift and they are also potentially interested in installing it, but they are a step behind NERSC, having done an initial comparison of tools, with Swift showing up near the top. Both of these discussions were at the workflow workshop. Dan On Apr 22, 2015, at 13:18, Foster, Ian T. > wrote: Dear all: Prabhat spoke at the ESNet requirements workshop. He happened to mention that they ran a data workshop at NERSC recently (last week?) and as part of that, evaluated all of the workflow systems that are ?in play? as he put it. He said that Swift and Fireworks came out at the top. Ian _______________________________________________ Swift-devel mailing list Swift-devel at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel _______________________________________________ Swift-devel mailing list Swift-devel at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Justin M Wozniak -- Daniel S. Katz University of Chicago (773) 834-7186 (voice) (773) 834-6818 (fax) d.katz at ieee.org or dsk at uchicago.edu http://www.ci.uchicago.edu/~dsk/ -- Daniel S. Katz University of Chicago (773) 834-7186 (voice) (773) 834-6818 (fax) d.katz at ieee.org or dsk at uchicago.edu http://www.ci.uchicago.edu/~dsk/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From ketan at mcs.anl.gov Tue Apr 28 10:20:20 2015 From: ketan at mcs.anl.gov (Ketan Maheshwari) Date: Tue, 28 Apr 2015 10:20:20 -0500 Subject: [Swift-devel] forcing service and local ports in automatic coasters Message-ID: Hi, Is it possible to force service and local ports in automatic coasters in 0.96? I tried the env vars SERVICE_PORT and LOCAL_PORT from the persistent coasters setup but does not seem to work. Thanks, Ketan -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Tue Apr 28 12:12:05 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 28 Apr 2015 10:12:05 -0700 Subject: [Swift-devel] forcing service and local ports in automatic coasters In-Reply-To: References: Message-ID: <1430241125.12352.1.camel@echo> Can you be more specific on what you want? With automatic coasters, the coaster service does not really create a TCP service like it does with persistent coasters. Mihael On Tue, 2015-04-28 at 10:20 -0500, Ketan Maheshwari wrote: > Hi, > > Is it possible to force service and local ports in automatic coasters in > 0.96? I tried the env vars SERVICE_PORT and LOCAL_PORT from the persistent > coasters setup but does not seem to work. > > Thanks, > Ketan > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel From yadunand at uchicago.edu Tue Apr 28 12:45:20 2015 From: yadunand at uchicago.edu (Yadu Nand Babuji) Date: Tue, 28 Apr 2015 12:45:20 -0500 Subject: [Swift-devel] forcing service and local ports in automatic coasters In-Reply-To: <1430241125.12352.1.camel@echo> References: <1430241125.12352.1.camel@echo> Message-ID: <553FC730.6080904@uchicago.edu> Hi Mihael, Ketan and I discussed the setup over voice, and here's what he ended up using: Swift client runs on Cetus, while there is an persistent coaster-service in active mode on Tukey. A tunnel from Tukey connects the serviceports. Ssh from Cetus to Tukey is limited by a cryptocard, so ssh-cl:cobalt with coasters wasn't working cleanly. Ketan, please correct me if I missed anything. Thanks, -Yadu On 04/28/2015 12:12 PM, Mihael Hategan wrote: > Can you be more specific on what you want? With automatic coasters, the > coaster service does not really create a TCP service like it does with > persistent coasters. > > Mihael > > On Tue, 2015-04-28 at 10:20 -0500, Ketan Maheshwari wrote: >> Hi, >> >> Is it possible to force service and local ports in automatic coasters in >> 0.96? I tried the env vars SERVICE_PORT and LOCAL_PORT from the persistent >> coasters setup but does not seem to work. >> >> Thanks, >> Ketan >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel From ketan at mcs.anl.gov Tue Apr 28 12:44:39 2015 From: ketan at mcs.anl.gov (Ketan Maheshwari) Date: Tue, 28 Apr 2015 12:44:39 -0500 Subject: [Swift-devel] forcing service and local ports in automatic coasters In-Reply-To: <1430241125.12352.1.camel@echo> References: <1430241125.12352.1.camel@echo> Message-ID: Thanks, please disregard this, I switched to persistent coasters and things work. --Ketan On Tue, Apr 28, 2015 at 12:12 PM, Mihael Hategan wrote: > Can you be more specific on what you want? With automatic coasters, the > coaster service does not really create a TCP service like it does with > persistent coasters. > > Mihael > > On Tue, 2015-04-28 at 10:20 -0500, Ketan Maheshwari wrote: > > Hi, > > > > Is it possible to force service and local ports in automatic coasters in > > 0.96? I tried the env vars SERVICE_PORT and LOCAL_PORT from the > persistent > > coasters setup but does not seem to work. > > > > Thanks, > > Ketan > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ketan at mcs.anl.gov Tue Apr 28 12:56:31 2015 From: ketan at mcs.anl.gov (Ketan Maheshwari) Date: Tue, 28 Apr 2015 12:56:31 -0500 Subject: [Swift-devel] forcing service and local ports in automatic coasters In-Reply-To: <553FC730.6080904@uchicago.edu> References: <1430241125.12352.1.camel@echo> <553FC730.6080904@uchicago.edu> Message-ID: On Tue, Apr 28, 2015 at 12:45 PM, Yadu Nand Babuji wrote: > Hi Mihael, > > Ketan and I discussed the setup over voice, and here's what he ended up > using: > > Swift client runs on Cetus, while there is an persistent > coaster-service in active mode > on Tukey. A tunnel from Tukey connects the serviceports. Ssh from Cetus > to Tukey is > limited by a cryptocard, so ssh-cl:cobalt with coasters wasn't working > cleanly. > Earlier, I tried setting up ssh multiplexed master channel to circumvent the cryptocard (verified this with ssh and scp). ssh-cl:cobalt still did not work. The error message was: java.io.IOException: Failed to run ssh: zsh:1: no matches found: /home/ketan/.globus/ssh*-*-*. > > Ketan, please correct me if I missed anything. > > Thanks, > -Yadu > On 04/28/2015 12:12 PM, Mihael Hategan wrote: > > Can you be more specific on what you want? With automatic coasters, the > > coaster service does not really create a TCP service like it does with > > persistent coasters. > > > > Mihael > > > > On Tue, 2015-04-28 at 10:20 -0500, Ketan Maheshwari wrote: > >> Hi, > >> > >> Is it possible to force service and local ports in automatic coasters in > >> 0.96? I tried the env vars SERVICE_PORT and LOCAL_PORT from the > persistent > >> coasters setup but does not seem to work. > >> > >> Thanks, > >> Ketan > >> _______________________________________________ > >> Swift-devel mailing list > >> Swift-devel at ci.uchicago.edu > >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > > _______________________________________________ > > Swift-devel mailing list > > Swift-devel at ci.uchicago.edu > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Tue Apr 28 14:48:27 2015 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 28 Apr 2015 12:48:27 -0700 Subject: [Swift-devel] forcing service and local ports in automatic coasters In-Reply-To: References: <1430241125.12352.1.camel@echo> <553FC730.6080904@uchicago.edu> Message-ID: <1430250507.15682.0.camel@echo> On Tue, 2015-04-28 at 12:56 -0500, Ketan Maheshwari wrote: > On Tue, Apr 28, 2015 at 12:45 PM, Yadu Nand Babuji > wrote: > > > Hi Mihael, > > > > Ketan and I discussed the setup over voice, and here's what he ended up > > using: > > > > Swift client runs on Cetus, while there is an persistent > > coaster-service in active mode > > on Tukey. A tunnel from Tukey connects the serviceports. Ssh from Cetus > > to Tukey is > > limited by a cryptocard, so ssh-cl:cobalt with coasters wasn't working > > cleanly. > > > > Earlier, I tried setting up ssh multiplexed master channel to circumvent > the cryptocard (verified this with ssh and scp). ssh-cl:cobalt still did > not work. The error message was: > java.io.IOException: Failed to run ssh: zsh:1: no matches found: > /home/ketan/.globus/ssh*-*-*. > I would worry about some script in your environment or ssh configuration. I can see no good reason why zsh should come into the picture. Mihael From ketan at mcs.anl.gov Wed Apr 29 06:18:22 2015 From: ketan at mcs.anl.gov (Ketan Maheshwari) Date: Wed, 29 Apr 2015 06:18:22 -0500 Subject: [Swift-devel] Swift did not shut down 10 seconds after the run completed Message-ID: Hi, Trying to run a Swift app between Cetus and Tukey with ssh tunnel and persistent, non-passive coasters. The run finished but at the end Swift did not shutdown cleanly. It showed the following message: ... ... Progress: Wed, 29 Apr 2015 11:09:57+0000 Stage in:1 Finished successfully:10 Final status: Wed, 29 Apr 2015 11:10:03+0000 Finished successfully:11 Swift did not shut down 10 seconds after the run completed This was followed by many threads waiting stack trace messages such as: Waiting JVM threads: Thread "main" (0x00000001) WAITING waiting for org.globus.cog.abstraction.coaster.service.CoasterService$1 (0x4ea54ea5) Monitors held: org.globus.cog.abstraction.coaster.service.CoasterService$1 (0x4ea54ea5) java.lang.Class (0x358a358a) Stack trace: java.lang.Object.wait java.lang.Object.wait:196 java.lang.Thread.join:641 -> locked org.globus.cog.abstraction.coaster.service.CoasterService$1 (0x4ea54ea5) java.lang.ApplicationShutdownHooks.run:91 java.lang.Shutdown.runHooks:101 java.lang.Shutdown.sequence:145 java.lang.Shutdown.exit:190 -> locked java.lang.Class (0x358a358a) java.lang.Runtime.exit:101 java.lang.System.exit:299 org.griphyn.vdl.karajan.Loader.main:266 ... The logs are attached. Thanks, -- Ketan -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: run005.tgz Type: application/x-gzip Size: 18711 bytes Desc: not available URL: From ketan at mcs.anl.gov Wed Apr 29 07:41:01 2015 From: ketan at mcs.anl.gov (Ketan Maheshwari) Date: Wed, 29 Apr 2015 07:41:01 -0500 Subject: [Swift-devel] Swift did not shut down 10 seconds after the run completed In-Reply-To: References: Message-ID: This may be a transient one. I am not seeing it in all runs. Just saw in one of about five similar runs. On Wed, Apr 29, 2015 at 6:18 AM, Ketan Maheshwari wrote: > Hi, > > Trying to run a Swift app between Cetus and Tukey with ssh tunnel and > persistent, non-passive coasters. The run finished but at the end Swift did > not shutdown cleanly. It showed the following message: > > ... > ... > Progress: Wed, 29 Apr 2015 11:09:57+0000 Stage in:1 Finished > successfully:10 > Final status: Wed, 29 Apr 2015 11:10:03+0000 Finished successfully:11 > Swift did not shut down 10 seconds after the run completed > > This was followed by many threads waiting stack trace messages such as: > > Waiting JVM threads: > Thread "main" (0x00000001) WAITING > waiting for org.globus.cog.abstraction.coaster.service.CoasterService$1 > (0x4ea54ea5) > Monitors held: > org.globus.cog.abstraction.coaster.service.CoasterService$1 (0x4ea54ea5) > java.lang.Class (0x358a358a) > Stack trace: > java.lang.Object.wait > java.lang.Object.wait:196 > java.lang.Thread.join:641 -> locked > org.globus.cog.abstraction.coaster.service.CoasterService$1 (0x4ea54ea5) > java.lang.ApplicationShutdownHooks.run:91 > java.lang.Shutdown.runHooks:101 > java.lang.Shutdown.sequence:145 > java.lang.Shutdown.exit:190 -> locked java.lang.Class (0x358a358a) > java.lang.Runtime.exit:101 > java.lang.System.exit:299 > org.griphyn.vdl.karajan.Loader.main:266 > > ... > > The logs are attached. > > Thanks, > -- > Ketan > -------------- next part -------------- An HTML attachment was scrubbed... URL: