From iraicu at cs.iit.edu Sun Oct 5 08:38:58 2014 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Sun, 05 Oct 2014 08:38:58 -0500 Subject: [Swift-devel] CFP: The 24th Int. ACM Symp. on High-Performance Parallel and Distributed Computing (HPDC) 2015 Message-ID: <543149F2.6080205@cs.iit.edu> **** CALL FOR PAPERS **** The 24th International ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC-2015) Portland, Oregon, USA - June 15-19, 2015 http://www.hpdc.org/2015 The ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) is the premier annual conference for presenting the latest research on the design, implementation, evaluation, and the use of parallel and distributed systems for high-end computing. The 24th HPDC will take place in the city of roses, Portland, Oregon on June 15-19, 2015. (Workshops on June 15-16, and the main conference on June 17-19.) **** IMPORTANT DATES **** Abstracts (required) due: January 12, 2015 Full Papers due: January 19, 2015 (no extensions) Author rebuttal period: March 4-7, 2015 Author notifications: March 16, 2015 Final Manuscripts: April 1, 2015 **** SCOPE AND TOPICS **** Submissions are welcomed on high-performance parallel and distributed computing topics including but not limited to: clouds, clusters, grids, big data, massively multicore, and global-scale computing systems. Submissions that focus on the architectures, systems, and networks of cloud infrastructures are particularly encouraged, as are experience reports of operational deployments that can provide insights for future research on HPDC applications and systems. All papers will be evaluated for their originality, technical depth and correctness, potential impact, relevance to the conference, and quality of presentation. Research papers must clearly demonstrate research contributions and novelty, while experience reports must clearly describe lessons learned and demonstrate impact. In the context of high-performance parallel and distributed computing, the topics of interest include, but are not limited to: - Systems, networks, and architectures - Massively multicore systems - Resource virtualization - Programming languages and environments - File and storage systems, I/O, and data management - Resource management and scheduling, including energy-aware techniques - Performance modeling and analysis - Fault tolerance, reliability, and availability - Data-intensive computing - Applications and services that depend upon high-end computing **** PAPER SUBMISSION GUIDELINES **** Authors are invited to submit technical papers of at most 12 pages in PDF format, including figures and references. Papers should be formatted in the ACM Proceedings Style and submitted via the conference web site. No changes to the margins, spacing, or font sizes as specified by the style file are allowed. Accepted papers will appear in the conference proceedings, and will be incorporated into the ACM Digital Library. A limited number of papers will be accepted as posters. Papers must be self-contained and provide the technical substance required for the program committee to evaluate their contributions. Submitted papers must be original work that has not appeared in and is not under consideration for another conference or a journal. See the ACM Prior Publication Policy for more details. Papers can be submitted at https://ssl.linklings.net/conferences/hpdc/. **** HPDC'15 GENERAL CO-CHAIRS **** Thilo Kielmann, VU University Amsterdam, The Netherlands **** HPDC'15 PROGRAM CO-CHAIRS **** Dean Hildebrand, IBM Research Almaden, USA Michela Taufer, University of Delaware, USA **** HPDC'15 WORKSHOP CHAIRS **** Abhishek Chandra, University of Minnesota, Twin Cities, USA Ioan Raicu, Illinois Institute of Technology and Argonne National Laboratory, USA **** HPDC'15 POSTERS CHAIR **** Ana-Maria Oprescu, VU University Amsterdam, The Netherlands **** HPDC'15 PUBLICITY CHAIR **** Ioan Raicu, Illinois Institute of Technology and Argonne National Laboratory, USA Torsten Hoefler, ETH Zurich, Switzerland Naoya Maruyama, RIKEN Advanced Institute for Computational Science, Japan **** HPDC'15 PUBLICATIONS CHAIR **** Antonino Tumeo, Pacific Northwest National Laboratory, USA **** HPDC'15 TRAVEL AWARD CHAIR **** Ming Zhao, Florida International University, USA **** HPDC'15 WEBMASTER CHAIR **** Kaveh Razavi, VU University Amsterdam, The Netherlands **** HPDC'15 PROGRAM COMMITTEE **** David Abramson, The University of Queensland, Australia Dong Ahn, Lawrence Livermore National Laboratory, USA Gabriel Antoniu, INRIA, France Henri Bal, VU University Amsterdam, The Netherlands Pavan Balaji, Argonne National Laboratory, USA Michela Becchi, University of Missouri, USA John Bent, EMC, USA Greg Bronevetsky, Lawrence Livermore National Laboratory, USA Ali Butt, Virginia Tech, USA Franck Cappello, Argonne National Lab, USA Abhishek Chandra, University of Minnesota, USA Andrew A. Chien, University of Chicago, USA Paolo Costa, Microsoft Research Cambridge, UK Kei Davis, Los Alamos National Laboratory, USA Peter Dinda, Northwestern University, USA Dick Epema, Delft University of Technology, The Netherlands Gilles Fedak, INRIA, France Wuchun Feng, Virginia Tech, USA Renato Figueiredo, University of Florida, USA Clemens Grelck, University of Amsterdam, The Netherlands Adriana Iamnitchi, University of South Florida, USA Larry Kaplan, Cray Inc., USA Kate Keahey, Argonne National Laboratory, USA Dries Kimpe, Argonne National Laboratory, USA Alice Koniges, Lawrence Berkeley National Laboratory, USA Zhiling Lan, Illinois Institute of Technology, USA John (Jack) Lange, University of Pittsburgh, USA Gary Liu, Oak Ridge National Laboratory, USA Jay Lofstead, Sandia National Laboratories, USA Arthur Barney Maccabe, Oak Ridge National Laboratory, USA Carlos Maltzahn, University of California, Santa Cruz, USA Naoya Maruyama, RIKEN Advanced Institute for Comp. Science, Japan Satoshi Matsuoka, Tokyo Inst. Technology, Japan Timothy Mattson, Intel, USA Kathryn Mohror, Lawrence Livermore National Laboratory, USA Bogdan Nicolae, IBM Research, Ireland Sangmi Pallickara, Colorado State University, USA Manish Parashar, Rutgers University, USA Lavanya Ramakrishnan, Lawrence Berkeley National Laboratory, USA Raju Rangaswami, Florida International University, USA Matei Ripeanu, University of British Columbia, Canada Nagiza F. Samatova, North Carolina State University, USA Prasenjit Sarkar, Independent Consultant, USA Karsten Schwan, Georgia Institute of Technology, USA Vasily Tarasov, IBM Research, USA Kenjiro Taura, University of Tokyo, Japan Douglas Thain, University of Notre Dame, USA Ana Varbanescu, University of Amsterdam, The Netherlands Richard Vuduc, Georgia Institute of Technology, USA Jon Weissman, University of Minnesota, USA Dongyan Xu, Purdue University, USA Rui Zhang, IBM Research, USA **** HPDC STEERING COMMITTEE **** Franck Cappello, Argonne National Lab, USA and INRIA, France Andrew A. Chien, University of Chicago, USA Peter Dinda, Northwestern University, USA Dick Epema, Delft University of Technology, The Netherlands Renato Figueiredo, University of Florida, USA Salim Hariri, University of Arizona, USA Thilo Kielmann, VU University Amsterdam, The Netherlands Arthur "Barney" Maccabe, Oak Ridge National Laboratory, USA Manish Parashar, Rutgers University, USA Matei Ripeanu, University of British Columbia, Canada Karsten Schwan, Georgia Tech, USA Doug Thain, University of Notre Dame, USA Jon Weissman, University of Minnesota, USA (Chair) Dongyan Xu, Purdue University, USA -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Editor: IEEE TCC, Springer Cluster, Springer JoCCASA Chair: IEEE/ACM MTAGS, ACM ScienceCloud ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ LinkedIn: http://www.linkedin.com/in/ioanraicu Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ ================================================================= ================================================================= -------------- next part -------------- An HTML attachment was scrubbed... URL: From hereld at anl.gov Sun Oct 12 10:03:01 2014 From: hereld at anl.gov (Hereld, Mark) Date: Sun, 12 Oct 2014 15:03:01 +0000 Subject: [Swift-devel] dump config state Message-ID: is there a way to dump the config state that an invocation of swift is using? e.g. (1) is sitedir.keep and all the rest available in script? (2) or is there a command line option that doesn't run, but rather blurts out a verbose compendium? (3) or is there a secret swift directive that can be invoked within the script? (4) or something... -m ------------------------------------------------------- Mark Hereld > Senior Fellow - Computation Institute Experimental Systems Engineer - Mathematics and Computer Science Visualization and Analysis Lead - Argonne Leadership Computing Facility Argonne National Laboratory The University of Chicago Cell: 630.327.2088 Voice: 630.252.4170 -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Sun Oct 12 14:21:43 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Sun, 12 Oct 2014 12:21:43 -0700 Subject: [Swift-devel] dump config state In-Reply-To: References: Message-ID: <1413141703.9373.4.camel@echo> Hi Mark, The config is dumped in the swift log. In 0.94 and 0.95, it's a long, barely formatted line that has "SWIFT_CONFIGURATION" as a header. In trunk it's formatted a little nicer. Do you want the values available programmatically from within swift or just a dump for post-run analysis? Mihael On Sun, 2014-10-12 at 15:03 +0000, Hereld, Mark wrote: > is there a way to dump the config state that an invocation of swift is using? > e.g. > (1) is sitedir.keep and all the rest available in script? > (2) or is there a command line option that doesn't run, but rather blurts out a verbose compendium? > (3) or is there a secret swift directive that can be invoked within the script? > (4) or something... > -m > > ------------------------------------------------------- > Mark Hereld > > Senior Fellow - Computation Institute > Experimental Systems Engineer - Mathematics and Computer Science > Visualization and Analysis Lead - Argonne Leadership Computing Facility > > Argonne National Laboratory > The University of Chicago > > Cell: 630.327.2088 > Voice: 630.252.4170 > > > > > > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel From hereld at anl.gov Sun Oct 12 21:58:11 2014 From: hereld at anl.gov (Hereld, Mark) Date: Mon, 13 Oct 2014 02:58:11 +0000 Subject: [Swift-devel] dump config state In-Reply-To: <1413141703.9373.4.camel@echo> References: <1413141703.9373.4.camel@echo> Message-ID: <8C553B10-0FB5-4D57-986D-3CE5E197C0F4@anl.gov> Hi Mihael, Thanks! That looks like just what I need. -- Mark On Oct 12, 2014, at 2:21 PM, Mihael Hategan > wrote: Hi Mark, The config is dumped in the swift log. In 0.94 and 0.95, it's a long, barely formatted line that has "SWIFT_CONFIGURATION" as a header. In trunk it's formatted a little nicer. Do you want the values available programmatically from within swift or just a dump for post-run analysis? Mihael On Sun, 2014-10-12 at 15:03 +0000, Hereld, Mark wrote: is there a way to dump the config state that an invocation of swift is using? e.g. (1) is sitedir.keep and all the rest available in script? (2) or is there a command line option that doesn't run, but rather blurts out a verbose compendium? (3) or is there a secret swift directive that can be invoked within the script? (4) or something... -m ------------------------------------------------------- Mark Hereld > Senior Fellow - Computation Institute Experimental Systems Engineer - Mathematics and Computer Science Visualization and Analysis Lead - Argonne Leadership Computing Facility Argonne National Laboratory The University of Chicago Cell: 630.327.2088 Voice: 630.252.4170 _______________________________________________ Swift-devel mailing list Swift-devel at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel ------------------------------------------------------- Mark Hereld > Senior Fellow - Computation Institute Experimental Systems Engineer - Mathematics and Computer Science Visualization and Analysis Lead - Argonne Leadership Computing Facility Argonne National Laboratory The University of Chicago Cell: 630.327.2088 Voice: 630.252.4170 -------------- next part -------------- An HTML attachment was scrubbed... URL: From wilde at anl.gov Tue Oct 14 11:54:47 2014 From: wilde at anl.gov (Michael Wilde) Date: Tue, 14 Oct 2014 11:54:47 -0500 Subject: [Swift-devel] Workers fail on some OSG sites Message-ID: <543D5557.90303@anl.gov> Mihael, can you assess this problem? Suchandra identified 13 high-yield OSG sites that are fruitful for larger-scale work. Of these, 12 pass a simple python connectivity test back to the OSG Connect login host. (Python can connect and send data to a remote dummy server). On these sites, Swift worker.pl processes can also connect back to the Swift client/coaster-service (as seen in the Swift or coaster logs). But on several sites, worker.pl encounters errors like the ones below: send: Cannot determine peer address at cscript3076873223245775853.pl line 490 Failed to process data: Failed to register (service returned error: No such block: 1013-5205390-000018) at cscript3076873223245775853.pl line 1101. Failed to process data: Failed to register (service returned error: No such block: 1013-5205390-000051) at cscript3076873223245775853.pl line 1101. Failed to process data: Failed to register (service returned error: No such block: 1013-5205390-000043) at cscript3076873223245775853.pl line 1101. Ive asked Yadu to file a ticket on this describing the config in more detail, but wanted to send this to you for an initial assessment, as its a problem thats been lingering (unreported) for at least several weeks. Thanks, - Mike -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From hategan at mcs.anl.gov Tue Oct 14 12:10:59 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 14 Oct 2014 10:10:59 -0700 Subject: [Swift-devel] Workers fail on some OSG sites In-Reply-To: <543D5557.90303@anl.gov> References: <543D5557.90303@anl.gov> Message-ID: <1413306659.6312.1.camel@echo> On Tue, 2014-10-14 at 11:54 -0500, Michael Wilde wrote: > But on several sites, worker.pl encounters errors like the ones below: What do you mean by "like"? > > send: Cannot determine peer address at cscript3076873223245775853.pl > line 490 > Failed to process data: Failed to register (service returned error: No > such block: 1013-5205390-000018) at cscript3076873223245775853.pl line 1101. > Failed to process data: Failed to register (service returned error: No > such block: 1013-5205390-000051) at cscript3076873223245775853.pl line 1101. > Failed to process data: Failed to register (service returned error: No > such block: 1013-5205390-000043) at cscript3076873223245775853.pl line 1101. This occurs when a worker started by one service tries to connect to a different service. Mihael From wilde at anl.gov Tue Oct 14 12:16:06 2014 From: wilde at anl.gov (Michael Wilde) Date: Tue, 14 Oct 2014 12:16:06 -0500 Subject: [Swift-devel] Workers fail on some OSG sites In-Reply-To: <1413306659.6312.1.camel@echo> References: <543D5557.90303@anl.gov> <1413306659.6312.1.camel@echo> Message-ID: <543D5A56.7070403@anl.gov> On 10/14/14 12:10 PM, Mihael Hategan wrote: > On Tue, 2014-10-14 at 11:54 -0500, Michael Wilde wrote: > >> But on several sites, worker.pl encounters errors like the ones below: > What do you mean by "like"? I meant that these were an actual example of the error messages being seen. > >> send: Cannot determine peer address at cscript3076873223245775853.pl >> line 490 >> Failed to process data: Failed to register (service returned error: No >> such block: 1013-5205390-000018) at cscript3076873223245775853.pl line 1101. >> Failed to process data: Failed to register (service returned error: No >> such block: 1013-5205390-000051) at cscript3076873223245775853.pl line 1101. >> Failed to process data: Failed to register (service returned error: No >> such block: 1013-5205390-000043) at cscript3076873223245775853.pl line 1101. > This occurs when a worker started by one service tries to connect to a > different service. Thats a good clue. Yadu, is that possible in this case? Please provide details of the configuration. Thanks, - Mike > > Mihael > -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From yadunand at uchicago.edu Tue Oct 14 20:30:40 2014 From: yadunand at uchicago.edu (Yadu Nand Babuji) Date: Tue, 14 Oct 2014 20:30:40 -0500 Subject: [Swift-devel] Workers fail on some OSG sites In-Reply-To: <543D5A56.7070403@anl.gov> References: <543D5557.90303@anl.gov> <1413306659.6312.1.camel@echo> <543D5A56.7070403@anl.gov> Message-ID: <543DCE40.6070407@uchicago.edu> Mike, Mihael, I've tried to match the error in the Condor*stderr, which had the block id of the workers with those in the swift log. In every case where the worker failed with the error string "Failed to process data", that worker had connected to the right coaster service, and was live for some time, after which it dies. Each section of the log starts with the name of the Coaster*stderr file, and the grepped worker block id. This is followed by a grep of the block id in the whole run folder: http://users.rcc.uchicago.edu/~yadunand/worker_mia.log Complete run folder : http://users.rcc.uchicago.edu/~yadunand/run011/ I remember David had reported channel timeouts from workers on midway, with 0.95, and I want to be sure that there isn't some deeper problem being overlooked. I see several channel timeouts in the logs. Thanks, Yadu On 10/14/2014 12:16 PM, Michael Wilde wrote: > On 10/14/14 12:10 PM, Mihael Hategan wrote: >> On Tue, 2014-10-14 at 11:54 -0500, Michael Wilde wrote: >> >>> But on several sites, worker.pl encounters errors like the ones below: >> What do you mean by "like"? > I meant that these were an actual example of the error messages being seen. >>> send: Cannot determine peer address at cscript3076873223245775853.pl >>> line 490 >>> Failed to process data: Failed to register (service returned error: No >>> such block: 1013-5205390-000018) at cscript3076873223245775853.pl line 1101. >>> Failed to process data: Failed to register (service returned error: No >>> such block: 1013-5205390-000051) at cscript3076873223245775853.pl line 1101. >>> Failed to process data: Failed to register (service returned error: No >>> such block: 1013-5205390-000043) at cscript3076873223245775853.pl line 1101. >> This occurs when a worker started by one service tries to connect to a >> different service. > Thats a good clue. Yadu, is that possible in this case? Please provide > details of the configuration. > > Thanks, > > - Mike > >> Mihael >> From hategan at mcs.anl.gov Sun Oct 19 20:18:32 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Sun, 19 Oct 2014 18:18:32 -0700 Subject: [Swift-devel] 0.96 plans Message-ID: <1413767912.16237.19.camel@echo> Hi, I wanted to send out an email to start a discussion about 0.96. I think we currently agreed that: - we will relase 0.95 as is and make patch releases if major bugs are uncovered - 0.96 should get a feature freeze right about now-ish; however, I ask for two exceptions: * a simple solution to bug #23: a function to test whether a piece of data is failed (e.g. isFailed(var)). * a resolution to bug #1275 - the tasks needed before release are somewhere around: * better testing coverage * documentation improvements * testing and fixing of the new monitoring tools * bugs cleanup Mihael From hategan at mcs.anl.gov Sun Oct 19 20:20:16 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Sun, 19 Oct 2014 18:20:16 -0700 Subject: [Swift-devel] unfixable bugs Message-ID: <1413768016.16237.21.camel@echo> Hi, There are many bugs in our bugzilla, and there are some bugs that are in the unfortunate state of needing more information about the issue to determine what's happening or to reproduce it, but such information has not been provided for a while. I have, at some point, added the WAITING_FOR_USER_INPUT state to keep track of some of these bugs. However, that, in itself, does not guarantee progress on the issue. I'm proposing that we decide on an amount of time that we allow a bug to be in a waiting state before we automatically close it as expired. The reason why I would like to do this is because having fewer bugs in bugzilla makes it easier to prioritize bug fixing (and not losing track of important issues). A move like this would eliminate bugs that have a really low chance of otherwise ever getting closed, and therefore only contribute negatively by adding noise. So let me know what you think about that. In the mean time, if you do have some time, please take another look at bugs that are waiting on you and maybe give some feedback on whether an issue is still present or perhaps some information that would help: https://bugzilla.mcs.anl.gov/swift/buglist.cgi?bug_status=WAITING%20FOR% 20USER%20INPUT Mihael From wilde at anl.gov Sun Oct 19 20:49:24 2014 From: wilde at anl.gov (Michael Wilde) Date: Sun, 19 Oct 2014 20:49:24 -0500 Subject: [Swift-devel] unfixable bugs In-Reply-To: <1413768016.16237.21.camel@echo> References: <1413768016.16237.21.camel@echo> Message-ID: <54446A24.40702@anl.gov> A waiting time for these is OK by me, but that should only apply to bugs, not enhancements. I'd like to see some of the "waiting for user input" bugs move to some kind of "needs test" status (eg bug 913 which you just updated). Thats a good example of a stress test thats needed. Also, instead of "automatically" closing these, maybe have a report that flags bugs whose waiting for user input time has expired? But in general, I agree - moving such bugs out of our main tracking focus is a good idea. - Mike On 10/19/14 8:20 PM, Mihael Hategan wrote: > Hi, > > There are many bugs in our bugzilla, and there are some bugs that are in > the unfortunate state of needing more information about the issue to > determine what's happening or to reproduce it, but such information has > not been provided for a while. > > I have, at some point, added the WAITING_FOR_USER_INPUT state to keep > track of some of these bugs. However, that, in itself, does not > guarantee progress on the issue. I'm proposing that we decide on an > amount of time that we allow a bug to be in a waiting state before we > automatically close it as expired. > > The reason why I would like to do this is because having fewer bugs in > bugzilla makes it easier to prioritize bug fixing (and not losing track > of important issues). A move like this would eliminate bugs that have a > really low chance of otherwise ever getting closed, and therefore only > contribute negatively by adding noise. > > So let me know what you think about that. In the mean time, if you do > have some time, please take another look at bugs that are waiting on you > and maybe give some feedback on whether an issue is still present or > perhaps some information that would help: > > https://bugzilla.mcs.anl.gov/swift/buglist.cgi?bug_status=WAITING%20FOR% > 20USER%20INPUT > > Mihael > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From wilde at anl.gov Sun Oct 19 20:50:27 2014 From: wilde at anl.gov (Michael Wilde) Date: Sun, 19 Oct 2014 20:50:27 -0500 Subject: [Swift-devel] 0.96 plans In-Reply-To: <1413767912.16237.19.camel@echo> References: <1413767912.16237.19.camel@echo> Message-ID: <54446A63.1020700@anl.gov> Mihael, this all looks good. We should make 0.96 RC 1 very soon. Doing enhancement bug 23 is OK as long as its low-impact/low-risk. -Mike On 10/19/14 8:18 PM, Mihael Hategan wrote: > Hi, > > I wanted to send out an email to start a discussion about 0.96. > > I think we currently agreed that: > - we will relase 0.95 as is and make patch releases if major bugs are > uncovered > - 0.96 should get a feature freeze right about now-ish; however, I ask > for two exceptions: > * a simple solution to bug #23: a function to test whether a piece > of data is failed (e.g. isFailed(var)). > * a resolution to bug #1275 > - the tasks needed before release are somewhere around: > * better testing coverage > * documentation improvements > * testing and fixing of the new monitoring tools > * bugs cleanup > > Mihael > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From hategan at mcs.anl.gov Sun Oct 19 21:46:29 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Sun, 19 Oct 2014 19:46:29 -0700 Subject: [Swift-devel] unfixable bugs In-Reply-To: <54446A24.40702@anl.gov> References: <1413768016.16237.21.camel@echo> <54446A24.40702@anl.gov> Message-ID: <1413773189.17781.5.camel@echo> On Sun, 2014-10-19 at 20:49 -0500, Michael Wilde wrote: > A waiting time for these is OK by me, but that should only apply to > bugs, not enhancements. I completely agree if the enhancement request is clearly formulated, but I would like to avoid bugs of the "improve swift" form. That said, I do assume that there will be exceptions that we would deal with on a case-by-case basis. > > I'd like to see some of the "waiting for user input" bugs move to some > kind of "needs test" status (eg bug 913 which you just updated). Thats > a good example of a stress test thats needed. > > Also, instead of "automatically" closing these, maybe have a report that > flags bugs whose waiting for user input time has expired? We could have a WILL_EXPIRE_IN_ONE_WEEK. But then we could simply re-open bugs to object to the expiration. The point is that this forces us to periodically re-evaluate issues. We should also agree on a reasonable expiration time. In other words, how much should a bug be in a WAIT state before we "expire" it? Mihael From hategan at mcs.anl.gov Sun Oct 19 21:47:50 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Sun, 19 Oct 2014 19:47:50 -0700 Subject: [Swift-devel] 0.96 plans In-Reply-To: <54446A63.1020700@anl.gov> References: <1413767912.16237.19.camel@echo> <54446A63.1020700@anl.gov> Message-ID: <1413773270.17781.7.camel@echo> On Sun, 2014-10-19 at 20:50 -0500, Michael Wilde wrote: > Mihael, this all looks good. We should make 0.96 RC 1 very soon. > > Doing enhancement bug 23 is OK as long as its low-impact/low-risk. It's an enhancement that consists of small new code that does not affect anything else. It would be similar (in both scope and difficulty) to adding an exp() function. Mihael From davidkelly at uchicago.edu Sun Oct 19 21:54:23 2014 From: davidkelly at uchicago.edu (David Kelly) Date: Sun, 19 Oct 2014 21:54:23 -0500 Subject: [Swift-devel] 0.96 plans In-Reply-To: <1413767912.16237.19.camel@echo> References: <1413767912.16237.19.camel@echo> Message-ID: Hello, Just curious how bug 1347 fits into the 0.95 release plans? Would that be considered a major bug worth delaying the 0.95 release? On Sun, Oct 19, 2014 at 8:18 PM, Mihael Hategan wrote: > Hi, > > I wanted to send out an email to start a discussion about 0.96. > > I think we currently agreed that: > - we will relase 0.95 as is and make patch releases if major bugs are > uncovered > - 0.96 should get a feature freeze right about now-ish; however, I ask > for two exceptions: > * a simple solution to bug #23: a function to test whether a piece > of data is failed (e.g. isFailed(var)). > * a resolution to bug #1275 > - the tasks needed before release are somewhere around: > * better testing coverage > * documentation improvements > * testing and fixing of the new monitoring tools > * bugs cleanup > > Mihael > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > -------------- next part -------------- An HTML attachment was scrubbed... URL: From wilde at anl.gov Sun Oct 19 22:17:02 2014 From: wilde at anl.gov (Michael Wilde) Date: Sun, 19 Oct 2014 22:17:02 -0500 Subject: [Swift-devel] 0.96 plans In-Reply-To: References: <1413767912.16237.19.camel@echo> Message-ID: <54447EAE.3090103@anl.gov> On 10/19/14 9:54 PM, David Kelly wrote: > Hello, > > Just curious how bug 1347 fits into the 0.95 release plans? Would that > be considered a major bug worth delaying the 0.95 release? David, I think we should fix it independent of the release, but as soon as possible, creating a 0.95.1 for it if needed. - Mike > > On Sun, Oct 19, 2014 at 8:18 PM, Mihael Hategan > wrote: > > Hi, > > I wanted to send out an email to start a discussion about 0.96. > > I think we currently agreed that: > - we will relase 0.95 as is and make patch releases if major bugs are > uncovered > - 0.96 should get a feature freeze right about now-ish; however, I ask > for two exceptions: > * a simple solution to bug #23: a function to test whether a piece > of data is failed (e.g. isFailed(var)). > * a resolution to bug #1275 > - the tasks needed before release are somewhere around: > * better testing coverage > * documentation improvements > * testing and fixing of the new monitoring tools > * bugs cleanup > > Mihael > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Mon Oct 20 03:13:00 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Mon, 20 Oct 2014 01:13:00 -0700 Subject: [Swift-devel] 0.96 plans In-Reply-To: References: <1413767912.16237.19.camel@echo> Message-ID: <1413792780.19591.2.camel@echo> On Sun, 2014-10-19 at 21:54 -0500, David Kelly wrote: > Hello, > > Just curious how bug 1347 fits into the 0.95 release plans? Would that be > considered a major bug worth delaying the 0.95 release? It's for 0.96. An no, it's not a major bug worth delaying anything. I just think it's a reasonable thing that can be done with not so much effort that goes a bit of a way towards addressing an issue otherwise rather difficult to solve in Swift. A judgment call. Feel free to tell me to focus on something else. Mihael From hategan at mcs.anl.gov Mon Oct 20 03:42:02 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Mon, 20 Oct 2014 01:42:02 -0700 Subject: [Swift-devel] 0.96 plans In-Reply-To: <1413792780.19591.2.camel@echo> References: <1413767912.16237.19.camel@echo> <1413792780.19591.2.camel@echo> Message-ID: <1413794522.20028.3.camel@echo> I apologize. I thought we were talking about 1275. Re 1347, I agree entirely with what Mike says. Mihael On Mon, 2014-10-20 at 01:13 -0700, Mihael Hategan wrote: > On Sun, 2014-10-19 at 21:54 -0500, David Kelly wrote: > > Hello, > > > > Just curious how bug 1347 fits into the 0.95 release plans? Would that be > > considered a major bug worth delaying the 0.95 release? > > It's for 0.96. An no, it's not a major bug worth delaying anything. I > just think it's a reasonable thing that can be done with not so much > effort that goes a bit of a way towards addressing an issue otherwise > rather difficult to solve in Swift. A judgment call. Feel free to tell > me to focus on something else. > > Mihael > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel From wilde at anl.gov Mon Oct 20 08:58:42 2014 From: wilde at anl.gov (Michael Wilde) Date: Mon, 20 Oct 2014 08:58:42 -0500 Subject: [Swift-devel] 0.96 plans In-Reply-To: <1413794522.20028.3.camel@echo> References: <1413767912.16237.19.camel@echo> <1413792780.19591.2.camel@echo> <1413794522.20028.3.camel@echo> Message-ID: <54451512.1000006@anl.gov> I think Yadu had some traction on reproducing bug 1347. Lets try to get it resolved in tandem with getting 0.95 RC 7 released as 0.95. - Mike On 10/20/14 3:42 AM, Mihael Hategan wrote: > I apologize. I thought we were talking about 1275. > > Re 1347, I agree entirely with what Mike says. > > Mihael > > On Mon, 2014-10-20 at 01:13 -0700, Mihael Hategan wrote: >> On Sun, 2014-10-19 at 21:54 -0500, David Kelly wrote: >>> Hello, >>> >>> Just curious how bug 1347 fits into the 0.95 release plans? Would that be >>> considered a major bug worth delaying the 0.95 release? >> It's for 0.96. An no, it's not a major bug worth delaying anything. I >> just think it's a reasonable thing that can be done with not so much >> effort that goes a bit of a way towards addressing an issue otherwise >> rather difficult to solve in Swift. A judgment call. Feel free to tell >> me to focus on something else. >> >> Mihael >> >> _______________________________________________ >> Swift-devel mailing list >> Swift-devel at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From wilde at anl.gov Tue Oct 21 14:08:40 2014 From: wilde at anl.gov (Michael Wilde) Date: Tue, 21 Oct 2014 14:08:40 -0500 Subject: [Swift-devel] trunk coaster service does not honor SWIFT_USERHOME ? Message-ID: <5446AF38.6030105@anl.gov> Im seeing the error below on the Titan Cray system (trying to write a log to my home dir instead of the SWIFT_USERHOME dir). Did the name of that var or the means of specifying it change in trunk? Thanks, - Mike T$ aprun /bin/sh -c "pwd; SWIFT_USERHOME=$PWD coaster-service -p 50001 -localport 50002 -nosec -passive" /lustre/atlas/proj-shared/mat049/wildemj/swift/lab/swiftaprun Switching log to: cps-2014-10-21_14-56-51.log 2014-10-21 14:56:51,454-0400 WARN CoasterPersistentService Switching log to: cps-2014-10-21_14-56-51.log CoasterService fatal error: Exception caught in block processor java.io.IOException: Failed to create script dir (/ccs/home/wildemj/.globus/coasters) at org.globus.cog.abstraction.coaster.service.job.manager.ScriptManager.writeScript(ScriptManager.java:46) at org.globus.cog.abstraction.coaster.service.job.manager.BlockQueueProcessor.run(BlockQueueProcessor.java:161) Started coaster service: http://10.128.14.193:50001 Worker connection URL: http://10.128.14.193:50002 Exception caught in block processor java.io.IOException: Failed to create script dir (/ccs/home/wildemj/.globus/coasters) at org.globus.cog.abstraction.coaster.service.job.manager.ScriptManager.writeScript(ScriptManager.java:46) at org.globus.cog.abstraction.coaster.service.job.manager.BlockQueueProcessor.run(BlockQueueProcessor.java:161) Shutting down service... Application 7960371 exit codes: 13 Application 7960371 resources: utime ~1s, stime ~1s, Rss ~27892, inblocks ~27355, outblocks ~1143 -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From hategan at mcs.anl.gov Tue Oct 21 14:37:00 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 21 Oct 2014 12:37:00 -0700 Subject: [Swift-devel] trunk coaster service does not honor SWIFT_USERHOME ? In-Reply-To: <5446AF38.6030105@anl.gov> References: <5446AF38.6030105@anl.gov> Message-ID: <1413920220.7074.4.camel@echo> Hi, In a chat with Mike we are addressing the issue. I will summarize here for future reference. - bin/coaster-service never honored SWIFT_USERHOME. - bin/swift checks if that variable is set and starts java with -Duser.home=$SWIFT_USERHOME The solution was to edit coaster-service to start java with -Duser.home= $SWIFT_USERHOME. Mihael On Tue, 2014-10-21 at 14:08 -0500, Michael Wilde wrote: > Im seeing the error below on the Titan Cray system (trying to write a > log to my home dir instead of the SWIFT_USERHOME dir). Did the name of > that var or the means of specifying it change in trunk? > > Thanks, > > - Mike > > T$ aprun /bin/sh -c "pwd; SWIFT_USERHOME=$PWD coaster-service -p 50001 > -localport 50002 -nosec -passive" > /lustre/atlas/proj-shared/mat049/wildemj/swift/lab/swiftaprun > Switching log to: cps-2014-10-21_14-56-51.log > 2014-10-21 14:56:51,454-0400 WARN CoasterPersistentService Switching > log to: cps-2014-10-21_14-56-51.log > CoasterService fatal error: > Exception caught in block processor > java.io.IOException: Failed to create script dir > (/ccs/home/wildemj/.globus/coasters) > at > org.globus.cog.abstraction.coaster.service.job.manager.ScriptManager.writeScript(ScriptManager.java:46) > at > org.globus.cog.abstraction.coaster.service.job.manager.BlockQueueProcessor.run(BlockQueueProcessor.java:161) > Started coaster service: http://10.128.14.193:50001 > Worker connection URL: http://10.128.14.193:50002 > Exception caught in block processor > java.io.IOException: Failed to create script dir > (/ccs/home/wildemj/.globus/coasters) > at > org.globus.cog.abstraction.coaster.service.job.manager.ScriptManager.writeScript(ScriptManager.java:46) > at > org.globus.cog.abstraction.coaster.service.job.manager.BlockQueueProcessor.run(BlockQueueProcessor.java:161) > Shutting down service... > Application 7960371 exit codes: 13 > Application 7960371 resources: utime ~1s, stime ~1s, Rss ~27892, > inblocks ~27355, outblocks ~1143 > > From wilde at anl.gov Wed Oct 22 09:11:59 2014 From: wilde at anl.gov (Michael Wilde) Date: Wed, 22 Oct 2014 09:11:59 -0500 Subject: [Swift-devel] How to select the name of the swift run dir in trunk version Message-ID: <5447BB2F.6090707@anl.gov> Hi All, Is there a way to tell trunk swift to use a specific run directory? Thanks, - Mike -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From hategan at mcs.anl.gov Wed Oct 22 14:12:40 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 22 Oct 2014 12:12:40 -0700 Subject: [Swift-devel] How to select the name of the swift run dir in trunk version In-Reply-To: <5447BB2F.6090707@anl.gov> References: <5447BB2F.6090707@anl.gov> Message-ID: <1414005160.18465.0.camel@echo> I think this is the same situation as in 0.95 and the answer is "no". We should add an option for that. Mihael On Wed, 2014-10-22 at 09:11 -0500, Michael Wilde wrote: > Hi All, > > Is there a way to tell trunk swift to use a specific run directory? > > Thanks, > > - Mike > From wilde at anl.gov Wed Oct 22 14:14:49 2014 From: wilde at anl.gov (Michael Wilde) Date: Wed, 22 Oct 2014 14:14:49 -0500 Subject: [Swift-devel] How to select the name of the swift run dir in trunk version In-Reply-To: <1414005160.18465.0.camel@echo> References: <5447BB2F.6090707@anl.gov> <1414005160.18465.0.camel@echo> Message-ID: <54480229.4050805@anl.gov> Sounds good. I ask this for use in a script that forms a scheduler job for a swift run. The script involved a scheduler submit script. a swift.conf file, persistent coaster logs. etc, and the thought is that all these things should go in the same run directory. - Mike On 10/22/14 2:12 PM, Mihael Hategan wrote: > I think this is the same situation as in 0.95 and the answer is "no". We > should add an option for that. > > Mihael > > On Wed, 2014-10-22 at 09:11 -0500, Michael Wilde wrote: >> Hi All, >> >> Is there a way to tell trunk swift to use a specific run directory? >> >> Thanks, >> >> - Mike >> > -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From wilde at anl.gov Thu Oct 23 18:45:37 2014 From: wilde at anl.gov (Michael Wilde) Date: Thu, 23 Oct 2014 18:45:37 -0500 Subject: [Swift-devel] Problems calling java.lang.String format method Message-ID: <54499321.7080509@anl.gov> Im trying to call .format( ) from java.lang.String, from the Swift function java( ). Is it possible to call Java functions whose args are typed Object? (such as .format) From this code: // String result = String.format("%4d", i * j); string result = java("java.lang.String","format","%4d",9876); tracef("result=%s\n", result); I get the error below, which suggests that the java( ) function can only find a fairly narrow range of methods whose signatures exactly match the signature that the Swift args are directly mapped to. T$ swift s.swift Swift trunk git-rev: 870bd2114e6bdcab18278d44208defbf7c077fdc heads/master 6143 RunID: run013 Progress: Thu, 23 Oct 2014 19:35:52-0400 java.lang.NoSuchMethodException: java.lang.String.format(java.lang.String, int) at java.lang.Class.getMethod(Class.java:1665) at org.griphyn.vdl.karajan.lib.swiftscript.Java.getMethod(Java.java:88) at org.griphyn.vdl.karajan.lib.swiftscript.Java.function(Java.java:56) at org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:77) at org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:175) at org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) at org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:165) at org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) at org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:41) at org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) at org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:91) at k.thr.LWThread.run(LWThread.java:247) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) dir=/lustre/atlas2/mat049/proj-shared/wildemj/bes-diffuse-demo-2014/swift-discus/swiftk Execution failed: @java(): Error attempting to use: java.lang.String swiftscript:java @ s, line: 51 Or better yet: is there already an undocumented sprintf( ) function (which is what Im trying to do here). Thanks, - Mike -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From wozniak at mcs.anl.gov Thu Oct 23 19:23:23 2014 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Thu, 23 Oct 2014 19:23:23 -0500 Subject: [Swift-devel] Problems calling java.lang.String format method In-Reply-To: <54499321.7080509@anl.gov> References: <54499321.7080509@anl.gov> Message-ID: <54499BFB.5060407@mcs.anl.gov> Yes, there is a sprintf(). There are a few uses in the test suite. I'm not sure what to do about methods on Object but we could discuss on the call tomorrow. On 10/23/2014 06:45 PM, Michael Wilde wrote: > Im trying to call .format( ) from java.lang.String, from the Swift > function java( ). > > Is it possible to call Java functions whose args are typed Object? (such > as .format) > > From this code: > > // String result = String.format("%4d", i * j); > > string result = java("java.lang.String","format","%4d",9876); > tracef("result=%s\n", result); > > I get the error below, which suggests that the java( ) function can only > find a fairly narrow range of methods whose signatures exactly match the > signature that the Swift args are directly mapped to. > > T$ swift s.swift > Swift trunk git-rev: 870bd2114e6bdcab18278d44208defbf7c077fdc > heads/master 6143 > RunID: run013 > Progress: Thu, 23 Oct 2014 19:35:52-0400 > java.lang.NoSuchMethodException: > java.lang.String.format(java.lang.String, int) > at java.lang.Class.getMethod(Class.java:1665) > at org.griphyn.vdl.karajan.lib.swiftscript.Java.getMethod(Java.java:88) > at org.griphyn.vdl.karajan.lib.swiftscript.Java.function(Java.java:56) > at > org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:77) > at > org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:175) > at > org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) > at > org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:165) > at > org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) > at > org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:41) > at > org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) > at > org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:91) > at k.thr.LWThread.run(LWThread.java:247) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > dir=/lustre/atlas2/mat049/proj-shared/wildemj/bes-diffuse-demo-2014/swift-discus/swiftk > > Execution failed: > @java(): Error attempting to use: java.lang.String > swiftscript:java @ s, line: 51 > > Or better yet: is there already an undocumented sprintf( ) function > (which is what Im trying to do here). > > Thanks, > > - Mike > > > -- Justin M Wozniak From wilde at anl.gov Thu Oct 23 19:23:29 2014 From: wilde at anl.gov (Michael Wilde) Date: Thu, 23 Oct 2014 19:23:29 -0500 Subject: [Swift-devel] Problems calling java.lang.String format method In-Reply-To: <54499321.7080509@anl.gov> References: <54499321.7080509@anl.gov> Message-ID: <54499C01.6010904@anl.gov> To clarify: On 10/23/14 6:45 PM, Michael Wilde wrote: > Or better yet: is there already an undocumented sprintf( ) function > (which is what Im trying to do here). I forgot: I was aware of the current Swift sprintf. But I need a sprintf that provides the standard format codes so that I can control field width for forming file names from data values. Swift K's current sprintf( ) is very limited. Swift T's is like the C standard, which is what I need. I hacked the capability I needed by calling the shell builtin printf as an app, but that's not so pretty because I can't call an app with "var args". - Mike -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From hategan at mcs.anl.gov Fri Oct 24 03:32:09 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 24 Oct 2014 01:32:09 -0700 Subject: [Swift-devel] Problems calling java.lang.String format method In-Reply-To: <54499321.7080509@anl.gov> References: <54499321.7080509@anl.gov> Message-ID: <1414139529.2465.5.camel@echo> I changed java() to accept arrays, be able to wrap primitives, and invoke methods with varargs, either as arrays or not. Both of the following should now work: string r1 = java("java.lang.String", "format", "%4d", [9876]); string r2 = java("java.lang.String", "format", "%4d", 9876); This wasn't easy. There are many rules that the java compiler follows to find the right method to invoke, and Class.getMethod(...) does very little of that. For example, f(1) could match either f(int), or f(Integer) or f(Object) or f(Object...) (which really is just f(Object[])). The more parameters, the more combinations possible. I'm not entirely sure about the end product, so it will have to get some testing. But we should really fix sprintf(). Mihael On Thu, 2014-10-23 at 18:45 -0500, Michael Wilde wrote: > Im trying to call .format( ) from java.lang.String, from the Swift > function java( ). > > Is it possible to call Java functions whose args are typed Object? (such > as .format) > > From this code: > > // String result = String.format("%4d", i * j); > > string result = java("java.lang.String","format","%4d",9876); > tracef("result=%s\n", result); > > I get the error below, which suggests that the java( ) function can only > find a fairly narrow range of methods whose signatures exactly match the > signature that the Swift args are directly mapped to. > > T$ swift s.swift > Swift trunk git-rev: 870bd2114e6bdcab18278d44208defbf7c077fdc > heads/master 6143 > RunID: run013 > Progress: Thu, 23 Oct 2014 19:35:52-0400 > java.lang.NoSuchMethodException: > java.lang.String.format(java.lang.String, int) > at java.lang.Class.getMethod(Class.java:1665) > at org.griphyn.vdl.karajan.lib.swiftscript.Java.getMethod(Java.java:88) > at org.griphyn.vdl.karajan.lib.swiftscript.Java.function(Java.java:56) > at > org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:77) > at > org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:175) > at > org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) > at > org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:165) > at > org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) > at > org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:41) > at > org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:110) > at > org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:91) > at k.thr.LWThread.run(LWThread.java:247) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) > dir=/lustre/atlas2/mat049/proj-shared/wildemj/bes-diffuse-demo-2014/swift-discus/swiftk > > Execution failed: > @java(): Error attempting to use: java.lang.String > swiftscript:java @ s, line: 51 > > Or better yet: is there already an undocumented sprintf( ) function > (which is what Im trying to do here). > > Thanks, > > - Mike > > > From iraicu at cs.iit.edu Fri Oct 24 18:55:32 2014 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Fri, 24 Oct 2014 18:55:32 -0500 Subject: [Swift-devel] CFP: IEEE Cluster 2015 -- Chicago IL September 8-11 2015 Message-ID: <544AE6F4.7080506@cs.iit.edu> IEEE International Conference on Cluster Computing September 8-11, 2015 Chicago, IL, USA https://press3.mcs.anl.gov/ieeecluster2015/ ---------------------------------------------- ...Follow us on Facebook athttps://www.facebook.com/ieee.cluster ...Follow us on Twitter athttps://twitter.com/IEEECluster ...Follow us on Linkedin at https://www.linkedin.com/groups/IEEE-International-Conference-on-Cluster-7428925 ...Follow us on RenRen athttp://page.renren.com/601871401 ---------------------------------------------- CALL FOR PAPERS Following the successes of the series of Cluster conferences, for 2015 we solicit high-quality original papers presenting work that advances the state-of-the-art in clusters and closely related fields. All papers will be rigorously peer-reviewed for their originality, technical depth and correctness, potential impact, relevance to the conference, and quality of presentation. Research papers must clearly demonstrate research contributions and novelty, while papers reporting experience must clearly describe lessons learned and impact, along with the utility of the approach compared to the ones in the past. PAPER TRACKS * Applications, Algorithms, and Libraries * Architecture, Networks/Communication, and Management * Programming and Systems Software * Data, Storage, and Visualization PROCEEDINGS: Proceedings of the conference and workshops will be available online when the conference starts and will be submitted to IEEE Xplore and for EI indexing. SPECIAL JOURNAL ISSUE: The best papers of Cluster 2015 will be included in a Special Issue on advances in topics related to cluster computing of the Elsevier International Journal of Parallel Computing (PARCO), edited by Pavan Balaji, Satoshi Matsuoka, and Michela Taufer. This special issue is dedicated for the papers accepted in the Cluster 2015 conference. The submission to this special issue is by invitation only. IMPORTANT DATES September 27, 2014 .... Submissions open for Workshops January 1, 2015 ........... Submissions open for Papers, Posters, and Tutorials February 27, 2015 ....... Papers Submission Deadline April 23, 2015 ............... Papers Acceptance Notification May 1, 2015 ................. Posters Submission Deadline May 1, 2015 ................. Submissions open for Student Mentoring Program June 1, 2015 ................ Student Mentoring Program Notification (Round 1) June 15, 2015 .............. Posters Acceptance Notification June 15, 2015 .............. Student Mentoring Program Notification (Round 2) June 29, 2015 .............. Student Mentoring Program Notification (Round 3) July 13, 2015 ............... Student Mentoring Program Notification (Round 4) July 13, 2015 ............... Student Mentoring Program NSF Grant Notification August 1, 2015 ............ Camera-ready Copy Deadline for Papers, Posters, and Workshops Workshop/Tutorial proposals are selected and notifications are sent on a first-come basis. SUBMISSION GUIDELINES Authors are invited to submit papers electronically in PDF format. Submitted manuscripts should be structured as technical papers and may not exceed 10 letter-size (8.5 x 11) pages including figures, tables and references using the IEEE format for conference proceedings. Submissions not conforming to these guidelines may be returned without review. Authors should make sure that their file will print on a printer that uses letter-size (8.5 x 11) paper. The official language of the conference is English. All manuscripts will be reviewed and will be judged on correctness, originality, technical strength, significance, quality of presentation, and interest and relevance to the conference attendees. Paper submissions are limited to 10 pages in 2-column IEEE format including all figures and references. Submitted manuscripts exceeding this limit will be returned without review. For the final camera-ready version, authors with accepted papers may purchase additional pages at the following rates: 200 USD for each of two additional pages. See formatting templates for details: * LaTex Package http://datasys.cs.iit.edu/events/CCGrid2014/IEEECS_confs_LaTeX.zip * Word Template http://datasys.cs.iit.edu/events/CCGrid2014/instruct8.5x11x2.doc Submitted papers must represent original unpublished research that is not currently under review for any other conference or journal. Papers not following these guidelines will be rejected without review and further action may be taken, including (but not limited to) notifications sent to the heads of the institutions of the authors and sponsors of the conference. Submissions received after the due date, exceeding the page limit, or not appropriately structured may not be considered. Authors may contact the conference chairs for more information. The proceedings will be published through the IEEE Computer Society Conference Publishing Services. ORGANIZATION:: - General Co-chairs: Pavan Balaji (Argonne National Laboratory, USA), Michela Taufer (University of Delaware, USA) - Program Chair: Satoshi Matsuoka (Tokyo Institute of Technology, USA) - Posters Chair: Seetharami Seelam (IBM, USA) - Proceedings Chair: Antonino Tumeo (Pacific Northwest National Laboratory, USA) - Workshops and Tutorials Chair: Bronis de Supinski (Lawrence Livermore National Laboratory, USA) - Panels Chair: Alice Koniges (Lawrence Berkeley National Laboratory, USA) - Mentoring Program Chair: Luc Boug? (?cole Normale Sup?rieure de Rennes, France) - Track Chairs: * Applications, Algorithms, and Libraries - Richard Vuduc (Georgia Tech, USA) * Architecture, Networks/Communication, and Management - Todd Gamblin (Lawrence Livermore National Laboratory, USA) * Programming and System Software - Naoya Maruyama (Riken AICS, Japan) * Data, Storage, and Visualization - Gabriel Antoniu (INRIA, France) MORE INFORMATION: For more information, contact Pavan Balaji (balaji at anl.gov) or Michela Taufer (taufer at udel.edu). -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Editor: IEEE TCC, Springer Cluster, Springer JoCCASA Chair: IEEE/ACM MTAGS, ACM ScienceCloud ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ LinkedIn: http://www.linkedin.com/in/ioanraicu Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ ================================================================= ================================================================= From tim.g.armstrong at gmail.com Wed Oct 29 14:59:59 2014 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Wed, 29 Oct 2014 14:59:59 -0500 Subject: [Swift-devel] IBM Jsee2 Message-ID: The following import was added to src/org/griphyn/vdl/util/SwiftConfig.java recently: import com.ibm.jsse2.sc; This seems to be preventing me from compiling Swift. Is this a bug? I'm using this verison of Java: [~]$ java -version java version "1.7.0_25" OpenJDK Runtime Environment (IcedTea 2.3.10) (7u25-2.3.10-1ubuntu0.12.04.2) OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode) - Tim -------------- next part -------------- An HTML attachment was scrubbed... URL: From tim.g.armstrong at gmail.com Wed Oct 29 15:02:30 2014 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Wed, 29 Oct 2014 15:02:30 -0500 Subject: [Swift-devel] IBM Jsee2 In-Reply-To: References: Message-ID: Never mind, I think I see what happened - the import was added by the IDE incorrectly. I'll remove it myself. Cheers, Tim On Wed, Oct 29, 2014 at 2:59 PM, Tim Armstrong wrote: > The following import was added to > src/org/griphyn/vdl/util/SwiftConfig.java recently: > > import com.ibm.jsse2.sc; > > This seems to be preventing me from compiling Swift. Is this a bug? > > I'm using this verison of Java: > > [~]$ java > -version > java version "1.7.0_25" > OpenJDK Runtime Environment (IcedTea 2.3.10) (7u25-2.3.10-1ubuntu0.12.04.2) > OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode) > > > - Tim > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Wed Oct 29 15:21:29 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 29 Oct 2014 13:21:29 -0700 Subject: [Swift-devel] IBM Jsee2 In-Reply-To: References: Message-ID: <1414614089.8615.0.camel@echo> Ooops, yes. Sorry. Didn't notice it. I usually optimize imports and look at the diffs before committing, but this slipped through. Mihael On Wed, 2014-10-29 at 15:02 -0500, Tim Armstrong wrote: > Never mind, I think I see what happened - the import was added by the IDE > incorrectly. I'll remove it myself. > > Cheers, > Tim > > On Wed, Oct 29, 2014 at 2:59 PM, Tim Armstrong > wrote: > > > The following import was added to > > src/org/griphyn/vdl/util/SwiftConfig.java recently: > > > > import com.ibm.jsse2.sc; > > > > This seems to be preventing me from compiling Swift. Is this a bug? > > > > I'm using this verison of Java: > > > > [~]$ java > > -version > > java version "1.7.0_25" > > OpenJDK Runtime Environment (IcedTea 2.3.10) (7u25-2.3.10-1ubuntu0.12.04.2) > > OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode) > > > > > > - Tim > > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel From davidkelly at uchicago.edu Wed Oct 29 18:50:17 2014 From: davidkelly at uchicago.edu (David Kelly) Date: Wed, 29 Oct 2014 18:50:17 -0500 Subject: [Swift-devel] OS X Yosemite Message-ID: Hello, This weekend I upgraded to OS X Yosemite. Today I was trying to run Swift on my laptop and got: $ swift -version xcrun: error: active developer path ("/Library/Developer/CommandLineTools") does not exist, use `xcode-select --switch path/to/Xcode.app` to specify the Xcode that you wish to use for command line developer tools (or see `man xcode-select`) Took me a second to figure out what was going on there. There is now a /usr/bin/swift command related to Apple's new Swift programming language. The fix is just to adjust PATH so Swift's installation directory is added before /usr/bin. Finder also recognizes and tries to open any files with a .swift extension in the mac code editor. Not a huge issue, but perhaps a potential source of confusion for new users. -------------- next part -------------- An HTML attachment was scrubbed... URL: From dsk at uchicago.edu Wed Oct 29 19:10:58 2014 From: dsk at uchicago.edu (Daniel S. Katz) Date: Wed, 29 Oct 2014 20:10:58 -0400 Subject: [Swift-devel] OS X Yosemite In-Reply-To: References: Message-ID: Sounds like something to make sure goes in the documentation. Dan > On Oct 29, 2014, at 7:50 PM, David Kelly wrote: > > Hello, > > This weekend I upgraded to OS X Yosemite. Today I was trying to run Swift on my laptop and got: > $ swift -version > > xcrun: error: active developer path ("/Library/Developer/CommandLineTools") does not exist, use `xcode-select --switch path/to/Xcode.app` to specify the Xcode that you wish to use for command line developer tools (or see `man xcode-select`) > > Took me a second to figure out what was going on there. There is now a /usr/bin/swift command related to Apple's new Swift programming language. The fix is just to adjust PATH so Swift's installation directory is added before /usr/bin. Finder also recognizes and tries to open any files with a .swift extension in the mac code editor. > > Not a huge issue, but perhaps a potential source of confusion for new users. > > _______________________________________________ > Swift-devel mailing list > Swift-devel at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel -- Daniel S. Katz University of Chicago (773) 834-7186 (voice) (773) 834-6818 (fax) d.katz at ieee.org or dsk at uchicago.edu http://www.ci.uchicago.edu/~dsk/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From tim.g.armstrong at gmail.com Fri Oct 31 10:53:21 2014 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Fri, 31 Oct 2014 10:53:21 -0500 Subject: [Swift-devel] maxParallelTasks in userguide Message-ID: The user guide states that the default value of maxParallelTasks is 2. Is that correct? In the code it looks like it's based on the formula jobThrottle * 100 + 1. If the default value of jobThrottle is 2, that should be 201, right? http://swift-lang.org/guides/trunk/userguide/userguide.html#_configuration_file_structure - Tim -------------- next part -------------- An HTML attachment was scrubbed... URL: From hategan at mcs.anl.gov Fri Oct 31 13:28:16 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Fri, 31 Oct 2014 11:28:16 -0700 Subject: [Swift-devel] maxParallelTasks in userguide In-Reply-To: References: Message-ID: <1414780096.15144.3.camel@echo> On Fri, 2014-10-31 at 10:53 -0500, Tim Armstrong wrote: > The user guide states that the default value of maxParallelTasks is 2. Is > that correct? That's what the new config sets it to. > In the code it looks like it's based on the formula > jobThrottle * 100 + 1. If the default value of jobThrottle is 2, that > should be 201, right? Yes, *if*. But I believe jobThrottle is set from maxParallelTasks, not the other way around. It is though a discrepancy, and I'm not sure how it came to be. Did anybody else know how we jumped from a jobThrottle of 2 to one of 0.02? Mihael