From iraicu at cs.iit.edu Mon Sep 5 12:41:50 2011 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Mon, 05 Sep 2011 12:41:50 -0500 Subject: [Swift-user] ACM MTAGS 2011: deadline extension to September 26th Message-ID: <4E6509DE.7090204@cs.iit.edu> CALL FOR PAPERS 4th Workshop on Many-Task Computing on Grids and Supercomputers (MTAGS) 2011 http://datasys.cs.iit.edu/events/MTAGS11/index.html http://sc11.supercomputing.org/schedule/event_detail.php?evid=wksp122 ***DEADLINE EXTENSION -- September 26th, 2011* The 4th workshop on Many-Task Computing on Grids and Supercomputers (MTAGS11) will provide the scientific community a dedicated forum for presenting new research, development, and deployment efforts of large-scale many-task computing (MTC) applications on large scale clusters, Grids, Supercomputers, and Cloud Computing infrastructure. MTC, the theme of the workshop encompasses loosely coupled applications, which are generally composed of many tasks (both independent and dependent tasks) to achieve some larger application goal. This workshop will cover challenges that can hamper efficiency and utilization in running applications on large-scale systems, such as local resource manager scalability and granularity, efficient utilization of raw hardware, parallel file system contention and scalability, data management, I/O management, reliability at scale, and application scalability. *General Chairs (mtags11-chairs at datasys.cs.iit.edu )* * Ioan Raicu, Illinois Institute of Technology & Argonne National Laboratory, USA * Ian Foster, University of Chicago & Argonne National Laboratory, USA * Yong Zhao, University of Electronic Science and Technology of China, China -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ ================================================================= ================================================================= -------------- next part -------------- An HTML attachment was scrubbed... URL: From iraicu at cs.iit.edu Mon Sep 5 12:50:31 2011 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Mon, 05 Sep 2011 12:50:31 -0500 Subject: [Swift-user] ACM DataCloud-SC11 2011: deadline extension to September 26th Message-ID: <4E650BE7.1020700@cs.iit.edu> CALL FOR PAPERS The Second International Workshop on Data-Intensive Computing in the Clouds (DataCloud-SC11) 2011 http://datasys.cs.iit.edu/events/DataCloud-SC11/index.html http://sc11.supercomputing.org/schedule/event_detail.php?evid=wksp119 ***DEADLINE EXTENSION -- September 26th, 2011* The second international workshop on Data-intensive Computing in the Clouds (DataCloud-SC11) will provide the scientific community a dedicated forum for discussing new research, development, and deployment efforts in running data-intensive computing workloads on Cloud Computing infrastructures. The DataCloud-SC11 workshop will focus on the use of cloud-based technologies to meet the new data intensive scientific challenges that are not well served by the current supercomputers, grids or compute-intensive clouds. We believe the workshop will be an excellent place to help the community define the current state, determine future goals, and present architectures and services for future clouds supporting data intensive computing. *General Chairs (datacloud-sc11-chairs at datasys.cs.iit.edu )* * Ioan Raicu, Illinois Institute of Technology & Argonne National Laboratory, USA * Tevfik Kosar, University at Buffalo, USA * Roger Barga, Microsoft Research, USA -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ ================================================================= ================================================================= -------------- next part -------------- An HTML attachment was scrubbed... URL: From lpesce at uchicago.edu Thu Sep 8 12:00:28 2011 From: lpesce at uchicago.edu (Lorenzo Pesce) Date: Thu, 8 Sep 2011 12:00:28 -0500 (CDT) Subject: [Swift-user] Do you have any resource for learning about SwiftR? In-Reply-To: <20110907193605.AVI46842@mstore03.uchicago.edu> References: <283375835.259628.1314717726557.JavaMail.root@zimbra.anl.gov> <596328981.259897.1314720333244.JavaMail.root@zimbra.anl.gov> <20110907193605.AVI46842@mstore03.uchicago.edu> Message-ID: <20110908120028.AWC44628@mstore01.uchicago.edu> Tim, Be mindful that Beagle now has a new ALPS and scheduler. It looks like the new ALPS is behaving differently from the old one. For example, the -N flag -- one MPI per node -- seems to be broken and ignored by ALPS, while perl now seems to be capable of running multiple MPI jobs per node (before there was no way of making it do that or at least we never found one and neither did Cray). I did not have time to test either because I work someplace else today, so this is just little more than hearsay, I might be able to do it tomorrow. I plan to try to make Rmpi work and then move on from there. Lorenzo ---- Original message ---- >Date: Wed, 7 Sep 2011 19:36:05 -0500 (CDT) >From: Tim Armstrong >Subject: Re: [Swift-user] Do you have any resource for learning about SwiftR? >To: "Michael Wilde" , "Lorenzo Pesce" >Cc: "Swift-User" > >Hi, sorry for the slow response. > >The documentation is up to date and the latest release is the one pointed to. > >I'm going to try and get the new version of R running on beagle - hopefully this will solve the problems we'd been seeing finally > >- Tim > >---- Original message ---- >>Date: Tue, 30 Aug 2011 11:05:33 -0500 (CDT) >>From: Michael Wilde >>Subject: Re: [Swift-user] Do you have any resource for learning about SwiftR? >>To: Lorenzo Pesce >>Cc: Tim Armstrong , Swift-User >> >>Lorenzo, >> >>The SwiftR documentation is currently at: >> >> http://www.ci.uchicago.edu/wiki/bin/view/SWFT/SwiftR >> >>which also provides a quick start guide at: >> >> http://www.ci.uchicago.edu/wiki/bin/view/SWFT/SwiftRQuickstart >> >>Further examples and some performance measurements are at: >> >> http://people.cs.uchicago.edu/~tga/swiftR/ >> >>And more examples are available with ?SwiftR help once you load the package: >>> source("http://people.cs.uchicago.edu/~tga/swiftR/getSwift.R") >> >>I just built an R-2.13.1 release on Beagle with plain gcc, which I think *should* be runnable in parallel on worker nodes. (Not yet tested though). This R should be capable of running SwiftR. Im hoping that Tim cam verify this soon. We'll likely need an additional SwiftR server name and config for Beagle and other Cray systems. >> >>We'll try to consolidate the SwiftR documentation in a user guide on the Swift in the future. Tim, can you do a quick check of the documentation to make sure its still correct and that it points to the latest SwiftR package? >> >>Thanks, >> >>- Mike >> >> >>----- Original Message ----- >>> From: "Lorenzo Pesce" >>> To: swift-user at ci.uchicago.edu >>> Sent: Tuesday, August 30, 2011 9:22:51 AM >>> Subject: [Swift-user] Do you have any resource for learning about SwiftR? >>> Hi - >>> >>> I want to run relatively small sized simulations (say at most 50 cores >>> or so, probably mostly one or two) but many many times over. The >>> simulations will be coded in R. >>> >>> Thanks a lot! >>> >>> Lorenzo >>> _______________________________________________ >>> Swift-user mailing list >>> Swift-user at ci.uchicago.edu >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user >> >>-- >>Michael Wilde >>Computation Institute, University of Chicago >>Mathematics and Computer Science Division >>Argonne National Laboratory >> From lpesce at uchicago.edu Fri Sep 9 13:12:55 2011 From: lpesce at uchicago.edu (Lorenzo Pesce) Date: Fri, 9 Sep 2011 13:12:55 -0500 Subject: [Swift-user] Can swift run multiple MPI jobs on a Cray XE6 node? Message-ID: Hi -- If I use qsub + aprun, I can't run more than one MPI job with more than one process per node (I can run multiple openMP jobs). Or at least nobody seems to know how to do that of the people I have talked to. Supposed that I want to send a series of 8 node MPI jobs. I could conceivably put three per node (whether or not this is a good idea is a different story) if aprun would support it, but it doesn't seem to. Can swift? Lorenzo From wozniak at mcs.anl.gov Sat Sep 10 12:57:20 2011 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Sat, 10 Sep 2011 12:57:20 -0500 (Central Daylight Time) Subject: [Swift-user] Can swift run multiple MPI jobs on a Cray XE6 node? In-Reply-To: References: Message-ID: The best way to do this on the Cray is still to use aprun directly from Swift in the local provider (although I heard you were having problems with the current aprun installation on Beagle). The new MPICH/Coasters features do not provide much to help with this but I am currently working on relevant improvements, and this is a use case that we would like to cover. Justin On Fri, 9 Sep 2011, Lorenzo Pesce wrote: > Hi -- > If I use qsub + aprun, I can't run more than one MPI job with more than > one process per node (I can run multiple openMP jobs). Or at least > nobody seems to know how to do that of the people I have talked to. > > Supposed that I want to send a series of 8 node MPI jobs. I could > conceivably put three per node (whether or not this is a good idea is a > different story) if aprun would support it, but it doesn't seem to. Can > swift? > > Lorenzo > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > -- Justin M Wozniak From iraicu at cs.iit.edu Fri Sep 30 00:38:05 2011 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Fri, 30 Sep 2011 00:38:05 -0500 Subject: [Swift-user] Call for Papers and Workshops at HPDC 2012 -- The 21st International ACM Symposium on High-Performance Parallel and Distributed Computing 2012 Message-ID: <4E8555BD.9090804@cs.iit.edu> **** CALL FOR PAPERS **** **** CALL FOR WORKSHOP PROPOSALS **** The 21st International ACM Symposium on High-Performance Parallel and Distributed Computing (HPDC'12) Delft University of Technology, Delft, the Netherlands June 18-22, 2012 http://www.hpdc.org/2012 The ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) is the premier annual conference on the design, the implementation, the evaluation, and the use of parallel and distributed systems for high-end computing. HPDC'12 will take place in Delft, the Netherlands, a historical, picturesque city that is less than one hour away from Amsterdam-Schiphol airport. The conference will be held on June 20-22 (Wednesday to Friday), with affiliated workshops taking place on June 18-19 (Monday and Tuesday). **** SUBMISSION DEADLINES **** Abstracts: 16 January 2012 Papers: 23 January 2012 (No extensions!) **** HPDC'12 GENERAL CHAIR **** Dick Epema, Delft University of Technology, Delft, the Netherlands **** HPDC'12 PROGRAM CO-CHAIRS **** Thilo Kielmann, Vrije Universiteit, Amsterdam, the Netherlands Matei Ripeanu, The University of British Columbia, Vancouver, Canada **** HPDC'12 WORKSHOPS CHAIR **** Alexandru Iosup, Delft University of Technology, Delft, the Netherlands **** SCOPE AND TOPICS **** Submissions are welcomed on all forms of high-performance parallel and distributed computing, including but not limited to clusters, clouds, grids, utility computing, data-intensive computing, and massively multicore systems. Submissions that explore solutions to estimate and reduce the energy footprint of such systems are particularly encouraged. All papers will be evaluated for their originality, potential impact, correctness, quality of presentation, appropriate presentation of related work, and relevance to the conference, with a strong preference for rigorous results obtained in operational parallel and distributed systems. The topics of interest of the conference include, but are not limited to, the following, in the context of high-performance parallel and distributed computing: - Systems, networks, and architectures for high-end computing - Massively multicore systems - Virtualization of machines, networks, and storage - Programming languages and environments - I/O, storage systems, and data management - Resource management, energy and cost minimizations - Performance modeling and analysis - Fault tolerance, reliability, and availability - Data-intensive computing - Applications of parallel and distributed computing **** PAPER SUBMISSION GUIDELINES **** Authors are invited to submit technical papers of at most 12 pages in PDF format, including figures and references. Papers should be formatted in the ACM Proceedings Style and submitted via the conference web site. No changes to the margins, spacing, or font sizes as specified by the style file are allowed. Accepted papers will appear in the conference proceedings, and will be incorporated into the ACM Digital Library. A limited number of papers will be accepted as posters. Papers must be self-contained and provide the technical substance required for the program committee to evaluate their contributions. Submitted papers must be original work that has not appeared in and is not under consideration for another conference or a journal. See the ACM Prior Publication Policy for more details. **** IMPORTANT DATES **** Workshop Proposals Due: 3 October 2011 Abstracts Due: 16 January 2012 Papers Due: 23 January 2012 (No extensions!) Reviews Released to Authors: 8 March 2012 Author Rebuttals Due: 12 March 2012 Author Notifications: 19 March 2012 Final Papers Due: 16 April 2012 Conference Dates: 18-22 June 2012 **** CALL FOR WORKSHOP PROPOSALS **** Workshops affiliated with HPDC will be held on June 18-19 (Monday and Tuesday). For more information on the workshops and for the complete Call for Workshop Proposals, see the workshops page on the conference website http://www.hpdc.org/2012/workshops/call-for-workshops/. Workshops should provide forums for discussion among researchers and practitioners on focused topics or emerging research areas. Organizers may structure workshops as they see fit, possibly including invited talks, panel discussions, presentations of work in progress, fully peer-reviewed papers, or some combination. Workshops could be scheduled for a half day or a full day, depending on interest, space constraints, and organizer preference. Organizers should design workshops for approximately 20-40 participants, to balance impact and effective discussion. Workshop proposals must be sent to the HPDC'12 Workshops Chair, Alexandru Iosup, at a.iosup at tudelft.nl, and should include: - The name and acronym of the workshop - A description (0.5-1 page) of the theme of the workshop - A description (one paragraph) of the relation between the theme of the workshop and of HPDC - A list of topics of interest - The names and affiliations of the workshop organizers, and if applicable, of a significant portion of the program committee - Data about previous offerings of the workshop (if any), including the attendance, the numbers of papers or presentations submitted and accepted, and the links to the corresponding websites - A publicity plan for attracting submissions and attendees Due to publication deadlines, workshops must operate within roughly the following timeline: papers due mid February (2-3 weeks after the HPDC deadline), and selected and sent to the publisher by mid April. Important dates: Workshop Proposals Due: 3 October 2011 Notifications: 14 October 2011 Workshop CFPs Online and Distributed: 7 November 2011 -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ ================================================================= =================================================================