From chchow at uchicago.edu Tue Jul 7 16:17:36 2015 From: chchow at uchicago.edu (Chun Ho Chow) Date: Tue, 7 Jul 2015 16:17:36 -0500 Subject: [Swift-user] Installation of Swift/T on Fedora linux Message-ID: I tried installing Swift/T on Fedora, but it seems to be having some difficulty with my MPI installation. For my installation (default, using dnf on fedora) mpi.h is in /usr/include/mpich-x86_64 the rest is in /usr/lib64/mpich Setting (in exm-settings.zsh) EXM_CUSTOM_MPI=1 MPI_INCLUDE=/usr/include/mpich-x86_64 does not seem to actually cause the script to look in that directory. Is there a way to install this without going into detailed configurations? Thanks, Chun Ho Chow -------------- next part -------------- An HTML attachment was scrubbed... URL: From wozniak at mcs.anl.gov Wed Jul 8 12:12:19 2015 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Wed, 8 Jul 2015 12:12:19 -0500 Subject: [Swift-user] Installation of Swift/T on Fedora linux In-Reply-To: References: Message-ID: <559D59F3.8080106@mcs.anl.gov> Hi Sorry to hear this- did you try the manual configuration notes? http://swift-lang.org/Swift-T/guide.html#Build_configuration Justin On 07/07/2015 04:17 PM, Chun Ho Chow wrote: > I tried installing Swift/T on Fedora, but it seems to be having some > difficulty with my MPI installation. > > For my installation (default, using dnf on fedora) > mpi.h is in /usr/include/mpich-x86_64 > the rest is in /usr/lib64/mpich > > Setting (in exm-settings.zsh) > EXM_CUSTOM_MPI=1 > MPI_INCLUDE=/usr/include/mpich-x86_64 > does not seem to actually cause the script to look in that directory. > > Is there a way to install this without going into detailed configurations? > > Thanks, > Chun Ho Chow > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Justin M Wozniak -------------- next part -------------- An HTML attachment was scrubbed... URL: From ajmazurie at oenone.net Mon Jul 13 11:52:56 2015 From: ajmazurie at oenone.net (=?utf-8?Q?Aur=C3=A9lien_Mazurie?=) Date: Mon, 13 Jul 2015 10:52:56 -0600 Subject: [Swift-user] Sites configuration examples Message-ID: <3D70EE07-04D9-42D5-91C1-8B4A87F62B1B@oenone.net> Dear all, I'm still struggling with the existing Swift documentation to understand how to deploy a Swift-based test workflow outside of the desktop computer it currently (successfully) runs in. What I'm trying to achieve is a small series of test cases: (a) execution of the same workflow on a remote machine to which I have SSH access (b) execution of the same workflow on a SLURM-powered compute cluster (c) execution of the same workflow on a HTCondor compute cluster (EC2-based, and created with StarCluster) My trouble comes from the fact that most of the material I can find on the Net is pre-0.96, and refers to XML description of site configuration that I haven't successfully converted to the new aggregative, vaguely JSON-like configuration format (which is very nice, by the way; I wish other toolkits I use could have the same). I'm also confused by some snippets having compound values for the "site..execution.jobManager" property, such as "ssh-cl:local". The documentation is not very clear on these cases, nor how this variable relates to "site..execution.type". Is there such a thing as a template site configuration for the test cases listed above? Best, Aur?lien From yadunand at uchicago.edu Tue Jul 14 10:11:00 2015 From: yadunand at uchicago.edu (Yadu Nand Babuji) Date: Tue, 14 Jul 2015 10:11:00 -0500 Subject: [Swift-user] Sites configuration examples In-Reply-To: <3D70EE07-04D9-42D5-91C1-8B4A87F62B1B@oenone.net> References: <3D70EE07-04D9-42D5-91C1-8B4A87F62B1B@oenone.net> Message-ID: <55A52684.10400@uchicago.edu> Hi Aurelien, We are in between efforts to improve the swift documentation set, including those for the site-configuration. The latest tutorial documentation covers configuration in limited detail, but comes with configurations for several sites which you could use as reference. http://swift-lang.org/swift-tutorial/doc/tutorial.html In the meanwhile, we can help with any questions you might have over the swift-user list. Here are some of the configs used for the nightly tests that could also be useful: a) Run remotely via ssh: https://github.com/swift-lang/swift-k/blob/master/tests/sites/bridled/swift.conf https://github.com/swift-lang/swift-k/blob/master/tests/sites/mcs/swift.conf b) Run remotely on a cluster that uses the Slurm scheduler: https://github.com/swift-lang/swift-k/blob/master/tests/sites/midway/swift.conf https://github.com/swift-lang/swift-k/blob/master/tests/sites/stampede/swift.conf c) Run remotely on a system that uses the Condor scheduler: https://github.com/swift-lang/swift-k/blob/master/tests/sites/osgconnect/swift.conf If you do have configurations in the older *xml formats, you could use swift-convert-config. The sites..execution.jobManager property has a colon separated value as that was simply inherited from the older style. It follows this format: : This is true if you are using execution type "coasters" as will be the case for most workflows. local:local -> Run on the local machine directly. (uses fork to start workers) local:slurm -> Run on the local machine,and use slurm scheduler directives to start workers ssh-cl:slurm -> Use commandline ssh to connect to the provided URL, and use slurm directives on that machine to start workers. I do not think we have templates for the configurations you have asked for, but that is something that could be done. The closest we have are the configs that come with the tutorial and the configs I've linked to from the test-suite. Thanks, Yadu On 07/13/2015 11:52 AM, Aur?lien Mazurie wrote: > Dear all, > I'm still struggling with the existing Swift documentation to understand how to deploy a Swift-based test workflow outside of the desktop computer it currently (successfully) runs in. > > What I'm trying to achieve is a small series of test cases: > (a) execution of the same workflow on a remote machine to which I have SSH access > (b) execution of the same workflow on a SLURM-powered compute cluster > (c) execution of the same workflow on a HTCondor compute cluster (EC2-based, and created with StarCluster) > > My trouble comes from the fact that most of the material I can find on the Net is pre-0.96, and refers to XML description of site configuration that I haven't successfully converted to the new aggregative, vaguely JSON-like configuration format (which is very nice, by the way; I wish other toolkits I use could have the same). > > I'm also confused by some snippets having compound values for the "site..execution.jobManager" property, such as "ssh-cl:local". The documentation is not very clear on these cases, nor how this variable relates to "site..execution.type". > > Is there such a thing as a template site configuration for the test cases listed above? > > Best, > Aur?lien > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user From ajmazurie at oenone.net Tue Jul 14 12:02:00 2015 From: ajmazurie at oenone.net (=?utf-8?Q?Aur=C3=A9lien_Mazurie?=) Date: Tue, 14 Jul 2015 11:02:00 -0600 Subject: [Swift-user] Sites configuration examples In-Reply-To: <55A52684.10400@uchicago.edu> References: <3D70EE07-04D9-42D5-91C1-8B4A87F62B1B@oenone.net> <55A52684.10400@uchicago.edu> Message-ID: <2C9B3DBF-775C-4B99-8450-5D6113B90A8B@oenone.net> Thanks, that is extremely helpful! A quick question: I fail to deploy the bootstrap JAR to the remote machines because Swift is grabbing a hostname that is incorrect on my local machine. I thought that the 'hostName' property would fix this, but it doesn't. Is there a way to set the hostname that will be used by the remote machine to download the bootstrap JAR file? Best, Aur?lien From yadunand at uchicago.edu Tue Jul 14 12:09:44 2015 From: yadunand at uchicago.edu (Yadu Nand Babuji) Date: Tue, 14 Jul 2015 12:09:44 -0500 Subject: [Swift-user] Sites configuration examples In-Reply-To: <2C9B3DBF-775C-4B99-8450-5D6113B90A8B@oenone.net> References: <3D70EE07-04D9-42D5-91C1-8B4A87F62B1B@oenone.net> <55A52684.10400@uchicago.edu> <2C9B3DBF-775C-4B99-8450-5D6113B90A8B@oenone.net> Message-ID: <55A54258.8010905@uchicago.edu> Hi Aurelien, Could you try setting the following : export GLOBUS_HOSTNAME= You could use these to limit port if necessary: export GLOBUS_TCP_SRC_RANGE=60000,61000 export GLOBUS_TCP_PORT_RANGE=60000,61000 Thanks, Yadu On 07/14/2015 12:02 PM, Aur?lien Mazurie wrote: > Thanks, that is extremely helpful! > > A quick question: I fail to deploy the bootstrap JAR to the remote machines because Swift is grabbing a hostname that is incorrect on my local machine. I thought that the 'hostName' property would fix this, but it doesn't. Is there a way to set the hostname that will be used by the remote machine to download the bootstrap JAR file? > > Best, > Aur?lien > From ajmazurie at oenone.net Tue Jul 14 13:16:25 2015 From: ajmazurie at oenone.net (=?utf-8?Q?Aur=C3=A9lien_Mazurie?=) Date: Tue, 14 Jul 2015 12:16:25 -0600 Subject: [Swift-user] Sites configuration examples In-Reply-To: <55A54258.8010905@uchicago.edu> References: <3D70EE07-04D9-42D5-91C1-8B4A87F62B1B@oenone.net> <55A52684.10400@uchicago.edu> <2C9B3DBF-775C-4B99-8450-5D6113B90A8B@oenone.net> <55A54258.8010905@uchicago.edu> Message-ID: <9212B5C1-697F-4754-A625-C1D071BC53A3@oenone.net> This works, thanks! Is there a relationship between these environment variables and the 'hostName' and 'TCPPortRange' properties? From the documentation I thought these would do the trick. Best, Aur?lien > On Jul 14, 2015, at 11:09 AM, Yadu Nand Babuji wrote: > > Hi Aurelien, > > Could you try setting the following : > export GLOBUS_HOSTNAME= > > You could use these to limit port if necessary: > export GLOBUS_TCP_SRC_RANGE=60000,61000 > export GLOBUS_TCP_PORT_RANGE=60000,61000 > > Thanks, > Yadu > On 07/14/2015 12:02 PM, Aur?lien Mazurie wrote: >> Thanks, that is extremely helpful! >> >> A quick question: I fail to deploy the bootstrap JAR to the remote machines because Swift is grabbing a hostname that is incorrect on my local machine. I thought that the 'hostName' property would fix this, but it doesn't. Is there a way to set the hostname that will be used by the remote machine to download the bootstrap JAR file? >> >> Best, >> Aur?lien >> > From maxhutch at gmail.com Fri Jul 17 11:23:23 2015 From: maxhutch at gmail.com (Max Hutchinson) Date: Fri, 17 Jul 2015 16:23:23 +0000 Subject: [Swift-user] optional arguments of different types Message-ID: Hello, I've defined a function with two optional arguments, one int and one string: (int retcode) sweep (string prefix, file json, file tusr, string pname, float[] pvals, int nwrite, boolean legacy, int nstep, int io_step, int step_block, float io_time, float time_block, int nodes, int mode, int job_time, string analysis="RTI", int j0=0 ){ When I run, I get a warning that seems to indicate that the second optional argument is being given the string type even though its declared int: Could not start execution: k:main @ HillColl.kml, line: 1 does not have a parameter named 'swift.string.17023j0', k:named @ HillColl.kml, line: 850: k:main @ HillColl.kml, line: 1 does not have a parameter named 'swift.string.17023j0' If I change the order the optional arguments are declared in, then it thinks the string argument is an int: Could not start execution: k:main @ HillColl.kml, line: 1 does not have a parameter named 'swift.int.0analysis', k:named @ HillColl.kml, line: 850: k:main @ HillColl.kml, line: 1 does not have a parameter named 'swift.int.0analysis' Is there heavy use of optional arguments in the community? Thanks, Max -------------- next part -------------- An HTML attachment was scrubbed... URL: From iraicu at cs.iit.edu Sat Jul 25 09:12:41 2015 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Sat, 25 Jul 2015 09:12:41 -0500 Subject: [Swift-user] CFP: IEEE/ACM Int. Symp. on Big Data Computing (BDC) 2015 -- final deadline extension to August 7th Message-ID: <55B39959.2060306@cs.iit.edu> CALL FOR PAPERS --------------------------------------------------------------------------------------- 2nd IEEE/ACM International Symposium on Big Data Computing (BDC) 2015 http://datasys.cs.iit.edu/events/BDC2015/ --------------------------------------------------------------------------------------- December 7-10, 2015 St. Raphael Resort, Limassol, Cyprus Co-located with 8th IEEE/ACM International Conference on Utility and Cloud Computing ======================================================================================= Rapid advances in digital sensors, networks, storage, and computation along with their availability at low cost is leading to the creation of huge collections of data -- dubbed as Big Data. This data has the potential for enabling new insights that can change the way business, science, and governments deliver services to their consumers and can impact society as a whole. This has led to the emergence of the Big Data Computing paradigm focusing on sensing, collection, storage, management and analysis of data from variety of sources to enable new value and insights. To realize the full potential of Big Data Computing, we need to address several challenges and develop suitable conceptual and technological solutions for dealing them. These include life-cycle management of data, large-scale storage, flexible processing infrastructure, data modeling, scalable machine learning and data analysis algorithms, techniques for sampling and making trade-off between data processing time and accuracy, and dealing with privacy and ethical issues involved in data sensing, storage, processing, and actions. The International Symposium on Big Data Computing (BDC) 2015 -- held in conjunction with 8th IEEE/ACM International Conference on Utility and Cloud Computing (UCC) 2015, December 7-10, 2015, St. Raphael Resort, Limassol, Cyprus, aims at bringing together international researchers, developers, policy makers, and users and to provide an international forum to present leading research activities, technical solutions, and results on a broad range of topics related to Big Data Computing paradigms, platforms and their applications. The conference features keynotes, technical presentations, posters, and workshops. TOPICS: --------------------------------------------------------------------------------------- I. Big Data Science * Analytics * Algorithms for Big Data * Energy-efficient Algorithms * Big Data Search * Big Data Acquisition, Integration, Cleaning, and Best Practices * Visualization of Big Data II. Big Data Infrastructures and Platforms * Programming Systems * Cyber-Infrastructure * Performance evaluation * Fault tolerance and reliability * I/O and Data management * Storage Systems (including file systems, NoSQL, and RDBMS) * Resource management * Many-Task Computing * Many-core computing and accelerators III. Big Data Security and Policy * Management Policies * Data Privacy * Data Security * Big Data Archival and Preservation * Big Data Provenance IV. Big Data Applications * Scientific application cases studies on Cloud infrastructure * Big Data Applications at Scale * Experience Papers with Big Data Application Deployments * Data streaming applications * Big Data in Social Networks * Healthcare Applications * Enterprise Applications IMPORTANT DATES --------------------------------------------------------------------------------------- Papers: * Papers Due: 7 August, 2015 (HARD DEADLINE) * Author Notifications: 4 September, 2015 * Final Papers Due: 21 September, 2015 Posters * Proceedings-published posters due: 8 September, 2015 * Notification of acceptance: 18 September, 2015 * Camera-ready posters due: 21 September, 2015 PAPER SUBMISSION --------------------------------------------------------------------------------------- Authors are invited to submit papers electronically. Submitted manuscripts should be structured as technical papers and may not exceed 10 letter size (8.5 x 11) pages including figures, tables and references using the following templates (latex, pdf, doc). Authors should submit the manuscript in PDF format and make sure that the file will print on a printer that uses letter size (8.5 x 11) paper. The official language of the meeting is English. All manuscripts will be reviewed and will be judged on correctness, originality, technical strength, significance, quality of presentation, and interest and relevance to the conference attendees. Papers conforming to the above guidelines can be submitted through the BDC 2015 paper submission system (https://www.easychair.org/conferences/?conf=bdc2015). Submitted papers must represent original unpublished research that is not currently under review for any other conference or journal. Papers not following these guidelines will be rejected without review and further action may be taken, including (but not limited to) notifications sent to the heads of the institutions of the authors and sponsors of the conference. Submissions received after the due date, exceeding length limit, or not appropriately structured may also not be considered. Authors may contact the conference PC Chair for more information. Selected papers from BDC 2015 will be invited to extend and submit to the Special Issue on Big Data Computing in the IEEE Transaction on Cloud Computing. ORGANIZATION --------------------------------------------------------------------------------------- General Chairs * Rajkumar Buyya, University of Melbourne, Australia * George Angelos Papadopoulos,University of Cyprus, Cyprus Program Committee Chairs (bdc15-chairs at datasys.cs.iit.edu) * Ioan Raicu, Illinois Institute of Technology & Argonne National Laboratory, USA * Amy Apon, National Science Foundation, USA * Manish Parashar, Rutgers University, USA Program Committee Vice Chairs * Omer Rana, Cardiff University, UK * Ilkay Altintas, University of California, San Diego, USA Program Committee Members * Alexander Rasin, DePaul University, USA * Alok Choudhary, Northwestern University, USA * Abhishek Chandra, University of Minnesota, USA * Andre Luckow, BMW IT Research Center, USA * Daniel Katz, University of Chicago and Argonne National Lab, USA * Dongfang Zhao, Illinois Institute of Technology, USA * Douglas Thain, University of Notre Dame, USA * Florian Schintke, Zuse Institute Berlin, Germany * Giuliano Casale, Imperial College London, UK * Jaliya Ekanayake, Microsoft, USA * Jessica Chen-Burger, Heriot-Watt University, UK * Judy Qiu, Indiana University, USA * Justin Wozniak, Argonne National Lab, USA * Ke Wang, Illinois Institute of Technology, USA * Kesheng (John) Wu, Lawrence Berkeley National Lab, USA * Kyle Chard, University of Chicago and Argonne National Lab, USA * Lavanya Ramakrishnan, Lawrence Berkeley National Laboratory, USA * Marco Netto, IBM Research, Brazil * Matei Ripeanu, University of British Columbia, Canada * Matei Stroila, HERE, USA * Nagiza Samatova, North Carolina State University, USA * Paolo Missier, Newcastle University, UK * Paul Watson, NewCastle University, UK * Peter Burnap, Cardiff University, UK * Rahul Potharaju, Microsoft, USA * Rajkumar Kettimuthu, Argonne National Lab and University of Chicago, USA * Robert Ross, Argonne National Lab, USA * Samer Al-Kiswany, University of British Columbia, Canada * Scott Klasky, Oak Ridge National Lab, USA * Wei Tang, Argonne National Lab, USA * Weidong Shi, University of Houston, USA * Xiaolin (Andy) Li, University of Florida, USA * Yanlong Yin, Bloomberg, USA * Yong Chen, Texas Tech University, USA * Yong Zhao, University of Electronic Science and Technology, China * Zhao Zhang, University of California, Berkeley, USA Cyber Co-Chairs * Dongfang Zhao, Illinois Institute of Technology, USA Local Organizing Committee * George Angelos Papadopoulos, University of Cyprus, Cyprus SPONSORSHIP --------------------------------------------------------------------------------------- IEEE*, ACM*, and IIT* *Final approval on sponsorship is pending. -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Editor: IEEE TCC, Springer Cluster, Springer JoCCASA Chair: IEEE/ACM MTAGS, ACM ScienceCloud ================================================================= Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ LinkedIn: http://www.linkedin.com/in/ioanraicu Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ ================================================================= ================================================================= From Timothy.Stitt at tgac.ac.uk Sun Jul 26 14:59:57 2015 From: Timothy.Stitt at tgac.ac.uk (Timothy Stitt (TGAC)) Date: Sun, 26 Jul 2015 19:59:57 +0000 Subject: [Swift-user] floor(), ceil() and round() issues with v0.8.0 Message-ID: Dear Swift/T developers & users, I've been recompiling a Swift/T script in v0.8.0 (which worked in previous versions) but its failing to compile at the line involving the floor() command. The error I'm seeing is: stc error: test.swift:7:6: Cannot assign to t: LVal has type int but RVal has type float I know that this worked fine in previous versions so I tried to compile with the trivial example below and I get the same error: import math; import io; import sys; main { int t = floor(7.8); trace(t); } I substituted floor() for ceil() and round() and got the same error. Is there something wrong with the math library or am I doing something really stupid that I can't see. Thanks, Tim. --- Timothy Stitt PhD / Head of Scientific Computing The Genome Analysis Centre (TGAC), Room 204b http://www.tgac.ac.uk/ p: +44 1603 450378 e: timothy.stitt at tgac.ac.uk -------------- next part -------------- An HTML attachment was scrubbed... URL: From tim.g.armstrong at gmail.com Sun Jul 26 18:18:03 2015 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Sun, 26 Jul 2015 16:18:03 -0700 Subject: [Swift-user] floor(), ceil() and round() issues with v0.8.0 In-Reply-To: References: Message-ID: Hi Tim, The return type of those functions changed to float in 0.8.0 as part of a bigger effort to standardise the Swift library. We tried to keep things backwards compatible as much as possible but unfortunately there wasn't a way to do that in this case. You can get the same effect with toInt(floor(7.8)) - Tim On 26 July 2015 at 12:59, Timothy Stitt (TGAC) wrote: > Dear Swift/T developers & users, > > I've been recompiling a Swift/T script in v0.8.0 (which worked in > previous versions) but its failing to compile at the line involving the > floor() command. The error I'm seeing is: > > stc error: > test.swift:7:6: Cannot assign to t: LVal has type int but RVal has type > float > > I know that this worked fine in previous versions so I tried to compile > with the trivial example below and I get the same error: > > import math; > import io; > import sys; > > main > { > int t = floor(7.8); > trace(t); > } > > I substituted floor() for ceil() and round() and got the same error. Is > there something wrong with the math library or am I doing something really > stupid that I can't see. > > Thanks, > > Tim. > > --- > > *Timothy Stitt PhD* / Head of Scientific Computing > > The Genome Analysis Centre (TGAC), Room 204b > > http://www.tgac.ac.uk/ > > > p: +44 1603 450378 > > e: timothy.stitt at tgac.ac.uk > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Timothy.Stitt at tgac.ac.uk Mon Jul 27 04:10:31 2015 From: Timothy.Stitt at tgac.ac.uk (Timothy Stitt (TGAC)) Date: Mon, 27 Jul 2015 09:10:31 +0000 Subject: [Swift-user] floor(), ceil() and round() issues with v0.8.0 In-Reply-To: References: Message-ID: Thanks Tim. I don't think those changes made their way into the v0.8.0 user guide that I have with my distribution. Your suggestion did work though and my old script is now compiling again. Cheers. --- Timothy Stitt PhD / Head of Scientific Computing The Genome Analysis Centre (TGAC), Room 204b http://www.tgac.ac.uk/ p: +44 1603 450378 e: timothy.stitt at tgac.ac.uk From: Tim Armstrong > Date: Monday, 27 July 2015 00:18 To: Timothy Stitt > Cc: "swift-user at ci.uchicago.edu" > Subject: Re: [Swift-user] floor(), ceil() and round() issues with v0.8.0 Hi Tim, The return type of those functions changed to float in 0.8.0 as part of a bigger effort to standardise the Swift library. We tried to keep things backwards compatible as much as possible but unfortunately there wasn't a way to do that in this case. You can get the same effect with toInt(floor(7.8)) - Tim On 26 July 2015 at 12:59, Timothy Stitt (TGAC) > wrote: Dear Swift/T developers & users, I've been recompiling a Swift/T script in v0.8.0 (which worked in previous versions) but its failing to compile at the line involving the floor() command. The error I'm seeing is: stc error: test.swift:7:6: Cannot assign to t: LVal has type int but RVal has type float I know that this worked fine in previous versions so I tried to compile with the trivial example below and I get the same error: import math; import io; import sys; main { int t = floor(7.8); trace(t); } I substituted floor() for ceil() and round() and got the same error. Is there something wrong with the math library or am I doing something really stupid that I can't see. Thanks, Tim. --- Timothy Stitt PhD / Head of Scientific Computing The Genome Analysis Centre (TGAC), Room 204b http://www.tgac.ac.uk/ p: +44 1603 450378 e: timothy.stitt at tgac.ac.uk _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -------------- next part -------------- An HTML attachment was scrubbed... URL: From wozniak at mcs.anl.gov Mon Jul 27 10:49:32 2015 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Mon, 27 Jul 2015 10:49:32 -0500 Subject: [Swift-user] floor(), ceil() and round() issues with v0.8.0 In-Reply-To: References: Message-ID: <55B6530C.2080501@mcs.anl.gov> These fixes are on the web now. On 07/27/2015 04:10 AM, Timothy Stitt (TGAC) wrote: > Thanks Tim. > > I don't think those changes made their way into the v0.8.0 user guide > that I have with my distribution. Your suggestion did work though and > my old script is now compiling again. > > Cheers. > > --- > > *Timothy Stitt PhD* / Head of Scientific Computing > > The Genome Analysis Centre (TGAC), Room 204b > > http://www.tgac.ac.uk/ > > > p: +44 1603 450378 > > e: timothy.stitt at tgac.ac.uk > > > From: Tim Armstrong > > Date: Monday, 27 July 2015 00:18 > To: Timothy Stitt > > Cc: "swift-user at ci.uchicago.edu " > > > Subject: Re: [Swift-user] floor(), ceil() and round() issues with v0.8.0 > > Hi Tim, > The return type of those functions changed to float in 0.8.0 as > part of a bigger effort to standardise the Swift library. We > tried to keep things backwards compatible as much as possible but > unfortunately there wasn't a way to do that in this case. > > You can get the same effect with toInt(floor(7.8)) > > - Tim > > On 26 July 2015 at 12:59, Timothy Stitt (TGAC) > > wrote: > > Dear Swift/T developers & users, > > I've been recompiling a Swift/T script in v0.8.0 (which worked > in previous versions) but its failing to compile at the line > involving the floor() command. The error I'm seeing is: > > stc error: > test.swift:7:6: Cannot assign to t: LVal has type int but RVal > has type float > > I know that this worked fine in previous versions so I tried > to compile with the trivial example below and I get the same > error: > > import math; > import io; > import sys; > > main > { > int t = floor(7.8); > trace(t); > } > > I substituted floor() for ceil() and round() and got the same > error. Is there something wrong with the math library or am I > doing something really stupid that I can't see. > > Thanks, > > Tim. > > --- > > *Timothy Stitt PhD* / Head of Scientific Computing > > The Genome Analysis Centre (TGAC), Room 204b > > http://www.tgac.ac.uk/ > > > p: +44 1603 450378 > > e: timothy.stitt at tgac.ac.uk > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Justin M Wozniak -------------- next part -------------- An HTML attachment was scrubbed... URL: From iraicu at cs.iit.edu Thu Jul 30 09:00:29 2015 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Thu, 30 Jul 2015 09:00:29 -0500 Subject: [Swift-user] CFP: 8th Workshop on Many-Task Computing on Clouds, Grids, and Supercomputers (MTAGS) 2015 -- co-located with IEEE/ACM Supercomputing/SC 2015 Message-ID: <55BA2DFD.2010200@cs.iit.edu> Call for Papers --------------------------------------------------------------------------------------- The 8th Workshop on Many-Task Computing on Clouds, Grids, and Supercomputers (MTAGS) 2015 http://datasys.cs.iit.edu/events/MTAGS15/ --------------------------------------------------------------------------------------- November 15th, 2015 Austin, Texas, USA Co-located with with IEEE/ACM International Conference for High Performance Computing, Networking, Storage and Analysis (SC15) ======================================================================================= The 8th workshop on Many-Task Computing on Clouds, Grids, and Supercomputers (MTAGS) will provide the scientific community a dedicated forum for presenting new research, development, and deployment efforts of large-scale many-task computing (MTC) applications on large scale clusters, Grids, Supercomputers, and Cloud Computing infrastructure. MTC, the theme of the workshop encompasses loosely coupled applications, which are generally composed of many tasks (both independent and dependent tasks) to achieve some larger application goal. This workshop will cover challenges that can hamper efficiency and utilization in running applications on large-scale systems, such as local resource manager scalability and granularity, efficient utilization of raw hardware, parallel file system contention and scalability, data management, I/O management, reliability at scale, and application scalability. We welcome paper submissions on all theoretical, simulations, and systems topics related to MTC, but we give special consideration to papers addressing petascale to exascale challenges. Papers will be peer-reviewed for novelty, scientific merit, and scope for the workshop. The workshop will be co-located with the IEEE/ACM Supercomputing 2015 Conference in Austin Texas on November 15th, 2015. For more information, please see http://datasys.cs.iit.edu/events/MTAGS15/. For more information on past workshops, please see MTAGS14, MTAGS13, MTAGS12, MTAGS11, MTAGS10, MTAGS09, and MTAGS08. We also ran a Special Issue on Many-Task Computing in the IEEE Transactions on Parallel and Distributed Systems (TPDS) which appeared in June 2011; the proceedings can be found online at http://www.computer.org/portal/web/csdl/abs/trans/td/2011/06/ttd201106toc.htm. We are also currently assembling a new special issue in the IEEE Transaction on Cloud Computing on Many-Task Computing in the Cloud, see http://datasys.cs.iit.edu/events/TCC-MTC15/index.html for more information. We, the workshop organizers, also published a highly relevant paper that defines Many-Task Computing which was published in MTAGS08, titled ?Many-Task Computing for Grids and Supercomputers?; we encourage potential authors to read this paper, and to clearly articulate in your paper submissions how your papers are related to Many-Task Computing. Topics --------------------------------------------------------------------------------------- We invite the submission of original work that is related to the topics below. The papers should be 6 pages, including all figures and references. We aim to cover topics related to Many-Task Computing on each of the three major distributed systems paradigms, Cloud Computing, Grid Computing and Supercomputing. Topics of interest include: * Compute Resource Management * Scheduling * Job execution frameworks * Local resource manager extensions * Performance evaluation of resource managers in use on large scale systems * Dynamic resource provisioning * Techniques to manage many-core resources and/or GPUs * Challenges and opportunities in running many-task workloads on HPC systems * Challenges and opportunities in running many-task workloads on Cloud Computing infrastructure * Storage architectures and implementations * Distributed file systems * Parallel file systems * Distributed meta-data management * Content distribution systems for large data * Data caching frameworks and techniques * Data management within and across data centers * Data-aware scheduling * Data-intensive computing applications * Eventual-consistency storage usage and management * Programming models and tools * Map-reduce and its generalizations * Many-task computing middleware and applications * Parallel programming frameworks * Ensemble MPI techniques and frameworks * Service-oriented science applications * Large-Scale Workflow Systems * Workflow system performance and scalability analysis * Scalability of workflow systems * Workflow infrastructure and e-Science middleware * Programming Paradigms and Models * Large-Scale Many-Task Applications * High-throughput computing (HTC) applications * Data-intensive applications * Quasi-supercomputing applications, deployments, and experiences * Performance Evaluation * Performance evaluation * Real systems * Simulations * Reliability of large systems Paper Submission and Publication --------------------------------------------------------------------------------------- Authors are invited to submit papers with unpublished, original work of not more than 6 pages of double column text using single spaced 10 point size on 8.5 x 11 inch pages, as per ACM 8.5 x 11 manuscript guidelines; document templates can be found at http://www.acm.org/sigs/publications/proceedings-templates. The final 6 page papers in PDF format must be submitted online at https://cmt.research.microsoft.com/MTAGS2015/ before the deadline. Papers will be peer-reviewed for novelty, scientific merit, and scope for the workshop. Submission implies the willingness of at least one of the authors to register and present the paper. For more information, please see http://datasys.cs.iit.edu/events/MTAGS15/. Important Dates --------------------------------------------------------------------------------------- * Abstracts due: September 4th, 2015 * Full paper due: September 11th, 2015 * Acceptance notification: October 2nd, 2015 * Early Registration deadline: October 15th, 2015 * Final papers due: November 6th, 2015 * Workshop date: November 15th, 2015 Committee Members --------------------------------------------------------------------------------------- Workshop Chairs * Ioan Raicu, Illinois Institute of Technology & Argonne National Laboratory * Justin Wozniak, University of Chicago & Argonne National Laboratory * Ian Foster, University of Chicago & Argonne National Laboratory * Yong Zhao, University of Electronic Science and Technology of China Steering Committee * David Abramson, Monash University, Australia * Jack Dongarra, University of Tennessee, USA * Geoffrey Fox, Indiana University, USA * Manish Parashar, Rutgers University, USA * Marc Snir, University of Illinois at Urbana Champaign, USA * Xian-He Sun, Illinois Institute of Technology, USA * Weimin Zheng, Tsinghua University, China Technical Committee * Hasan Abbasi, Oak Ridge National Labs, USA * Tim Armstrong, University of Chicago, USA * Roger Barga, Microsoft, USA * Mihai Budiu, Microsoft Research, USA * Rajkumar Buyya University of Melbourne, Australia * Kyle Chard, University of Chicago, USA * Evangelinos Constantinos, Massachusetts Institute of Technology, USA * Catalin Dumitrescu, Fermi National Labs, USA * Haryadi Gunawi, University of Chicago, USA * Indranil Gupta, University of Illinois at Urbana Champaign, USA * Alexandru Iosup, Delft University of Technology, Netherlands * Florin Isaila, Universidad Carlos III de Madrid, Spain & Argonne National Laboratory, USA * Kamil Iskra, Argonne National Laboratory, USA * Daniel S. Katz, University of Chicago, USA * Jik-Soo Kim, Kristi, Korea * Scott A. Klasky, Oak Ridge National Labs, USA * Mike Lang, Los Alamos National Laboratory, USA * Tonglin Li, Illinois Institute of Technology, USA * Chris Moretti, Princeton University, USA * David O'Hallaron, Carnegie Mellon University, USA * Marlon Pierce, Indiana University, USA * Judy Qiu, Indiana University, USA * Lavanya Ramakrishnan, Lawrence Berkeley National Laboratory, USA * Matei Ripeanu, University of British Columbia, Canada * Iman Sadooghi, Illinois Institute of Technology, USA * Wei Tang, Argonne National Laboratory, USA * Edward Walker, Whitworth University, USA * Ke Wang, Illinois Institute of Technology, USA * Matthew Woitaszek, Walmart Labs, USA * Rich Wolski, University of California, Santa Barbara, USA * Zhifeng Yun, University of Houston, USA * Zhao Zhang, University of California at Berkeley, USA * Ziming Zheng, University of Chicago, USA -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Editor: IEEE TCC, Springer Cluster, Springer JoCCASA Chair: IEEE/ACM MTAGS, ACM ScienceCloud ================================================================= Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ LinkedIn: http://www.linkedin.com/in/ioanraicu Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ ================================================================= ================================================================= From chchow at uchicago.edu Fri Jul 31 13:14:35 2015 From: chchow at uchicago.edu (Chun Ho Chow) Date: Fri, 31 Jul 2015 13:14:35 -0500 Subject: [Swift-user] Setting which account to charge to Message-ID: Hi, Is there a way to manually set the account to charge core-hours to in Swift/T? The guide at http://swift-lang.org/Swift-T/turbine-sites.html doesn't seem to specify an option for this. I am on the Midway cluster, if that is relevant. Thanks, Chun Ho -------------- next part -------------- An HTML attachment was scrubbed... URL: