From gmgall at lncc.br Mon Jun 2 07:40:23 2014 From: gmgall at lncc.br (Guilherme Gall) Date: Mon, 02 Jun 2014 09:40:23 -0300 Subject: [Swift-user] Java version to build and run Swift In-Reply-To: <1401473983.16971.7.camel@echo> References: <53889317.7070708@lncc.br> <1401473983.16971.7.camel@echo> Message-ID: <538C70B7.30809@lncc.br> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Em 30-05-2014 15:19, Mihael Hategan escreveu: > On Fri, 2014-05-30 at 11:17 -0300, Guilherme Gall wrote: >> Hi all, >> >> What version of Java should I use to build and run Swift trunk? > > Oracle is the gold standard. The IBM JDK should work. GCJ never > did. > > The version should be >= 1.6. Hi all, I forgot I wasn't using the last revision on trunk. By using an older revision I was trying to eliminate the "Failed to link input file" error that I reported via e-mail to this list April 4 (http://lists.ci.uchicago.edu/pipermail/swift-user/2014-April/002822.html) Making the checkout of the last revision and rebuilding Swift with Java 1.8.0 the NullPointerException doesn't happens anymore. The "Failed to link input file" error persists, though. Best regards, - -- Guilherme Gall CSR/LNCC GPG Public Key ID: A65ED0D5 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJTjHC3AAoJEG9WBlOmXtDVSA8IAK7RlLYEUIedfnb+WyjkO28T FP7H6HEruHD+MUmbMUH4yxFhXo5Qh4CWep0On+CfPxEcuzfSzozKuqY0ZeYDRTpg 5T39R+vgBgHmwUzajzwfeX18eBK/XtWW3ACaodB2/gE1JN/uGnuFvrEdDBdMmeqr 5cQFV/hrZOTEW5Trjtv5TOX6f8ihYBy2N2g4wandQQki3S3y+SvWNcaFvToABS0E Ruwk1hXXOi8rqiCo6q6fhTFab0pOsvQfkfkFX4A4hfczseuvKkQE7vDbJBY8Bmnd XJbpKooYxm9WB1k3Hhhpnr3OXHyEzndNwVQjJpAUbqZF8KbEfjddt1EyswRC+Zw= =EiaM -----END PGP SIGNATURE----- From hategan at mcs.anl.gov Mon Jun 2 14:52:52 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Mon, 2 Jun 2014 12:52:52 -0700 Subject: [Swift-user] Java version to build and run Swift In-Reply-To: <538C70B7.30809@lncc.br> References: <53889317.7070708@lncc.br> <1401473983.16971.7.camel@echo> <538C70B7.30809@lncc.br> Message-ID: <1401738772.6755.1.camel@echo> Hi Guilherme, I cannot seem to reproduce this problem. Do you happen to have a swift log from a failed run, perhaps together with wrapper logs (found in the *.d directory)? Mihael On Mon, 2014-06-02 at 09:40 -0300, Guilherme Gall wrote: > Em 30-05-2014 15:19, Mihael Hategan escreveu: > > On Fri, 2014-05-30 at 11:17 -0300, Guilherme Gall wrote: > >> Hi all, > >> > >> What version of Java should I use to build and run Swift trunk? > > > > Oracle is the gold standard. The IBM JDK should work. GCJ never > > did. > > > > The version should be >= 1.6. > > Hi all, > > I forgot I wasn't using the last revision on trunk. By using an older > revision I was trying to eliminate the "Failed to link input file" > error that I reported via e-mail to this list April 4 > (http://lists.ci.uchicago.edu/pipermail/swift-user/2014-April/002822.html) > > Making the checkout of the last revision and rebuilding Swift with > Java 1.8.0 the NullPointerException doesn't happens anymore. The > "Failed to link input file" error persists, though. > > Best regards, From zhiwudazhanjiangshi at gmail.com Mon Jun 2 23:39:07 2014 From: zhiwudazhanjiangshi at gmail.com (yi lu) Date: Tue, 3 Jun 2014 12:39:07 +0800 Subject: [Swift-user] How to compile or run a swift script on GNU/Linux? Message-ID: Hi all, Please give me some instruction. Thanks, Yi -------------- next part -------------- An HTML attachment was scrubbed... URL: From tim.g.armstrong at gmail.com Tue Jun 3 07:32:17 2014 From: tim.g.armstrong at gmail.com (Tim Armstrong) Date: Tue, 3 Jun 2014 07:32:17 -0500 Subject: [Swift-user] How to compile or run a swift script on GNU/Linux? In-Reply-To: References: Message-ID: The Swift quickstart guide can be found here: http://swift-lang.org/guides/quickstart.html That should get you started - we'd be happy to provide more specific help if you hit obstacles. - Tim On Mon, Jun 2, 2014 at 11:39 PM, yi lu wrote: > Hi all, > > Please give me some instruction. > > Thanks, > > Yi > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > -------------- next part -------------- An HTML attachment was scrubbed... URL: From gmgall at lncc.br Tue Jun 3 09:36:52 2014 From: gmgall at lncc.br (Guilherme Gall) Date: Tue, 03 Jun 2014 11:36:52 -0300 Subject: [Swift-user] Java version to build and run Swift In-Reply-To: <1401738772.6755.1.camel@echo> References: <53889317.7070708@lncc.br> <1401473983.16971.7.camel@echo> <538C70B7.30809@lncc.br> <1401738772.6755.1.camel@echo> Message-ID: <538DDD84.7050300@lncc.br> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Em 02-06-2014 16:52, Mihael Hategan escreveu: > Hi Guilherme, > > I cannot seem to reproduce this problem. > > Do you happen to have a swift log from a failed run, perhaps > together with wrapper logs (found in the *.d directory)? > > Mihael > Hello Mihael, I'm sending the logs of a run that causes the aforementioned "Failed to link input file" error attached. It happens in two different machines both with the same input data. I just modified the tc.data and sites.xml files to reflect the differences between the environments. A simpler script, like hello.swift from examples directory, works fine in both machines. A third machine with Swift built from trunk revision 7575 can run the script that fails without any problem. Again, I'm using the same input data and script that fails in the machines mentioned above. Unfortunately I forgot which Java version I used to build this working version. It's a development machine with more than one Java version installed. - -- Guilherme Gall CSR/LNCC GPG Public Key ID: A65ED0D5 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJTjd2EAAoJEG9WBlOmXtDVJtQIANbmbMHVT1TC6HMAOaFu1W2u +6Vt7gP3x0pHsYH1gE59AgUR+vwbfEr84Y5QB9O+Fgg3z18WC37RYeRqvqFGW5Hh xNoMMuEtzK6kJIpJ3BscUasF662Nfqday1XR+3XPEhGWdiFvCOJeDvXImOAI+X1k G6llhGezAaPvSYau8nf6ec6fOSv9fgfItkALiCr8BTN4zKibK2p9ZhzbtosCwpLh pC3mGEj9Kje0toBlV2Rpfb49RDB9cDJ7/oNorfBJ0sYxhsCLLbcaQGiyN2BzHIC8 WoJi1UlYxf1B0GPbryog3yAoZ9hyjfL3SsaO72zuTLBHqYj1o8jh0fu/oxSoips= =73hy -----END PGP SIGNATURE----- -------------- next part -------------- A non-text attachment was scrubbed... Name: run001.tar.gz Type: application/gzip Size: 10566 bytes Desc: not available URL: From hategan at mcs.anl.gov Tue Jun 3 14:22:33 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 3 Jun 2014 12:22:33 -0700 Subject: [Swift-user] Java version to build and run Swift In-Reply-To: <538DDD84.7050300@lncc.br> References: <53889317.7070708@lncc.br> <1401473983.16971.7.camel@echo> <538C70B7.30809@lncc.br> <1401738772.6755.1.camel@echo> <538DDD84.7050300@lncc.br> Message-ID: <1401823353.1353.2.camel@echo> Hi, So the problem seems to be that alt.asc is passed to the app twice. Once through map_envs and once through output_maps. I'm not sure whether this should or should not generally result in an error (although it should be caught earlier and reported nicer if it should). I'll think about it. Mihael On Tue, 2014-06-03 at 11:36 -0300, Guilherme Gall wrote: > Em 02-06-2014 16:52, Mihael Hategan escreveu: > > Hi Guilherme, > > > > I cannot seem to reproduce this problem. > > > > Do you happen to have a swift log from a failed run, perhaps > > together with wrapper logs (found in the *.d directory)? > > > > Mihael > > > > Hello Mihael, > > I'm sending the logs of a run that causes the aforementioned "Failed > to link input file" error attached. It happens in two different > machines both with the same input data. I just modified the tc.data > and sites.xml files to reflect the differences between the > environments. A simpler script, like hello.swift from examples > directory, works fine in both machines. > > A third machine with Swift built from trunk revision 7575 can run the > script that fails without any problem. Again, I'm using the same input > data and script that fails in the machines mentioned above. > Unfortunately I forgot which Java version I used to build this working > version. It's a development machine with more than one Java version > installed. > > From hategan at mcs.anl.gov Tue Jun 3 14:29:48 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 3 Jun 2014 12:29:48 -0700 Subject: [Swift-user] Java version to build and run Swift In-Reply-To: <1401823353.1353.2.camel@echo> References: <53889317.7070708@lncc.br> <1401473983.16971.7.camel@echo> <538C70B7.30809@lncc.br> <1401738772.6755.1.camel@echo> <538DDD84.7050300@lncc.br> <1401823353.1353.2.camel@echo> Message-ID: <1401823788.1353.5.camel@echo> On Tue, 2014-06-03 at 12:22 -0700, Mihael Hategan wrote: > I'm not sure whether this should or should not generally result in an > error (although it should be caught earlier and reported nicer if it > should). I'll think about it. I think it's a reasonable pattern, so this should not produce an error. I see that in 0.94 the list of stage ins and outs is stripped of duplicates before being sent to the app and that is missing in trunk. I'll have a fix shortly. Mihael From hategan at mcs.anl.gov Tue Jun 3 15:40:36 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 3 Jun 2014 13:40:36 -0700 Subject: [Swift-user] Java version to build and run Swift In-Reply-To: <1401823788.1353.5.camel@echo> References: <53889317.7070708@lncc.br> <1401473983.16971.7.camel@echo> <538C70B7.30809@lncc.br> <1401738772.6755.1.camel@echo> <538DDD84.7050300@lncc.br> <1401823353.1353.2.camel@echo> <1401823788.1353.5.camel@echo> Message-ID: <1401828036.31559.0.camel@echo> On Tue, 2014-06-03 at 12:29 -0700, Mihael Hategan wrote: > On Tue, 2014-06-03 at 12:22 -0700, Mihael Hategan wrote: > > > I'm not sure whether this should or should not generally result in an > > error (although it should be caught earlier and reported nicer if it > > should). I'll think about it. > > I think it's a reasonable pattern, so this should not produce an error. > > I see that in 0.94 the list of stage ins and outs is stripped of > duplicates before being sent to the app and that is missing in trunk. > I'll have a fix shortly. Done. There is a fix in swift trunk (r7904). Mihael From gmgall at lncc.br Tue Jun 3 16:25:24 2014 From: gmgall at lncc.br (Guilherme Gall) Date: Tue, 03 Jun 2014 18:25:24 -0300 Subject: [Swift-user] Java version to build and run Swift In-Reply-To: <1401828036.31559.0.camel@echo> References: <53889317.7070708@lncc.br> <1401473983.16971.7.camel@echo> <538C70B7.30809@lncc.br> <1401738772.6755.1.camel@echo> <538DDD84.7050300@lncc.br> <1401823353.1353.2.camel@echo> <1401823788.1353.5.camel@echo> <1401828036.31559.0.camel@echo> Message-ID: <538E3D44.2040204@lncc.br> Em 03-06-2014 17:40, Mihael Hategan escreveu: > On Tue, 2014-06-03 at 12:29 -0700, Mihael Hategan wrote: >> On Tue, 2014-06-03 at 12:22 -0700, Mihael Hategan wrote: >> >>> I'm not sure whether this should or should not generally result >>> in an error (although it should be caught earlier and reported >>> nicer if it should). I'll think about it. >> >> I think it's a reasonable pattern, so this should not produce an >> error. >> >> I see that in 0.94 the list of stage ins and outs is stripped of >> duplicates before being sent to the app and that is missing in >> trunk. I'll have a fix shortly. > > Done. There is a fix in swift trunk (r7904). > > Mihael > Hello Mihael, With the newest revision everything worked fine in all machines I have Swift installed. Even with the alt.asc file being passed to the app twice. Thank you very much for your help. -- Guilherme Gall CSR/LNCC GPG Public Key ID: A65ED0D5 From wilde at anl.gov Fri Jun 6 09:26:41 2014 From: wilde at anl.gov (Michael Wilde) Date: Fri, 6 Jun 2014 09:26:41 -0500 Subject: [Swift-user] Running Swift on Windows Message-ID: <5391CFA1.2040607@anl.gov> Forwarding a question of general interest: -------- Original Message -------- Subject: Re: [Swift-info] Question regarding Swift parallel scripting Date: Fri, 06 Jun 2014 08:55:07 -0500 From: Michael Wilde Hi, Is it possible to code in swift with a Windows XP machine? --- Yes. See: http://swift-lang.org/guides/release-0.94/userguide/userguide.html#_running_on_windows Swift on Windows has not been heavily used, and the Swift test suite does not yet cover it. Some Windows configurations have encountered problems; others work. Please try it and report your feedback back to the swift-user list. We'll try to fix problems, and would welcome help from Windows experts. Regards, - Mike -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From wilde at anl.gov Fri Jun 6 16:34:27 2014 From: wilde at anl.gov (Michael Wilde) Date: Fri, 6 Jun 2014 16:34:27 -0500 Subject: [Swift-user] Short article on the nature of Swift Message-ID: <539233E3.3000907@anl.gov> The many new subscribers to this list (who we welcome!) might be interested in this high-level article on which Swift which was just posted: https://ci.uchicago.edu/blog/flock-swifts -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago From wilde at anl.gov Sat Jun 7 12:25:47 2014 From: wilde at anl.gov (Michael Wilde) Date: Sat, 7 Jun 2014 12:25:47 -0500 Subject: [Swift-user] A note about how Swift runs applications Message-ID: <53934B1B.6030708@anl.gov> Copying here a reply to a question to info at swift-lang.org: On 6/7/14, 10:08 AM, a user wrote: > I would like very much to try learning Swift, yet my question is > reminiscent of the old expression, "If you have to ask, then you..."! > Anyway, here goes: I was somewhat put off upon reading the first page > or two of the tutorial re getting the best experience by running it in > a playground!? Obviously, they are not referring to swings and > see-saws, but other than that one reference I cannot find an > explanation; what am I missing? > > Please excuse my ignorance. My only excuse is that I am almost 80 and > the only playground we learned about had sand on the ground. Thanks for pointing out our poorly worded text. We will try to improve it. I suspect you were (rightly) confused by the term "application sandbox". We used it in what's become a common computer science usage: http://en.wikipedia.org/wiki/Sandbox_(software_development) In particular, Swift runs application programs that your script specifies in a uniquely created temporary directory that the documentation refers to as a "job directory" (but which we are changing to call "task directory" in the 0.95 release, as part of making our terminology more clear and consistent). Each application invocation gets its own job ("task") directory, into which Swift links the task's input files, and in which Swift expects to find the application's output files after it has completed. We sometimes refer to this application job/task directory as the application's "sandbox" because it can run within this directory without affecting other concurrently running application tasks. Please join the swift-user discussion list; that's the best place to send questions like this, so that many people can provide answers and all can benefit from them. -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago -------------- next part -------------- An HTML attachment was scrubbed... URL: From foster at anl.gov Sat Jun 7 14:11:07 2014 From: foster at anl.gov (Foster, Ian T.) Date: Sat, 7 Jun 2014 19:11:07 +0000 Subject: [Swift-user] A note about how Swift runs applications In-Reply-To: <53934B1B.6030708@anl.gov> References: <53934B1B.6030708@anl.gov> Message-ID: <3F668DEB-D283-4964-9EA6-9ACC483F8124@anl.gov> We are being introduced to a new class of user! On Jun 7, 2014, at 12:25 PM, "Michael Wilde" > wrote: Copying here a reply to a question to info at swift-lang.org: On 6/7/14, 10:08 AM, a user wrote: I would like very much to try learning Swift, yet my question is reminiscent of the old expression, ?If you have to ask, then you??! Anyway, here goes: I was somewhat put off upon reading the first page or two of the tutorial re getting the best experience by running it in a playground!? Obviously, they are not referring to swings and see-saws, but other than that one reference I cannot find an explanation; what am I missing? Please excuse my ignorance. My only excuse is that I am almost 80 and the only playground we learned about had sand on the ground. Thanks for pointing out our poorly worded text. We will try to improve it. I suspect you were (rightly) confused by the term "application sandbox". We used it in what's become a common computer science usage: http://en.wikipedia.org/wiki/Sandbox_(software_development) In particular, Swift runs application programs that your script specifies in a uniquely created temporary directory that the documentation refers to as a "job directory" (but which we are changing to call "task directory" in the 0.95 release, as part of making our terminology more clear and consistent). Each application invocation gets its own job ("task") directory, into which Swift links the task's input files, and in which Swift expects to find the application's output files after it has completed. We sometimes refer to this application job/task directory as the application's "sandbox" because it can run within this directory without affecting other concurrently running application tasks. Please join the swift-user discussion list; that's the best place to send questions like this, so that many people can provide answers and all can benefit from them. -- Michael Wilde Mathematics and Computer Science Computation Institute Argonne National Laboratory The University of Chicago _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -------------- next part -------------- An HTML attachment was scrubbed... URL: From Matthew.Shaxted at som.com Tue Jun 17 16:03:18 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Tue, 17 Jun 2014 17:03:18 -0400 Subject: [Swift-user] Sites.xml to swift.properties Conversion Message-ID: Hi Swift support, I am in the process of converting my 0.94 swift scripts to 0.95, and I am having a bit of difficulties creating the correct sites properties from the new swift.properties file. I am trying to convert the sites.xml file below, and when I attempt to identify site.persistent-coaster{provider="coaster-persistent"...} in the swift.properties file I am getting an "Error: Unknown property site.persistent-coasters.provider". Can anyone please lend some insight on how to best convert from a sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 cog-r3908 Thanks, Matthew 0.94 Sites.xml File 0 10000 {env.HOME}/work passive 2 .01999 10000 /tmp/shaxted My new swift.properties file look like below: sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echo=/bin/echo site=local site. persistent-coaster { provider=coaster tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=2 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coaster.echo=/bin/echo site=persistent-coaster MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A45.9B57C1F0] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A45.9B57C1F0] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: From davidkelly at uchicago.edu Tue Jun 17 16:46:12 2014 From: davidkelly at uchicago.edu (David Kelly) Date: Tue, 17 Jun 2014 16:46:12 -0500 Subject: [Swift-user] Sites.xml to swift.properties Conversion In-Reply-To: References: Message-ID: Hi Matthew, The new config assumes the provider is just 'coaster' by default, but it's possible to override this and specify your own url (just a little more verbose). This property should do it: jobManager=coaster-persistent:local:local:http://localhost:56069 I'll make a note to add documentation about non-'coaster' setups in the userguide. David On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted wrote: > Hi Swift support, > > > > I am in the process of converting my 0.94 swift scripts to 0.95, and I am > having a bit of difficulties creating the correct sites properties from the > new swift.properties file. > > > > I am trying to convert the sites.xml file below, and when I attempt to > identify site.persistent-coaster{provider=?coaster-persistent??} in the > swift.properties file I am getting an ?Error: Unknown property > site.persistent-coasters.provider?. > > > > Can anyone please lend some insight on how to best convert from a > sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 > cog-r3908 > > > > Thanks, > > Matthew > > > > > > *0.94 Sites.xml File* > > > > > > > > > > 0 > > 10000 > > > > {env.HOME}/work > > > > > > > url="http://localhost:56069" > > jobmanager="local:local"/> > > passive > > 2 > > .01999 > > 10000 > > > > /tmp/shaxted > > > > > > > > > > *My new swift.properties file look like below:* > > > > sitedir.keep=true > > wrapperlog.always.transfer=true > > > > site.local { > > tasksPerWorker=8 > > taskWalltime=00:15:00 > > maxJobs=1 > > workdir=/home/som/EnergyPlus/test/work > > filesystem=local > > } > > app.local.echo=/bin/echo > > site=local > > > > site. persistent-coaster { > > provider=coaster > > tasksPerWorker=8 > > taskWalltime=00:15:00 > > maxJobs=2 > > workdir=/home/som/EnergyPlus/test/work > > filesystem=local > > } > > app.persistent-coaster.echo=/bin/echo > > site=persistent-coaster > > > > > > > > MATTHEW SHAXTED > > > > SKIDMORE, OWINGS & MERRILL LLP > > 224 South Michigan Ave. > > Chicago, IL 60604 > > TEL: 312.360.4368 > > FAX: 312.360.4545 > > matthew.shaxted at som.com > > > > [image: cid:image9d6458.png at 2965c709.c87949ac] > > WWW.SOM.COM > > > > The information contained in this communication may be confidential, is > intended only for the use of the recipient(s) named above, and may be > legally privileged. If the reader of this message is not the intended > recipient, you are hereby notified that any dissemination, distribution, or > copying of this communication, or any of its contents, is strictly > prohibited and may be unlawful. If you have received this communication in > error, please return it to the sender immediately and delete the original > message and any copy of it from your computer system. If you have any > questions concerning this message, please contact the sender. > > > > [image: cid:image93798a.gif at f078f826.ddd94773] > > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: not available URL: From yadudoc1729 at gmail.com Tue Jun 17 16:48:51 2014 From: yadudoc1729 at gmail.com (Yadu Nand) Date: Tue, 17 Jun 2014 16:48:51 -0500 Subject: [Swift-user] Sites.xml to swift.properties Conversion In-Reply-To: References: Message-ID: Hi David, Isn't the swift.properties supposed to say : site=local,persistent-coaster instead of the site variable being redefined in what looks like a single swift.properties file ? -Yadu On Tue, Jun 17, 2014 at 4:46 PM, David Kelly wrote: > Hi Matthew, > > The new config assumes the provider is just 'coaster' by default, but it's > possible to override this and specify your own url (just a little more > verbose). This property should do it: > > jobManager=coaster-persistent:local:local:http://localhost:56069 > > I'll make a note to add documentation about non-'coaster' setups in the > userguide. > > David > > > On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted > wrote: > >> Hi Swift support, >> >> >> >> I am in the process of converting my 0.94 swift scripts to 0.95, and I am >> having a bit of difficulties creating the correct sites properties from the >> new swift.properties file. >> >> >> >> I am trying to convert the sites.xml file below, and when I attempt to >> identify site.persistent-coaster{provider=?coaster-persistent??} in the >> swift.properties file I am getting an ?Error: Unknown property >> site.persistent-coasters.provider?. >> >> >> >> Can anyone please lend some insight on how to best convert from a >> sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 >> cog-r3908 >> >> >> >> Thanks, >> >> Matthew >> >> >> >> >> >> *0.94 Sites.xml File* >> >> >> >> >> >> >> >> >> >> 0 >> >> 10000 >> >> >> >> {env.HOME}/work >> >> >> >> >> >> > >> url="http://localhost:56069" >> >> jobmanager="local:local"/> >> >> passive >> >> 2 >> >> .01999 >> >> 10000 >> >> >> >> /tmp/shaxted >> >> >> >> >> >> >> >> >> >> *My new swift.properties file look like below:* >> >> >> >> sitedir.keep=true >> >> wrapperlog.always.transfer=true >> >> >> >> site.local { >> >> tasksPerWorker=8 >> >> taskWalltime=00:15:00 >> >> maxJobs=1 >> >> workdir=/home/som/EnergyPlus/test/work >> >> filesystem=local >> >> } >> >> app.local.echo=/bin/echo >> >> site=local >> >> >> >> site. persistent-coaster { >> >> provider=coaster >> >> tasksPerWorker=8 >> >> taskWalltime=00:15:00 >> >> maxJobs=2 >> >> workdir=/home/som/EnergyPlus/test/work >> >> filesystem=local >> >> } >> >> app.persistent-coaster.echo=/bin/echo >> >> site=persistent-coaster >> >> >> >> >> >> >> >> MATTHEW SHAXTED >> >> >> >> SKIDMORE, OWINGS & MERRILL LLP >> >> 224 South Michigan Ave. >> >> Chicago, IL 60604 >> >> TEL: 312.360.4368 >> >> FAX: 312.360.4545 >> >> matthew.shaxted at som.com >> >> >> >> [image: cid:image9d6458.png at 2965c709.c87949ac] >> >> WWW.SOM.COM >> >> >> >> The information contained in this communication may be confidential, is >> intended only for the use of the recipient(s) named above, and may be >> legally privileged. If the reader of this message is not the intended >> recipient, you are hereby notified that any dissemination, distribution, or >> copying of this communication, or any of its contents, is strictly >> prohibited and may be unlawful. If you have received this communication in >> error, please return it to the sender immediately and delete the original >> message and any copy of it from your computer system. If you have any >> questions concerning this message, please contact the sender. >> >> >> >> [image: cid:image93798a.gif at f078f826.ddd94773] >> >> >> >> _______________________________________________ >> Swift-user mailing list >> Swift-user at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user >> > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > -- Yadu Nand B -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: not available URL: From davidkelly at uchicago.edu Tue Jun 17 16:56:44 2014 From: davidkelly at uchicago.edu (David Kelly) Date: Tue, 17 Jun 2014 16:56:44 -0500 Subject: [Swift-user] Sites.xml to swift.properties Conversion In-Reply-To: References: Message-ID: Yes - if you want it to run on both sites by default, there should be one line that says site=local,persistent-coaster. On Tue, Jun 17, 2014 at 4:48 PM, Yadu Nand wrote: > Hi David, > > Isn't the swift.properties supposed to say : site=local,persistent-coaster > instead of the site variable being redefined in what looks like a single > swift.properties file ? > > -Yadu > > > On Tue, Jun 17, 2014 at 4:46 PM, David Kelly > wrote: > >> Hi Matthew, >> >> The new config assumes the provider is just 'coaster' by default, but >> it's possible to override this and specify your own url (just a little more >> verbose). This property should do it: >> >> jobManager=coaster-persistent:local:local:http://localhost:56069 >> >> I'll make a note to add documentation about non-'coaster' setups in the >> userguide. >> >> David >> >> >> On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted > > wrote: >> >>> Hi Swift support, >>> >>> >>> >>> I am in the process of converting my 0.94 swift scripts to 0.95, and I >>> am having a bit of difficulties creating the correct sites properties from >>> the new swift.properties file. >>> >>> >>> >>> I am trying to convert the sites.xml file below, and when I attempt to >>> identify site.persistent-coaster{provider=?coaster-persistent??} in the >>> swift.properties file I am getting an ?Error: Unknown property >>> site.persistent-coasters.provider?. >>> >>> >>> >>> Can anyone please lend some insight on how to best convert from a >>> sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 >>> cog-r3908 >>> >>> >>> >>> Thanks, >>> >>> Matthew >>> >>> >>> >>> >>> >>> *0.94 Sites.xml File* >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> 0 >>> >>> 10000 >>> >>> >>> >>> {env.HOME}/work >>> >>> >>> >>> >>> >>> >> >>> url="http://localhost:56069" >>> >>> jobmanager="local:local"/> >>> >>> passive >>> >>> 2 >>> >>> .01999 >>> >>> 10000 >>> >>> >>> >>> /tmp/shaxted >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> *My new swift.properties file look like below:* >>> >>> >>> >>> sitedir.keep=true >>> >>> wrapperlog.always.transfer=true >>> >>> >>> >>> site.local { >>> >>> tasksPerWorker=8 >>> >>> taskWalltime=00:15:00 >>> >>> maxJobs=1 >>> >>> workdir=/home/som/EnergyPlus/test/work >>> >>> filesystem=local >>> >>> } >>> >>> app.local.echo=/bin/echo >>> >>> site=local >>> >>> >>> >>> site. persistent-coaster { >>> >>> provider=coaster >>> >>> tasksPerWorker=8 >>> >>> taskWalltime=00:15:00 >>> >>> maxJobs=2 >>> >>> workdir=/home/som/EnergyPlus/test/work >>> >>> filesystem=local >>> >>> } >>> >>> app.persistent-coaster.echo=/bin/echo >>> >>> site=persistent-coaster >>> >>> >>> >>> >>> >>> >>> >>> MATTHEW SHAXTED >>> >>> >>> >>> SKIDMORE, OWINGS & MERRILL LLP >>> >>> 224 South Michigan Ave. >>> >>> Chicago, IL 60604 >>> >>> TEL: 312.360.4368 >>> >>> FAX: 312.360.4545 >>> >>> matthew.shaxted at som.com >>> >>> >>> >>> [image: cid:image9d6458.png at 2965c709.c87949ac] >>> >>> WWW.SOM.COM >>> >>> >>> >>> The information contained in this communication may be confidential, is >>> intended only for the use of the recipient(s) named above, and may be >>> legally privileged. If the reader of this message is not the intended >>> recipient, you are hereby notified that any dissemination, distribution, or >>> copying of this communication, or any of its contents, is strictly >>> prohibited and may be unlawful. If you have received this communication in >>> error, please return it to the sender immediately and delete the original >>> message and any copy of it from your computer system. If you have any >>> questions concerning this message, please contact the sender. >>> >>> >>> >>> [image: cid:image93798a.gif at f078f826.ddd94773] >>> >>> >>> >>> _______________________________________________ >>> Swift-user mailing list >>> Swift-user at ci.uchicago.edu >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user >>> >> >> >> _______________________________________________ >> Swift-user mailing list >> Swift-user at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user >> > > > > -- > Yadu Nand B > > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: not available URL: From Matthew.Shaxted at som.com Tue Jun 17 16:56:46 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Tue, 17 Jun 2014 17:56:46 -0400 Subject: [Swift-user] Sites.xml to swift.properties Conversion In-Reply-To: References: Message-ID: Yes I did just fix this and it is generating two pools (below), but I still cannot identify the execution provider for some odd reason. 1 0.03 /home/som/EnergyPlus/test/work 8 00:15:00 1 8 00:15:00 /home/som/EnergyPlus/test/work MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A4D.1F7722D0] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A4D.1F7722D0] From: Yadu Nand [mailto:yadudoc1729 at gmail.com] Sent: Tuesday, June 17, 2014 4:49 PM To: David Kelly Cc: Matthew Shaxted; swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Sites.xml to swift.properties Conversion Hi David, Isn't the swift.properties supposed to say : site=local,persistent-coaster instead of the site variable being redefined in what looks like a single swift.properties file ? -Yadu On Tue, Jun 17, 2014 at 4:46 PM, David Kelly > wrote: Hi Matthew, The new config assumes the provider is just 'coaster' by default, but it's possible to override this and specify your own url (just a little more verbose). This property should do it: jobManager=coaster-persistent:local:local:http://localhost:56069 I'll make a note to add documentation about non-'coaster' setups in the userguide. David On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted > wrote: Hi Swift support, I am in the process of converting my 0.94 swift scripts to 0.95, and I am having a bit of difficulties creating the correct sites properties from the new swift.properties file. I am trying to convert the sites.xml file below, and when I attempt to identify site.persistent-coaster{provider=?coaster-persistent??} in the swift.properties file I am getting an ?Error: Unknown property site.persistent-coasters.provider?. Can anyone please lend some insight on how to best convert from a sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 cog-r3908 Thanks, Matthew 0.94 Sites.xml File 0 10000 {env.HOME}/work passive 2 .01999 10000 /tmp/shaxted My new swift.properties file look like below: sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echo=/bin/echo site=local site. persistent-coaster { provider=coaster tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=2 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coaster.echo=/bin/echo site=persistent-coaster MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A4D.1F7722D0] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A4D.1F7722D0] _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Yadu Nand B -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: From davidkelly at uchicago.edu Tue Jun 17 16:59:48 2014 From: davidkelly at uchicago.edu (David Kelly) Date: Tue, 17 Jun 2014 16:59:48 -0500 Subject: [Swift-user] Sites.xml to swift.properties Conversion In-Reply-To: References: Message-ID: Could you paste the new swift.properties please? The jobmanager line I gave should translate to: On Tue, Jun 17, 2014 at 4:56 PM, Matthew Shaxted wrote: > Yes I did just fix this and it is generating two pools (below), but I > still cannot identify the execution provider for some odd reason. > > > > > > > > > > > > > > 1 > > 0.03 > > /home/som/EnergyPlus/test/work > > > > 8 > > 00:15:00 > > > > > > > > 1 > > 8 > > 00:15:00 > > > > /home/som/EnergyPlus/test/work > > > > > > > > > > MATTHEW SHAXTED > > > > SKIDMORE, OWINGS & MERRILL LLP > > 224 South Michigan Ave. > > Chicago, IL 60604 > > TEL: 312.360.4368 > > FAX: 312.360.4545 > > matthew.shaxted at som.com > > > > [image: cid:image9d6458.png at 2965c709.c87949ac] > > WWW.SOM.COM > > > > The information contained in this communication may be confidential, is > intended only for the use of the recipient(s) named above, and may be > legally privileged. If the reader of this message is not the intended > recipient, you are hereby notified that any dissemination, distribution, or > copying of this communication, or any of its contents, is strictly > prohibited and may be unlawful. If you have received this communication in > error, please return it to the sender immediately and delete the original > message and any copy of it from your computer system. If you have any > questions concerning this message, please contact the sender. > > > > [image: cid:image93798a.gif at f078f826.ddd94773] > > > > *From:* Yadu Nand [mailto:yadudoc1729 at gmail.com] > *Sent:* Tuesday, June 17, 2014 4:49 PM > *To:* David Kelly > *Cc:* Matthew Shaxted; swift-user at ci.uchicago.edu > *Subject:* Re: [Swift-user] Sites.xml to swift.properties Conversion > > > > Hi David, > > > > Isn't the swift.properties supposed to say : site=local,persistent-coaster > > instead of the site variable being redefined in what looks like a single > swift.properties file ? > > > > -Yadu > > > > On Tue, Jun 17, 2014 at 4:46 PM, David Kelly > wrote: > > Hi Matthew, > > > > The new config assumes the provider is just 'coaster' by default, but it's > possible to override this and specify your own url (just a little more > verbose). This property should do it: > > jobManager=coaster-persistent:local:local:http://localhost:56069 > > I'll make a note to add documentation about non-'coaster' setups in the > userguide. > > David > > > > On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted > wrote: > > Hi Swift support, > > > > I am in the process of converting my 0.94 swift scripts to 0.95, and I am > having a bit of difficulties creating the correct sites properties from the > new swift.properties file. > > > > I am trying to convert the sites.xml file below, and when I attempt to > identify site.persistent-coaster{provider=?coaster-persistent??} in the > swift.properties file I am getting an ?Error: Unknown property > site.persistent-coasters.provider?. > > > > Can anyone please lend some insight on how to best convert from a > sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 > cog-r3908 > > > > Thanks, > > Matthew > > > > > > *0.94 Sites.xml File* > > > > > > > > > > 0 > > 10000 > > > > {env.HOME}/work > > > > > > > url="http://localhost:56069" > > jobmanager="local:local"/> > > passive > > 2 > > .01999 > > 10000 > > > > /tmp/shaxted > > > > > > > > > > *My new swift.properties file look like below:* > > > > sitedir.keep=true > > wrapperlog.always.transfer=true > > > > site.local { > > tasksPerWorker=8 > > taskWalltime=00:15:00 > > maxJobs=1 > > workdir=/home/som/EnergyPlus/test/work > > filesystem=local > > } > > app.local.echo=/bin/echo > > site=local > > > > site. persistent-coaster { > > provider=coaster > > tasksPerWorker=8 > > taskWalltime=00:15:00 > > maxJobs=2 > > workdir=/home/som/EnergyPlus/test/work > > filesystem=local > > } > > app.persistent-coaster.echo=/bin/echo > > site=persistent-coaster > > > > > > > > MATTHEW SHAXTED > > > > SKIDMORE, OWINGS & MERRILL LLP > > 224 South Michigan Ave. > > Chicago, IL 60604 > > TEL: 312.360.4368 > > FAX: 312.360.4545 > > matthew.shaxted at som.com > > > > [image: cid:image9d6458.png at 2965c709.c87949ac] > > WWW.SOM.COM > > > > The information contained in this communication may be confidential, is > intended only for the use of the recipient(s) named above, and may be > legally privileged. If the reader of this message is not the intended > recipient, you are hereby notified that any dissemination, distribution, or > copying of this communication, or any of its contents, is strictly > prohibited and may be unlawful. If you have received this communication in > error, please return it to the sender immediately and delete the original > message and any copy of it from your computer system. If you have any > questions concerning this message, please contact the sender. > > > > [image: cid:image93798a.gif at f078f826.ddd94773] > > > > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > > > > > -- > > Yadu Nand B > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: not available URL: From Matthew.Shaxted at som.com Tue Jun 17 17:03:43 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Tue, 17 Jun 2014 18:03:43 -0400 Subject: [Swift-user] Sites.xml to swift.properties Conversion In-Reply-To: References: Message-ID: Oh Great I just saw this now? this indeed works. Thanks the documentation was a bit misleading in section 4.8: http://swift-lang.org/guides/trunk/userguide/userguide.html#_location_of_swift_properties This is the sites.xml file I get now: 1 0.03 /home/som/EnergyPlus/test/work 8 00:15:00 1 8 00:15:00 /home/som/EnergyPlus/test/work MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A4E.1811B6D0] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A4E.1811B6D0] From: David Kelly [mailto:davidkelly at uchicago.edu] Sent: Tuesday, June 17, 2014 4:46 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Sites.xml to swift.properties Conversion Hi Matthew, The new config assumes the provider is just 'coaster' by default, but it's possible to override this and specify your own url (just a little more verbose). This property should do it: jobManager=coaster-persistent:local:local:http://localhost:56069 I'll make a note to add documentation about non-'coaster' setups in the userguide. David On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted > wrote: Hi Swift support, I am in the process of converting my 0.94 swift scripts to 0.95, and I am having a bit of difficulties creating the correct sites properties from the new swift.properties file. I am trying to convert the sites.xml file below, and when I attempt to identify site.persistent-coaster{provider=?coaster-persistent??} in the swift.properties file I am getting an ?Error: Unknown property site.persistent-coasters.provider?. Can anyone please lend some insight on how to best convert from a sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 cog-r3908 Thanks, Matthew 0.94 Sites.xml File 0 10000 {env.HOME}/work passive 2 .01999 10000 /tmp/shaxted My new swift.properties file look like below: sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echo=/bin/echo site=local site. persistent-coaster { provider=coaster tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=2 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coaster.echo=/bin/echo site=persistent-coaster MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A4E.1811B6D0] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A4E.1811B6D0] _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: From Matthew.Shaxted at som.com Tue Jun 17 17:59:58 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Tue, 17 Jun 2014 18:59:58 -0400 Subject: [Swift-user] 0.94 to 0.95 Conversion References: Message-ID: Another strange error when trying to convert my scripts from 0.94 to 0.95? I have an app defined in the swift script as below, and I?m getting an error: ?Cannot pass type 'file' as a parameter to application 'epLocal' in application epLocal at line 8?. Did something change with app definition in 0.95 (ie cannot accept files?)? app (file json) runEP ( file imf, file epw, string params[] ) { epLocal "--imf" imf "--epw" epw "--outall" "temp.tgz" "--outxml" "temp.xml" "--outjson" json "--params" params; } My generated apps file from swift.properties looks like below: coast epCoast /home/som/EnergyPlus/shanghai/RunAndReduceEP.sh local epLocal /home/som/EnergyPlus/shanghai/RunAndReduceEP.sh MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A55.309D1D50] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A55.309D1D50] From: Matthew Shaxted Sent: Tuesday, June 17, 2014 5:04 PM To: 'David Kelly' Cc: swift-user at ci.uchicago.edu Subject: RE: [Swift-user] Sites.xml to swift.properties Conversion Oh Great I just saw this now? this indeed works. Thanks the documentation was a bit misleading in section 4.8: http://swift-lang.org/guides/trunk/userguide/userguide.html#_location_of_swift_properties This is the sites.xml file I get now: 1 0.03 /home/som/EnergyPlus/test/work 8 00:15:00 1 8 00:15:00 /home/som/EnergyPlus/test/work MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A55.309D1D50] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A55.309D1D50] From: David Kelly [mailto:davidkelly at uchicago.edu] Sent: Tuesday, June 17, 2014 4:46 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Sites.xml to swift.properties Conversion Hi Matthew, The new config assumes the provider is just 'coaster' by default, but it's possible to override this and specify your own url (just a little more verbose). This property should do it: jobManager=coaster-persistent:local:local:http://localhost:56069 I'll make a note to add documentation about non-'coaster' setups in the userguide. David On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted > wrote: Hi Swift support, I am in the process of converting my 0.94 swift scripts to 0.95, and I am having a bit of difficulties creating the correct sites properties from the new swift.properties file. I am trying to convert the sites.xml file below, and when I attempt to identify site.persistent-coaster{provider=?coaster-persistent??} in the swift.properties file I am getting an ?Error: Unknown property site.persistent-coasters.provider?. Can anyone please lend some insight on how to best convert from a sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 cog-r3908 Thanks, Matthew 0.94 Sites.xml File 0 10000 {env.HOME}/work passive 2 .01999 10000 /tmp/shaxted My new swift.properties file look like below: sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echo=/bin/echo site=local site. persistent-coaster { provider=coaster tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=2 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coaster.echo=/bin/echo site=persistent-coaster MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A55.309D1D50] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A55.309D1D50] _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: From Matthew.Shaxted at som.com Tue Jun 17 18:04:24 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Tue, 17 Jun 2014 19:04:24 -0400 Subject: [Swift-user] 0.94 to 0.95 Conversion References: Message-ID: Oh I believe I found the answer? The @?s needed to stay in front of the app variables in the below manner. I know they were removed for the functions (such as @arg), but apparently not so for the app file definitions. My app definition now looks like below: app (file json) runEP ( file imf, file epw, string params[] ) { epLocal "--imf" @imf "--epw" @epw "--outall" "temp.tgz" "--outxml" "temp.xml" "--outjson" @json "--params" @params; } Thanks MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A56.92971870] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A56.92971870] From: Matthew Shaxted Sent: Tuesday, June 17, 2014 6:00 PM To: 'David Kelly' Cc: 'swift-user at ci.uchicago.edu'; 'Yadu Nand' Subject: RE: 0.94 to 0.95 Conversion Another strange error when trying to convert my scripts from 0.94 to 0.95? I have an app defined in the swift script as below, and I?m getting an error: ?Cannot pass type 'file' as a parameter to application 'epLocal' in application epLocal at line 8?. Did something change with app definition in 0.95 (ie cannot accept files?)? app (file json) runEP ( file imf, file epw, string params[] ) { epLocal "--imf" imf "--epw" epw "--outall" "temp.tgz" "--outxml" "temp.xml" "--outjson" json "--params" params; } My generated apps file from swift.properties looks like below: coast epCoast /home/som/EnergyPlus/shanghai/RunAndReduceEP.sh local epLocal /home/som/EnergyPlus/shanghai/RunAndReduceEP.sh MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A56.92971870] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A56.92971870] From: Matthew Shaxted Sent: Tuesday, June 17, 2014 5:04 PM To: 'David Kelly' Cc: swift-user at ci.uchicago.edu Subject: RE: [Swift-user] Sites.xml to swift.properties Conversion Oh Great I just saw this now? this indeed works. Thanks the documentation was a bit misleading in section 4.8: http://swift-lang.org/guides/trunk/userguide/userguide.html#_location_of_swift_properties This is the sites.xml file I get now: 1 0.03 /home/som/EnergyPlus/test/work 8 00:15:00 1 8 00:15:00 /home/som/EnergyPlus/test/work MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A56.92971870] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A56.92971870] From: David Kelly [mailto:davidkelly at uchicago.edu] Sent: Tuesday, June 17, 2014 4:46 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Sites.xml to swift.properties Conversion Hi Matthew, The new config assumes the provider is just 'coaster' by default, but it's possible to override this and specify your own url (just a little more verbose). This property should do it: jobManager=coaster-persistent:local:local:http://localhost:56069 I'll make a note to add documentation about non-'coaster' setups in the userguide. David On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted > wrote: Hi Swift support, I am in the process of converting my 0.94 swift scripts to 0.95, and I am having a bit of difficulties creating the correct sites properties from the new swift.properties file. I am trying to convert the sites.xml file below, and when I attempt to identify site.persistent-coaster{provider=?coaster-persistent??} in the swift.properties file I am getting an ?Error: Unknown property site.persistent-coasters.provider?. Can anyone please lend some insight on how to best convert from a sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 cog-r3908 Thanks, Matthew 0.94 Sites.xml File 0 10000 {env.HOME}/work passive 2 .01999 10000 /tmp/shaxted My new swift.properties file look like below: sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echo=/bin/echo site=local site. persistent-coaster { provider=coaster tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=2 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coaster.echo=/bin/echo site=persistent-coaster MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8A56.92971870] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8A56.92971870] _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: From hategan at mcs.anl.gov Tue Jun 17 18:26:50 2014 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Tue, 17 Jun 2014 16:26:50 -0700 Subject: [Swift-user] 0.94 to 0.95 Conversion In-Reply-To: References: Message-ID: <1403047610.28757.3.camel@echo> Right. You need either filename(x) or @x. The "@" as in syntactic sugar for "filename()" and the "@" as an annoying prefix to function names in pre-0.95 are somewhat of a coincidence. Mihael On Tue, 2014-06-17 at 19:04 -0400, Matthew Shaxted wrote: > Oh I believe I found the answer? > > The @?s needed to stay in front of the app variables in the below manner. I know they were removed for the functions (such as @arg), but apparently not so for the app file definitions. My app definition now looks like below: > > app (file json) runEP ( file imf, file epw, string params[] ) > { > epLocal "--imf" @imf "--epw" @epw "--outall" "temp.tgz" "--outxml" "temp.xml" "--outjson" @json "--params" @params; > } > > Thanks > > MATTHEW SHAXTED > > SKIDMORE, OWINGS & MERRILL LLP > 224 South Michigan Ave. > Chicago, IL 60604 > TEL: 312.360.4368 > FAX: 312.360.4545 > matthew.shaxted at som.com > > [cid:image001.png at 01CF8A56.92971870] > WWW.SOM.COM > > The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. > > [cid:image002.png at 01CF8A56.92971870] > > From: Matthew Shaxted > Sent: Tuesday, June 17, 2014 6:00 PM > To: 'David Kelly' > Cc: 'swift-user at ci.uchicago.edu'; 'Yadu Nand' > Subject: RE: 0.94 to 0.95 Conversion > > Another strange error when trying to convert my scripts from 0.94 to 0.95? > > I have an app defined in the swift script as below, and I?m getting an error: ?Cannot pass type 'file' as a parameter to application 'epLocal' in application epLocal at line 8?. > > Did something change with app definition in 0.95 (ie cannot accept files?)? > > app (file json) runEP ( file imf, file epw, string params[] ) > { > epLocal "--imf" imf "--epw" epw "--outall" "temp.tgz" "--outxml" "temp.xml" "--outjson" json "--params" params; > } > > My generated apps file from swift.properties looks like below: > > coast epCoast /home/som/EnergyPlus/shanghai/RunAndReduceEP.sh > local epLocal /home/som/EnergyPlus/shanghai/RunAndReduceEP.sh > > > MATTHEW SHAXTED > > SKIDMORE, OWINGS & MERRILL LLP > 224 South Michigan Ave. > Chicago, IL 60604 > TEL: 312.360.4368 > FAX: 312.360.4545 > matthew.shaxted at som.com > > [cid:image001.png at 01CF8A56.92971870] > WWW.SOM.COM > > The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. > > [cid:image002.png at 01CF8A56.92971870] > > From: Matthew Shaxted > Sent: Tuesday, June 17, 2014 5:04 PM > To: 'David Kelly' > Cc: swift-user at ci.uchicago.edu > Subject: RE: [Swift-user] Sites.xml to swift.properties Conversion > > Oh Great I just saw this now? this indeed works. Thanks the documentation was a bit misleading in section 4.8: http://swift-lang.org/guides/trunk/userguide/userguide.html#_location_of_swift_properties > > This is the sites.xml file I get now: > > > > > > > 1 > 0.03 > /home/som/EnergyPlus/test/work > > 8 > 00:15:00 > > > > 1 > 8 > 00:15:00 > > /home/som/EnergyPlus/test/work > > > > > > > MATTHEW SHAXTED > > SKIDMORE, OWINGS & MERRILL LLP > 224 South Michigan Ave. > Chicago, IL 60604 > TEL: 312.360.4368 > FAX: 312.360.4545 > matthew.shaxted at som.com > > [cid:image001.png at 01CF8A56.92971870] > WWW.SOM.COM > > The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. > > [cid:image002.png at 01CF8A56.92971870] > > From: David Kelly [mailto:davidkelly at uchicago.edu] > Sent: Tuesday, June 17, 2014 4:46 PM > To: Matthew Shaxted > Cc: swift-user at ci.uchicago.edu > Subject: Re: [Swift-user] Sites.xml to swift.properties Conversion > > Hi Matthew, > > The new config assumes the provider is just 'coaster' by default, but it's possible to override this and specify your own url (just a little more verbose). This property should do it: > jobManager=coaster-persistent:local:local:http://localhost:56069 > I'll make a note to add documentation about non-'coaster' setups in the userguide. > David > > On Tue, Jun 17, 2014 at 4:03 PM, Matthew Shaxted > wrote: > Hi Swift support, > > I am in the process of converting my 0.94 swift scripts to 0.95, and I am having a bit of difficulties creating the correct sites properties from the new swift.properties file. > > I am trying to convert the sites.xml file below, and when I attempt to identify site.persistent-coaster{provider=?coaster-persistent??} in the swift.properties file I am getting an ?Error: Unknown property site.persistent-coasters.provider?. > > Can anyone please lend some insight on how to best convert from a sites.xml to a swift.properties file? I am using Swift 0.95 RC6 swift-r7900 cog-r3908 > > Thanks, > Matthew > > > 0.94 Sites.xml File > > > > > 0 > 10000 > > {env.HOME}/work > > > url="http://localhost:56069" > jobmanager="local:local"/> > passive > 2 > .01999 > 10000 > > /tmp/shaxted > > > > > My new swift.properties file look like below: > > sitedir.keep=true > wrapperlog.always.transfer=true > > site.local { > tasksPerWorker=8 > taskWalltime=00:15:00 > maxJobs=1 > workdir=/home/som/EnergyPlus/test/work > filesystem=local > } > app.local.echo=/bin/echo > site=local > > site. persistent-coaster { > provider=coaster > tasksPerWorker=8 > taskWalltime=00:15:00 > maxJobs=2 > workdir=/home/som/EnergyPlus/test/work > filesystem=local > } > app.persistent-coaster.echo=/bin/echo > site=persistent-coaster > > > > MATTHEW SHAXTED > > SKIDMORE, OWINGS & MERRILL LLP > 224 South Michigan Ave. > Chicago, IL 60604 > TEL: 312.360.4368 > FAX: 312.360.4545 > matthew.shaxted at som.com > > [cid:image001.png at 01CF8A56.92971870] > WWW.SOM.COM > > The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. > > [cid:image002.png at 01CF8A56.92971870] > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user From Matthew.Shaxted at som.com Wed Jun 18 12:20:09 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Wed, 18 Jun 2014 13:20:09 -0400 Subject: [Swift-user] Persistent Coasters & 0.95 RC6 Message-ID: Hi, I am trying to upgrade my 0.94 persistent-coasters scripts to 0.95, and seem to be experiencing some difficulty when trying to execute coaster jobs. I can run these test scripts locally with no problems. I have a swift.properties file that is outlined below. I can successfully start-coaster-service using a hosts.txt file. I notice that this process creates a unique sites.xml file but my swift.properties file should match it. I am manually defining the coaster service port to match that in the swift.properties file. When I try to run the below test.swift script, I am getting the error that looks like below. Any idea what may be causing this issue? Swift.Properties File sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echoLocal=/bin/echo site.persistent-coasters { jobManager=coaster-persistent:local:local:http://localhost:50200 tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coasters.echoCoast=/bin/echo site=local,persistent-coasters test.swift file app echo (string s) { echoCoast s; } echo("HELLO WORLD"); test.swift Error from the run.log file swift NO_STATUS_FILE jobid=echoCoast-5135s9sl - Error file missing 2014-06-18 12:13:25,214-0500 DEBUG swift APPLICATION_EXCEPTION jobid=echoCoast-5135s9sl - Application exception: Job failed with and exit code of 127 Command line output Swift 0.95 RC6 swift-r7900 cog-r3908 RunID: run003 Progress: Wed, 18 Jun 2014 12:13:24-0500 Execution failed: Exception in echoCoast: Arguments: [HELLO WORLD] Host: persistent-coasters Directory: test-run003/jobs/5/echoCoast-5135s9sl exception @ swift-int.k, line: 530 Caused by: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) Caused by: org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) (exit code: 127) MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8AED.4A6A0CA0] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8AED.4A6A0CA0] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: From yadudoc1729 at gmail.com Wed Jun 18 12:30:43 2014 From: yadudoc1729 at gmail.com (Yadu Nand) Date: Wed, 18 Jun 2014 12:30:43 -0500 Subject: [Swift-user] Persistent Coasters & 0.95 RC6 In-Reply-To: References: Message-ID: Hi Matthew, Could you mail us a tar ball of your runNNN directory ? Thanks, Yadu On Wed, Jun 18, 2014 at 12:20 PM, Matthew Shaxted wrote: > Hi, I am trying to upgrade my 0.94 persistent-coasters scripts to 0.95, > and seem to be experiencing some difficulty when trying to execute coaster > jobs. I can run these test scripts locally with no problems. > > > > I have a swift.properties file that is outlined below. I can successfully > start-coaster-service using a hosts.txt file. I notice that this process > creates a unique sites.xml file but my swift.properties file should match > it. I am manually defining the coaster service port to match that in the > swift.properties file. > > > > When I try to run the below test.swift script, I am getting the error that > looks like below. > > > > Any idea what may be causing this issue? > > > > > > *Swift.Properties File* > > > > sitedir.keep=true > > wrapperlog.always.transfer=true > > > > site.local { > > tasksPerWorker=8 > > taskWalltime=00:15:00 > > maxJobs=1 > > workdir=/home/som/EnergyPlus/test/work > > filesystem=local > > } > > app.local.echoLocal=/bin/echo > > > > site.persistent-coasters { > > jobManager=coaster-persistent:local:local:http://localhost:50200 > > tasksPerWorker=8 > > taskWalltime=00:15:00 > > maxJobs=1 > > workdir=/home/som/EnergyPlus/test/work > > filesystem=local > > } > > app.persistent-coasters.echoCoast=/bin/echo > > > > site=local,persistent-coasters > > > > > > > > > > *test.swift file* > > > > app echo (string s) { > > echoCoast s; > > } > > > > echo("HELLO WORLD"); > > > > > > > > > > *test.swift Error* > > > > *from the run.log file* > > swift NO_STATUS_FILE jobid=echoCoast-5135s9sl - Error file missing > > 2014-06-18 12:13:25,214-0500 DEBUG swift APPLICATION_EXCEPTION > jobid=echoCoast-5135s9sl - Application exception: Job failed with and exit > code of 127 > > > > *Command line output* > > Swift 0.95 RC6 swift-r7900 cog-r3908 > > RunID: run003 > > Progress: Wed, 18 Jun 2014 12:13:24-0500 > > > > Execution failed: > > Exception in echoCoast: > > Arguments: [HELLO WORLD] > > Host: persistent-coasters > > Directory: test-run003/jobs/5/echoCoast-5135s9sl > > exception @ swift-int.k, line: 530 > > Caused by: Job failed with and exit code of 127 > > org.globus.cog.abstraction.impl.common.execution.JobException: Job failed > with and exit code of 127 (exit code: 127) > > at > org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) > > at > org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) > > at > org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) > > at > org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) > > at > org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) > > at > org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) > > > > Caused by: org.globus.cog.abstraction.impl.common.execution.JobException: > Job failed with and exit code of 127 > > org.globus.cog.abstraction.impl.common.execution.JobException: Job failed > with and exit code of 127 (exit code: 127) > > at > org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) > > at > org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) > > at > org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) > > at > org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) > > at > org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) > > at > org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) > > (exit code: 127) > > > > > > > > > > > > > > MATTHEW SHAXTED > > > > SKIDMORE, OWINGS & MERRILL LLP > > 224 South Michigan Ave. > > Chicago, IL 60604 > > TEL: 312.360.4368 > > FAX: 312.360.4545 > > matthew.shaxted at som.com > > > > [image: cid:image9d6458.png at 2965c709.c87949ac] > > WWW.SOM.COM > > > > The information contained in this communication may be confidential, is > intended only for the use of the recipient(s) named above, and may be > legally privileged. If the reader of this message is not the intended > recipient, you are hereby notified that any dissemination, distribution, or > copying of this communication, or any of its contents, is strictly > prohibited and may be unlawful. If you have received this communication in > error, please return it to the sender immediately and delete the original > message and any copy of it from your computer system. If you have any > questions concerning this message, please contact the sender. > > > > [image: cid:image93798a.gif at f078f826.ddd94773] > > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > -- Yadu Nand B -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: not available URL: From Matthew.Shaxted at som.com Wed Jun 18 12:35:41 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Wed, 18 Jun 2014 13:35:41 -0400 Subject: [Swift-user] Persistent Coasters & 0.95 RC6 In-Reply-To: References: Message-ID: Hi Yadu, yes it is attached. Thanks MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8AF1.D0AE77C0] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8AF1.D0AE77C0] From: Yadu Nand [mailto:yadudoc1729 at gmail.com] Sent: Wednesday, June 18, 2014 12:31 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Matthew, Could you mail us a tar ball of your runNNN directory ? Thanks, Yadu On Wed, Jun 18, 2014 at 12:20 PM, Matthew Shaxted > wrote: Hi, I am trying to upgrade my 0.94 persistent-coasters scripts to 0.95, and seem to be experiencing some difficulty when trying to execute coaster jobs. I can run these test scripts locally with no problems. I have a swift.properties file that is outlined below. I can successfully start-coaster-service using a hosts.txt file. I notice that this process creates a unique sites.xml file but my swift.properties file should match it. I am manually defining the coaster service port to match that in the swift.properties file. When I try to run the below test.swift script, I am getting the error that looks like below. Any idea what may be causing this issue? Swift.Properties File sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echoLocal=/bin/echo site.persistent-coasters { jobManager=coaster-persistent:local:local:http://localhost:50200 tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coasters.echoCoast=/bin/echo site=local,persistent-coasters test.swift file app echo (string s) { echoCoast s; } echo("HELLO WORLD"); test.swift Error from the run.log file swift NO_STATUS_FILE jobid=echoCoast-5135s9sl - Error file missing 2014-06-18 12:13:25,214-0500 DEBUG swift APPLICATION_EXCEPTION jobid=echoCoast-5135s9sl - Application exception: Job failed with and exit code of 127 Command line output Swift 0.95 RC6 swift-r7900 cog-r3908 RunID: run003 Progress: Wed, 18 Jun 2014 12:13:24-0500 Execution failed: Exception in echoCoast: Arguments: [HELLO WORLD] Host: persistent-coasters Directory: test-run003/jobs/5/echoCoast-5135s9sl exception @ swift-int.k, line: 530 Caused by: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) Caused by: org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) (exit code: 127) MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8AF1.D0AE77C0] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8AF1.D0AE77C0] _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Yadu Nand B -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: test.tar.gz Type: application/x-gzip Size: 1362 bytes Desc: test.tar.gz URL: From Matthew.Shaxted at som.com Wed Jun 18 13:59:11 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Wed, 18 Jun 2014 14:59:11 -0400 Subject: [Swift-user] Persistent Coasters & 0.95 RC6 References: Message-ID: And here is a tar of the run001.log directory? From: Matthew Shaxted Sent: Wednesday, June 18, 2014 12:36 PM To: 'Yadu Nand' Cc: swift-user at ci.uchicago.edu Subject: RE: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Yadu, yes it is attached. Thanks MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8AFD.7B3D7D20] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8AFD.7B3D7D20] From: Yadu Nand [mailto:yadudoc1729 at gmail.com] Sent: Wednesday, June 18, 2014 12:31 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Matthew, Could you mail us a tar ball of your runNNN directory ? Thanks, Yadu On Wed, Jun 18, 2014 at 12:20 PM, Matthew Shaxted > wrote: Hi, I am trying to upgrade my 0.94 persistent-coasters scripts to 0.95, and seem to be experiencing some difficulty when trying to execute coaster jobs. I can run these test scripts locally with no problems. I have a swift.properties file that is outlined below. I can successfully start-coaster-service using a hosts.txt file. I notice that this process creates a unique sites.xml file but my swift.properties file should match it. I am manually defining the coaster service port to match that in the swift.properties file. When I try to run the below test.swift script, I am getting the error that looks like below. Any idea what may be causing this issue? Swift.Properties File sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echoLocal=/bin/echo site.persistent-coasters { jobManager=coaster-persistent:local:local:http://localhost:50200 tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coasters.echoCoast=/bin/echo site=local,persistent-coasters test.swift file app echo (string s) { echoCoast s; } echo("HELLO WORLD"); test.swift Error from the run.log file swift NO_STATUS_FILE jobid=echoCoast-5135s9sl - Error file missing 2014-06-18 12:13:25,214-0500 DEBUG swift APPLICATION_EXCEPTION jobid=echoCoast-5135s9sl - Application exception: Job failed with and exit code of 127 Command line output Swift 0.95 RC6 swift-r7900 cog-r3908 RunID: run003 Progress: Wed, 18 Jun 2014 12:13:24-0500 Execution failed: Exception in echoCoast: Arguments: [HELLO WORLD] Host: persistent-coasters Directory: test-run003/jobs/5/echoCoast-5135s9sl exception @ swift-int.k, line: 530 Caused by: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) Caused by: org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) (exit code: 127) MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8AFD.7B3D7D20] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8AFD.7B3D7D20] _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Yadu Nand B -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: run001.tar.gz Type: application/x-gzip Size: 3224 bytes Desc: run001.tar.gz URL: From yadudoc1729 at gmail.com Wed Jun 18 14:40:15 2014 From: yadudoc1729 at gmail.com (Yadu Nand) Date: Wed, 18 Jun 2014 14:40:15 -0500 Subject: [Swift-user] Persistent Coasters & 0.95 RC6 In-Reply-To: References: Message-ID: Hi Matthew, With your coaster-service.conf having the SERVICE_PORT set to 50200, the sites.xml file start-coaster-service generates should not have a different port number. Could you check the log file start-coaster-service.log for a line like this : Started coaster service: http://127.0.1.1:50200 Once you are sure that the coaster-service is indeed using the ports you specified, please try the following swift.properties file. site=local,persistent-coasters use.provider.staging=true execution.retries=2 site.persistent-coasters { jobmanager=coaster-persistent:local:local:http://localhost:50200 taskWalltime=00:15:00 workerManager=passive workdir=/tmp/swiftwork filesystem=local } site.local1 { jobmanager=local initialScore=10000 filesystem=local workdir=/tmp/swiftwork } app.persistent-coasters.echoCoast=/bin/echo I made a minor modification to your test.swift to get a log file : type file; app (file o, file e) echo (string s) { echoCoast s stderr=@e stdout=@o; } file out <"stdout">; file err <"stderr">; (out,err) = echo("HELLO WORLD"); I just tested this on my machine with one remote worker. Please let me know if this works. If not please include the start-coaster-service.log that you get in the same folder as setup.sh along with the entire run directory. Thanks! Yadu On Wed, Jun 18, 2014 at 1:59 PM, Matthew Shaxted wrote: > And here is a tar of the run001.log directory? > > > > > > > > *From:* Matthew Shaxted > *Sent:* Wednesday, June 18, 2014 12:36 PM > *To:* 'Yadu Nand' > *Cc:* swift-user at ci.uchicago.edu > *Subject:* RE: [Swift-user] Persistent Coasters & 0.95 RC6 > > > > Hi Yadu, yes it is attached. > > > > Thanks > > > > MATTHEW SHAXTED > > > > SKIDMORE, OWINGS & MERRILL LLP > > 224 South Michigan Ave. > > Chicago, IL 60604 > > TEL: 312.360.4368 > > FAX: 312.360.4545 > > matthew.shaxted at som.com > > > > [image: cid:image9d6458.png at 2965c709.c87949ac] > > WWW.SOM.COM > > > > The information contained in this communication may be confidential, is > intended only for the use of the recipient(s) named above, and may be > legally privileged. If the reader of this message is not the intended > recipient, you are hereby notified that any dissemination, distribution, or > copying of this communication, or any of its contents, is strictly > prohibited and may be unlawful. If you have received this communication in > error, please return it to the sender immediately and delete the original > message and any copy of it from your computer system. If you have any > questions concerning this message, please contact the sender. > > > > [image: cid:image93798a.gif at f078f826.ddd94773] > > > > *From:* Yadu Nand [mailto:yadudoc1729 at gmail.com ] > *Sent:* Wednesday, June 18, 2014 12:31 PM > *To:* Matthew Shaxted > *Cc:* swift-user at ci.uchicago.edu > *Subject:* Re: [Swift-user] Persistent Coasters & 0.95 RC6 > > > > Hi Matthew, > > > > Could you mail us a tar ball of your runNNN directory ? > > > > Thanks, > > Yadu > > > > On Wed, Jun 18, 2014 at 12:20 PM, Matthew Shaxted > wrote: > > Hi, I am trying to upgrade my 0.94 persistent-coasters scripts to 0.95, > and seem to be experiencing some difficulty when trying to execute coaster > jobs. I can run these test scripts locally with no problems. > > > > I have a swift.properties file that is outlined below. I can successfully > start-coaster-service using a hosts.txt file. I notice that this process > creates a unique sites.xml file but my swift.properties file should match > it. I am manually defining the coaster service port to match that in the > swift.properties file. > > > > When I try to run the below test.swift script, I am getting the error that > looks like below. > > > > Any idea what may be causing this issue? > > > > > > *Swift.Properties File* > > > > sitedir.keep=true > > wrapperlog.always.transfer=true > > > > site.local { > > tasksPerWorker=8 > > taskWalltime=00:15:00 > > maxJobs=1 > > workdir=/home/som/EnergyPlus/test/work > > filesystem=local > > } > > app.local.echoLocal=/bin/echo > > > > site.persistent-coasters { > > jobManager=coaster-persistent:local:local:http://localhost:50200 > > tasksPerWorker=8 > > taskWalltime=00:15:00 > > maxJobs=1 > > workdir=/home/som/EnergyPlus/test/work > > filesystem=local > > } > > app.persistent-coasters.echoCoast=/bin/echo > > > > site=local,persistent-coasters > > > > > > > > > > *test.swift file* > > > > app echo (string s) { > > echoCoast s; > > } > > > > echo("HELLO WORLD"); > > > > > > > > > > *test.swift Error* > > > > *from the run.log file* > > swift NO_STATUS_FILE jobid=echoCoast-5135s9sl - Error file missing > > 2014-06-18 12:13:25,214-0500 DEBUG swift APPLICATION_EXCEPTION > jobid=echoCoast-5135s9sl - Application exception: Job failed with and exit > code of 127 > > > > *Command line output* > > Swift 0.95 RC6 swift-r7900 cog-r3908 > > RunID: run003 > > Progress: Wed, 18 Jun 2014 12:13:24-0500 > > > > Execution failed: > > Exception in echoCoast: > > Arguments: [HELLO WORLD] > > Host: persistent-coasters > > Directory: test-run003/jobs/5/echoCoast-5135s9sl > > exception @ swift-int.k, line: 530 > > Caused by: Job failed with and exit code of 127 > > org.globus.cog.abstraction.impl.common.execution.JobException: Job failed > with and exit code of 127 (exit code: 127) > > at > org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) > > at > org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) > > at > org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) > > at > org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) > > at > org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) > > at > org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) > > > > Caused by: org.globus.cog.abstraction.impl.common.execution.JobException: > Job failed with and exit code of 127 > > org.globus.cog.abstraction.impl.common.execution.JobException: Job failed > with and exit code of 127 (exit code: 127) > > at > org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) > > at > org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) > > at > org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) > > at > org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) > > at > org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) > > at > org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) > > (exit code: 127) > > > > > > > > > > > > > > MATTHEW SHAXTED > > > > SKIDMORE, OWINGS & MERRILL LLP > > 224 South Michigan Ave. > > Chicago, IL 60604 > > TEL: 312.360.4368 > > FAX: 312.360.4545 > > matthew.shaxted at som.com > > > > [image: cid:image9d6458.png at 2965c709.c87949ac] > > WWW.SOM.COM > > > > The information contained in this communication may be confidential, is > intended only for the use of the recipient(s) named above, and may be > legally privileged. If the reader of this message is not the intended > recipient, you are hereby notified that any dissemination, distribution, or > copying of this communication, or any of its contents, is strictly > prohibited and may be unlawful. If you have received this communication in > error, please return it to the sender immediately and delete the original > message and any copy of it from your computer system. If you have any > questions concerning this message, please contact the sender. > > > > [image: cid:image93798a.gif at f078f826.ddd94773] > > > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > > > > > -- > > Yadu Nand B > > > -- Yadu Nand B -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: not available URL: From Matthew.Shaxted at som.com Wed Jun 18 14:55:52 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Wed, 18 Jun 2014 15:55:52 -0400 Subject: [Swift-user] Persistent Coasters & 0.95 RC6 In-Reply-To: References: Message-ID: Wouldn?t you know it ?works great with these settings? Thanks very much Yadu. It seems I needed the correct workerManager and port number defined. Matthew From: Yadu Nand [mailto:yadudoc1729 at gmail.com] Sent: Wednesday, June 18, 2014 2:40 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Matthew, With your coaster-service.conf having the SERVICE_PORT set to 50200, the sites.xml file start-coaster-service generates should not have a different port number. Could you check the log file start-coaster-service.log for a line like this : Started coaster service: http://127.0.1.1:50200 Once you are sure that the coaster-service is indeed using the ports you specified, please try the following swift.properties file. site=local,persistent-coasters use.provider.staging=true execution.retries=2 site.persistent-coasters { jobmanager=coaster-persistent:local:local:http://localhost:50200 taskWalltime=00:15:00 workerManager=passive workdir=/tmp/swiftwork filesystem=local } site.local1 { jobmanager=local initialScore=10000 filesystem=local workdir=/tmp/swiftwork } app.persistent-coasters.echoCoast=/bin/echo I made a minor modification to your test.swift to get a log file : type file; app (file o, file e) echo (string s) { echoCoast s stderr=@e stdout=@o; } file out <"stdout">; file err <"stderr">; (out,err) = echo("HELLO WORLD"); I just tested this on my machine with one remote worker. Please let me know if this works. If not please include the start-coaster-service.log that you get in the same folder as setup.sh along with the entire run directory. Thanks! Yadu On Wed, Jun 18, 2014 at 1:59 PM, Matthew Shaxted > wrote: And here is a tar of the run001.log directory? From: Matthew Shaxted Sent: Wednesday, June 18, 2014 12:36 PM To: 'Yadu Nand' Cc: swift-user at ci.uchicago.edu Subject: RE: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Yadu, yes it is attached. Thanks MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8B04.1C16A590] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8B04.1C16A590] From: Yadu Nand [mailto:yadudoc1729 at gmail.com] Sent: Wednesday, June 18, 2014 12:31 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Matthew, Could you mail us a tar ball of your runNNN directory ? Thanks, Yadu On Wed, Jun 18, 2014 at 12:20 PM, Matthew Shaxted > wrote: Hi, I am trying to upgrade my 0.94 persistent-coasters scripts to 0.95, and seem to be experiencing some difficulty when trying to execute coaster jobs. I can run these test scripts locally with no problems. I have a swift.properties file that is outlined below. I can successfully start-coaster-service using a hosts.txt file. I notice that this process creates a unique sites.xml file but my swift.properties file should match it. I am manually defining the coaster service port to match that in the swift.properties file. When I try to run the below test.swift script, I am getting the error that looks like below. Any idea what may be causing this issue? Swift.Properties File sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echoLocal=/bin/echo site.persistent-coasters { jobManager=coaster-persistent:local:local:http://localhost:50200 tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coasters.echoCoast=/bin/echo site=local,persistent-coasters test.swift file app echo (string s) { echoCoast s; } echo("HELLO WORLD"); test.swift Error from the run.log file swift NO_STATUS_FILE jobid=echoCoast-5135s9sl - Error file missing 2014-06-18 12:13:25,214-0500 DEBUG swift APPLICATION_EXCEPTION jobid=echoCoast-5135s9sl - Application exception: Job failed with and exit code of 127 Command line output Swift 0.95 RC6 swift-r7900 cog-r3908 RunID: run003 Progress: Wed, 18 Jun 2014 12:13:24-0500 Execution failed: Exception in echoCoast: Arguments: [HELLO WORLD] Host: persistent-coasters Directory: test-run003/jobs/5/echoCoast-5135s9sl exception @ swift-int.k, line: 530 Caused by: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) Caused by: org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) (exit code: 127) MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8B04.1C16A590] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8B04.1C16A590] _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Yadu Nand B -- Yadu Nand B -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: From Matthew.Shaxted at som.com Thu Jun 19 10:54:27 2014 From: Matthew.Shaxted at som.com (Matthew Shaxted) Date: Thu, 19 Jun 2014 11:54:27 -0400 Subject: [Swift-user] Persistent Coasters & 0.95 RC6 References: Message-ID: Another strange behavior I am noticing in 0.95? I would like to be able to run 12 jobs on each of my coaster nodes. I have defined the tasksPerWorker=12 flag in the swift.properties file, but it does not seem to be respecting the flag. It only stages in 2 tasks at a time. Additionally there seems to be some inconsistent syntax in section 4.8 (when I try to use the jobsPerNode flag it says it does not exist): http://swift-lang.org/guides/trunk/userguide/userguide.html Thanks for any help. Matthew Swift.Properties File site=local,persistent-coasters use.provider.staging=true use.wrapper.staging=false lazy.errors=false provider.staging.pin.swiftfiles=false wrapperlog.always.transfer=false site.persistent-coasters { jobmanager=coaster-persistent:local:local:http://localhost:50200 taskWalltime=00:15:00 workerManager=passive workdir=/tmp/swiftwork filesystem=local tasksPerWorker=12 } site.local { jobmanager=local initialScore=10000 filesystem=local workdir=/home/som/EnergyPlus/shanghai/work } app.persistent-coasters.epCoast=/home/som/EnergyPlus/RunAndReduceEP.sh app.local.epLocal=$PWD/RunAndReduceEP.sh MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8BAB.EDDA9F30] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8BAB.EDDA9F30] From: Matthew Shaxted Sent: Wednesday, June 18, 2014 2:56 PM To: 'Yadu Nand' Cc: swift-user at ci.uchicago.edu Subject: RE: [Swift-user] Persistent Coasters & 0.95 RC6 Wouldn?t you know it ?works great with these settings? Thanks very much Yadu. It seems I needed the correct workerManager and port number defined. Matthew From: Yadu Nand [mailto:yadudoc1729 at gmail.com] Sent: Wednesday, June 18, 2014 2:40 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Matthew, With your coaster-service.conf having the SERVICE_PORT set to 50200, the sites.xml file start-coaster-service generates should not have a different port number. Could you check the log file start-coaster-service.log for a line like this : Started coaster service: http://127.0.1.1:50200 Once you are sure that the coaster-service is indeed using the ports you specified, please try the following swift.properties file. site=local,persistent-coasters use.provider.staging=true execution.retries=2 site.persistent-coasters { jobmanager=coaster-persistent:local:local:http://localhost:50200 taskWalltime=00:15:00 workerManager=passive workdir=/tmp/swiftwork filesystem=local } site.local1 { jobmanager=local initialScore=10000 filesystem=local workdir=/tmp/swiftwork } app.persistent-coasters.echoCoast=/bin/echo I made a minor modification to your test.swift to get a log file : type file; app (file o, file e) echo (string s) { echoCoast s stderr=@e stdout=@o; } file out <"stdout">; file err <"stderr">; (out,err) = echo("HELLO WORLD"); I just tested this on my machine with one remote worker. Please let me know if this works. If not please include the start-coaster-service.log that you get in the same folder as setup.sh along with the entire run directory. Thanks! Yadu On Wed, Jun 18, 2014 at 1:59 PM, Matthew Shaxted > wrote: And here is a tar of the run001.log directory? From: Matthew Shaxted Sent: Wednesday, June 18, 2014 12:36 PM To: 'Yadu Nand' Cc: swift-user at ci.uchicago.edu Subject: RE: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Yadu, yes it is attached. Thanks MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8BAB.EDDA9F30] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8BAB.EDDA9F30] From: Yadu Nand [mailto:yadudoc1729 at gmail.com] Sent: Wednesday, June 18, 2014 12:31 PM To: Matthew Shaxted Cc: swift-user at ci.uchicago.edu Subject: Re: [Swift-user] Persistent Coasters & 0.95 RC6 Hi Matthew, Could you mail us a tar ball of your runNNN directory ? Thanks, Yadu On Wed, Jun 18, 2014 at 12:20 PM, Matthew Shaxted > wrote: Hi, I am trying to upgrade my 0.94 persistent-coasters scripts to 0.95, and seem to be experiencing some difficulty when trying to execute coaster jobs. I can run these test scripts locally with no problems. I have a swift.properties file that is outlined below. I can successfully start-coaster-service using a hosts.txt file. I notice that this process creates a unique sites.xml file but my swift.properties file should match it. I am manually defining the coaster service port to match that in the swift.properties file. When I try to run the below test.swift script, I am getting the error that looks like below. Any idea what may be causing this issue? Swift.Properties File sitedir.keep=true wrapperlog.always.transfer=true site.local { tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.local.echoLocal=/bin/echo site.persistent-coasters { jobManager=coaster-persistent:local:local:http://localhost:50200 tasksPerWorker=8 taskWalltime=00:15:00 maxJobs=1 workdir=/home/som/EnergyPlus/test/work filesystem=local } app.persistent-coasters.echoCoast=/bin/echo site=local,persistent-coasters test.swift file app echo (string s) { echoCoast s; } echo("HELLO WORLD"); test.swift Error from the run.log file swift NO_STATUS_FILE jobid=echoCoast-5135s9sl - Error file missing 2014-06-18 12:13:25,214-0500 DEBUG swift APPLICATION_EXCEPTION jobid=echoCoast-5135s9sl - Application exception: Job failed with and exit code of 127 Command line output Swift 0.95 RC6 swift-r7900 cog-r3908 RunID: run003 Progress: Wed, 18 Jun 2014 12:13:24-0500 Execution failed: Exception in echoCoast: Arguments: [HELLO WORLD] Host: persistent-coasters Directory: test-run003/jobs/5/echoCoast-5135s9sl exception @ swift-int.k, line: 530 Caused by: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) Caused by: org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 org.globus.cog.abstraction.impl.common.execution.JobException: Job failed with and exit code of 127 (exit code: 127) at org.globus.cog.abstraction.coaster.service.local.JobStatusHandler.requestComplete(JobStatusHandler.java:40) at org.globus.cog.coaster.handlers.RequestHandler.receiveCompleted(RequestHandler.java:88) at org.globus.cog.coaster.channels.AbstractCoasterChannel.handleRequest(AbstractCoasterChannel.java:527) at org.globus.cog.coaster.channels.AbstractStreamCoasterChannel.stepNIO(AbstractStreamCoasterChannel.java:238) at org.globus.cog.coaster.channels.NIOMultiplexer.loop(NIOMultiplexer.java:97) at org.globus.cog.coaster.channels.NIOMultiplexer.run(NIOMultiplexer.java:56) (exit code: 127) MATTHEW SHAXTED SKIDMORE, OWINGS & MERRILL LLP 224 South Michigan Ave. Chicago, IL 60604 TEL: 312.360.4368 FAX: 312.360.4545 matthew.shaxted at som.com [cid:image001.png at 01CF8BAB.EDDA9F30] WWW.SOM.COM The information contained in this communication may be confidential, is intended only for the use of the recipient(s) named above, and may be legally privileged. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited and may be unlawful. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender. [cid:image002.png at 01CF8BAB.EDDA9F30] _______________________________________________ Swift-user mailing list Swift-user at ci.uchicago.edu https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Yadu Nand B -- Yadu Nand B -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 6643 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 3047 bytes Desc: image002.png URL: From hsharma at anl.gov Tue Jun 24 12:25:07 2014 From: hsharma at anl.gov (Hemant Sharma) Date: Tue, 24 Jun 2014 17:25:07 -0000 Subject: [Swift-user] Queuing isssue with SWFIT on Orthros, APS cluster Message-ID: <53A9B631.70706@anl.gov> Hi guys, I'm having a problem with queuing using SWIFT. I have a swift script, which should execute about 27000 iterations. In order to limit the initial memory size, I created the following config file: use.provider.staging=false provider.staging.pin.swiftfiles=false use.wrapper.staging=false status.mode=provider wrapperlog.always.transfer=true execution.retries=0 lazy.errors=true sitedir.keep=true file.gc.enabled=false wrapper.parameter.mode=files foreach.max.threads=330 Some times, when I execute the script, it starts with 320 active jobs (on 320 processors), but after some time, it just gets stuck with 330 submitted jobs and none of them are active. Example output to screen is: Swift 0.94 swift-r6637 cog-r3742 RunID: 20140624-1200-qke4z0v8 Progress: time: Tue, 24 Jun 2014 12:00:30 -0500 Progress: time: Tue, 24 Jun 2014 12:00:31 -0500 Selecting site:328 Initializing site shared directory:1 Stage in:1 Progress: time: Tue, 24 Jun 2014 12:00:32 -0500 Selecting site:10 Stage in:277 Submitting:3 Submitted:40 Progress: time: Tue, 24 Jun 2014 12:00:38 -0500 Selecting site:10 Submitted:319 Active:1 Progress: time: Tue, 24 Jun 2014 12:00:43 -0500 Selecting site:10 Active:319 Checking status:1 Progress: time: Tue, 24 Jun 2014 12:00:44 -0500 Selecting site:1 Stage in:20 Active:208 Checking status:31 Stage out:70 Finished successfully:21 Progress: time: Tue, 24 Jun 2014 12:00:45 -0500 Stage in:11 Active:120 Checking status:10 Stage out:189 Finished successfully:31 Progress: time: Tue, 24 Jun 2014 12:00:46 -0500 Stage in:25 Active:117 Stage out:188 Finished successfully:54 Progress: time: Tue, 24 Jun 2014 12:00:47 -0500 Initializing:1 Selecting site:1 Stage in:46 Active:118 Stage out:164 Finished successfully:86 Progress: time: Tue, 24 Jun 2014 12:00:48 -0500 Selecting site:2 Stage in:102 Submitting:1 Submitted:2 Active:165 Checking status:1 Stage out:57 Finished successfully:199 Progress: time: Tue, 24 Jun 2014 12:00:49 -0500 Submitted:5 Active:324 Checking status:1 Finished successfully:265 Progress: time: Tue, 24 Jun 2014 12:00:50 -0500 Submitted:12 Active:317 Checking status:1 Finished successfully:272 Progress: time: Tue, 24 Jun 2014 12:00:51 -0500 Submitted:22 Active:307 Finished successfully:283 Progress: time: Tue, 24 Jun 2014 12:00:52 -0500 Selecting site:1 Stage in:13 Submitted:47 Active:223 Stage out:46 Finished successfully:321 Progress: time: Tue, 24 Jun 2014 12:00:53 -0500 Stage in:28 Submitted:73 Active:153 Stage out:75 Finished successfully:362 Progress: time: Tue, 24 Jun 2014 12:00:55 -0500 Submitted:182 Active:147 Checking status:1 Finished successfully:442 Progress: time: Tue, 24 Jun 2014 12:00:57 -0500 Submitted:183 Active:146 Checking status:1 Finished successfully:443 Progress: time: Tue, 24 Jun 2014 12:01:00 -0500 Submitted:185 Active:144 Checking status:1 Finished successfully:445 Progress: time: Tue, 24 Jun 2014 12:01:01 -0500 Submitted:186 Active:143 Checking status:1 Finished successfully:446 Progress: time: Tue, 24 Jun 2014 12:01:02 -0500 Submitted:190 Active:139 Checking status:1 Finished successfully:450 Progress: time: Tue, 24 Jun 2014 12:01:05 -0500 Submitted:193 Active:136 Checking status:1 Finished successfully:453 Progress: time: Tue, 24 Jun 2014 12:01:07 -0500 Submitted:196 Active:133 Checking status:1 Finished successfully:456 Progress: time: Tue, 24 Jun 2014 12:01:09 -0500 Submitted:198 Active:131 Checking status:1 Finished successfully:458 Progress: time: Tue, 24 Jun 2014 12:01:10 -0500 Stage in:5 Submitted:202 Active:63 Stage out:60 Finished successfully:467 Progress: time: Tue, 24 Jun 2014 12:01:11 -0500 Submitted:273 Active:56 Checking status:1 Finished successfully:533 Progress: time: Tue, 24 Jun 2014 12:01:13 -0500 Submitted:282 Active:47 Checking status:1 Finished successfully:542 Progress: time: Tue, 24 Jun 2014 12:01:14 -0500 Submitting:1 Submitted:292 Active:37 Finished successfully:553 Progress: time: Tue, 24 Jun 2014 12:01:15 -0500 Submitted:298 Active:31 Checking status:1 Finished successfully:558 Progress: time: Tue, 24 Jun 2014 12:01:16 -0500 Submitted:305 Active:24 Checking status:1 Finished successfully:565 Progress: time: Tue, 24 Jun 2014 12:01:17 -0500 Submitted:307 Active:22 Checking status:1 Finished successfully:567 Progress: time: Tue, 24 Jun 2014 12:01:18 -0500 Submitted:313 Active:16 Checking status:1 Finished successfully:573 Progress: time: Tue, 24 Jun 2014 12:01:20 -0500 Submitted:315 Active:14 Checking status:1 Finished successfully:575 Progress: time: Tue, 24 Jun 2014 12:01:21 -0500 Submitted:317 Active:12 Checking status:1 Finished successfully:577 Progress: time: Tue, 24 Jun 2014 12:01:22 -0500 Submitted:319 Active:10 Checking status:1 Finished successfully:579 Progress: time: Tue, 24 Jun 2014 12:01:23 -0500 Submitted:320 Active:9 Checking status:1 Finished successfully:580 Progress: time: Tue, 24 Jun 2014 12:01:25 -0500 Submitted:323 Active:6 Checking status:1 Finished successfully:583 Progress: time: Tue, 24 Jun 2014 12:01:26 -0500 Submitted:324 Active:5 Checking status:1 Finished successfully:584 Progress: time: Tue, 24 Jun 2014 12:01:27 -0500 Submitted:325 Active:4 Checking status:1 Finished successfully:585 Progress: time: Tue, 24 Jun 2014 12:01:29 -0500 Submitted:326 Active:3 Checking status:1 Finished successfully:586 Progress: time: Tue, 24 Jun 2014 12:01:36 -0500 Submitted:327 Active:2 Checking status:1 Finished successfully:587 Progress: time: Tue, 24 Jun 2014 12:01:39 -0500 Submitted:328 Active:1 Checking status:1 Finished successfully:588 Progress: time: Tue, 24 Jun 2014 12:01:50 -0500 Submitted:329 Checking status:1 Finished successfully:589 Progress: time: Tue, 24 Jun 2014 12:02:00 -0500 Submitted:330 Finished successfully:590 Progress: time: Tue, 24 Jun 2014 12:02:30 -0500 Submitted:330 Finished successfully:590 Progress: time: Tue, 24 Jun 2014 12:03:00 -0500 Submitted:330 Finished successfully:590 Progress: time: Tue, 24 Jun 2014 12:03:30 -0500 Submitted:330 Finished successfully:590 Progress: time: Tue, 24 Jun 2014 12:04:00 -0500 Submitted:330 Finished successfully:590 The issue is not really reproducible, nor is the number of successful jobs. Any ideas how to solve this problem? I'm attaching the log file. Thanks, Hemant Hemant Sharma Post-doctoral Researcher Advanced Photon Source Argonne National Laboratory Lemont IL 60429 USA -------------- next part -------------- A non-text attachment was scrubbed... Name: Indexer-20140624-1200-qke4z0v8.log.zip Type: application/zip Size: 438282 bytes Desc: not available URL: