From jonmon at mcs.anl.gov Wed Feb 1 00:02:29 2012 From: jonmon at mcs.anl.gov (jonmon at mcs.anl.gov) Date: Wed, 1 Feb 2012 06:02:29 +0000 Subject: [Swift-user] Montage+Swift+Coasters In-Reply-To: <1327953213.34872.YahooMailNeo@web39502.mail.mud.yahoo.com> References: <1327017075.46246.YahooMailNeo@web39501.mail.mud.yahoo.com> <1327024520.62801.YahooMailNeo@web39505.mail.mud.yahoo.com> <4D008EF1-8072-4A18-8A5A-18D74A2ACDA2@mcs.anl.gov> <1327346756.49322.YahooMailNeo@web39506.mail.mud.yahoo.com> <1327348246.89718.YahooMailNeo@web39507.mail.mud.yahoo.com> <1327350350.29451.YahooMailNeo@web39501.mail.mud.yahoo.com> <1327359158.12794.YahooMailNeo@web39505.mail.mud.yahoo.com> <1327375262.49286.YahooMailNeo@web39503.mail.mud.yahoo.com> <1327377349.65265.YahooM ailNeo@web39505.mail.mud.yahoo.com> <1327433855.75566.YahooMailNeo@web39505.mail.mud.yahoo.com> <96C93FE9-5535-45B5-9D70-1356268B73D5@mcs.anl.gov> <1327953213.34872.YahooMailNeo@web39502.mail.mud.yahoo.com> Message-ID: <1949126882-1328076164-cardhu_decombobulator_blackberry.rim.net-1585933405-@b15.c3.bise6.blackberry> Let's try one more thing before we schedule a skype call to talk about more details(although one might still be necessary) If you could please open up the python files that were in the tar ball I sent with the scripts. Everywhere you see a Montage function(it is prefixed with a lower case m) replace that with the fully qualified path to the binary. Let me know if this works. -----Original Message----- From: Emalayan Vairavanathan Date: Mon, 30 Jan 2012 11:53:33 To: Jonathan Monette Reply-To: Emalayan Vairavanathan Cc: swift user Subject: Re: [Swift-user] Montage+Swift+Coasters Hi Jon, I added mBackground to tc file. But I am still getting the same error. To answer your questions: Yes I am using only the local machine for now (No workers are started in remote nodes). By the way how we can debug the problem ? Do you think whether having a Skpye session is a good idea ? Thank you Emalayan ________________________________ From: Jonathan Monette To: Emalayan Vairavanathan Cc: swift user Sent: Tuesday, 24 January 2012 1:11 PM Subject: Re: [Swift-user] Montage+Swift+Coasters Ok.? Try adding it to your tc.? You are only using the local machine correct?? You aren't using some remote cluster are you? On Jan 24, 2012, at 2:41 PM, Jonathan Monette wrote: > Error code 127 means that the command wasn't found.? This line was in the log > > stderr.txt: /bin/sh: mBackground: command not found > > So?.do you have all the Montage binaries in your path?? What happens when you say mBackground in the terminal? > > On Jan 24, 2012, at 1:37 PM, Emalayan Vairavanathan wrote: > >> > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -------------- next part -------------- An HTML attachment was scrubbed... URL: From iraicu at cs.iit.edu Wed Feb 1 17:43:48 2012 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Wed, 01 Feb 2012 17:43:48 -0600 Subject: [Swift-user] Call for Workshops: The 9th Int. Conf. on Autonomic Computing (ICAC 2012) Message-ID: <4F29CE34.8020706@cs.iit.edu> CALL FOR WORKSHOP PROPOSALS The 9th International Conference on Autonomic Computing (ICAC 2012) September 17-21, 2012. San Jose, CA, USA http://icac2012.cs.fiu.edu/ ----------------------------------------------------------------- IMPORTANT DATES Workshop Proposal Submission: February 10, 2012 ----------------------------------------------------------------- OVERVIEW ICAC is the leading conference on autonomic computing techniques, foundations, and applications. Autonomic computing refers to methods and means for automated management of performance, fault, security, and configuration with little involvement of users or administrators. Systems introducing new autonomic features are becoming increasingly prevalent, motivating research that spans a variety of areas, from computer systems, networking, software engineering, and data management to machine learning, control theory, and bio-inspired computing. ICAC brings together researchers and practitioners across these disciplines to address multiple facets of adaptation and self-management in computing systems and applications from different perspectives. Autonomic computing solutions are sought for clouds, grids, data centers, enterprise software, internet services, data services, smart phones, embedded systems, and sensor networks. In these environments, resources and applications must be managed to maximize performance and minimize cost, while maintaining predictable and reliable behavior in the face of varying workloads, failures, and malicious threats. ICAC'12 welcomes proposals for co-located workshops on topics of interest to the autonomic computing community. Workshop proposals should be submitted to the Workshop Chair, Fred Douglis (f.douglis at computer.org) by February 10, 2012. Workshops are expected to publish proceedings, and should cover areas that complement the main program. ------------------------------------------------------------------ ORGANIZERS GENERAL CHAIR: Dejan Milojicic, HP Labs WORKSHOPS CHAIR: Fred Douglis, EMC -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ ================================================================= ================================================================= From turam at mcs.anl.gov Tue Feb 7 10:22:58 2012 From: turam at mcs.anl.gov (Thomas Uram) Date: Tue, 7 Feb 2012 10:22:58 -0600 Subject: [Swift-user] gridftp error: Server refused MLST command Message-ID: <12CFCABD-E727-40EC-AC98-5D4CF57E18E4@mcs.anl.gov> I have a sites file configured to use gridftp as follows: /home/turam/tmp When I run this, I routinely get errors like so: 2012-02-07 10:02:07,908-0600 WARN vdl:transferwrapperlog Failed to transfer wrapper log for job hostname-pmjqoqmk 2012-02-07 10:02:07,908-0600 DEBUG vdl:transferwrapperlog Exception for wrapper log failure from hostname-20120207-1001-sco9qsfa/info/p on Bugaboo: null Caused by: org.globus.cog.abstraction.impl.file.IrrecoverableResourceException: Exception in getFile Caused by: org.globus.cog.abstraction.impl.file.FileResourceException: Failed to retrieve file information about /home/turam/tmp/hostname-20120207-1001-sco9qsfa/info/p/hostname-pmjqoqmk-info Caused by: org.globus.ftp.exception.ServerException: Server refused performing the request. Custom message: Server refused MLST command (error code 1) [Nested exception message: Custom message: Unexpected reply: 500-Command failed : System error in stat: No such file or directory 500-A system call failed: No such file or directory 500 End.] [Nested exception is org.globus.ftp.exception.UnexpectedReplyCodeException: Custom message: Unexpected reply: 500-Command failed : System error in stat: No such file or directory 500-A system call failed: No such file or directory 500 End.] Full log is here: http://www.mcs.anl.gov/~turam/20120207-1015/hostname-20120207-1001-sco9qsfa.log I found some related discussion (http://lists.ci.uchicago.edu/pipermail/swift-devel/2011-September/009050.html), but no solution was identified. Two questions: - Is this a problem in my configuration, or need I take this up with the admins of the gridftp server? - It's complaining about transferring wrapper logs, but the config file specifies "wrapperlog.always.transfer=false", so should it be even trying? Thanks, Tom -------------- next part -------------- An HTML attachment was scrubbed... URL: From mickelso at mcs.anl.gov Mon Feb 20 12:29:28 2012 From: mickelso at mcs.anl.gov (Sheri Mickelson) Date: Mon, 20 Feb 2012 12:29:28 -0600 Subject: [Swift-user] loading modules Message-ID: <20CD6DAF-3B97-4B62-AC5B-E09C6F2C0C40@mcs.anl.gov> Hi, Is there a way to have swift load modules? Several of our app procedures run programs that are located within a module that needs to be loaded before they run. Thanks, Sheri From wozniak at mcs.anl.gov Mon Feb 20 12:31:54 2012 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Mon, 20 Feb 2012 12:31:54 -0600 (CST) Subject: [Swift-user] loading modules In-Reply-To: <20CD6DAF-3B97-4B62-AC5B-E09C6F2C0C40@mcs.anl.gov> References: <20CD6DAF-3B97-4B62-AC5B-E09C6F2C0C40@mcs.anl.gov> Message-ID: Hi Sheri, Does your tc point to bash scripts or the binaries? I think it would be best to point to bash scripts and setup things there. Justin On Mon, 20 Feb 2012, Sheri Mickelson wrote: > Hi, > > Is there a way to have swift load modules? Several of our app > procedures run programs that are located within a module that needs to > be loaded before they run. > > Thanks, Sheri > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > -- Justin M Wozniak From mickelso at mcs.anl.gov Mon Feb 20 12:36:12 2012 From: mickelso at mcs.anl.gov (Sheri Mickelson) Date: Mon, 20 Feb 2012 12:36:12 -0600 Subject: [Swift-user] loading modules In-Reply-To: References: <20CD6DAF-3B97-4B62-AC5B-E09C6F2C0C40@mcs.anl.gov> Message-ID: Some are scripts others are binaries. That's what I was thinking about doing, but was wondering if Swift had a shortcut before I created wrapper scripts. Thanks, Sheri On Feb 20, 2012, at 12:31 PM, Justin M Wozniak wrote: > Hi Sheri, > Does your tc point to bash scripts or the binaries? I think it > would be best to point to bash scripts and setup things there. > Justin > > On Mon, 20 Feb 2012, Sheri Mickelson wrote: > >> Hi, >> >> Is there a way to have swift load modules? Several of our app >> procedures run programs that are located within a module that needs >> to >> be loaded before they run. >> >> Thanks, Sheri >> >> _______________________________________________ >> Swift-user mailing list >> Swift-user at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user >> > > -- > Justin M Wozniak From wilde at mcs.anl.gov Mon Feb 20 12:42:00 2012 From: wilde at mcs.anl.gov (Michael Wilde) Date: Mon, 20 Feb 2012 12:42:00 -0600 (CST) Subject: [Swift-user] loading modules In-Reply-To: Message-ID: <1354824339.10222.1329763320315.JavaMail.root@zimbra.anl.gov> Maybe we could do this via the new INIT_COMMAND feature (trunk), but I think for now, you should go ahead and create the wrappers, because the modules needed will be very app-specific. I would think we could create a generic module-loading wrapper script that works for any app, say: run-with-modules -m "gcc java python-2.7" command args... - Mike ----- Original Message ----- > From: "Sheri Mickelson" > To: "Justin M Wozniak" > Cc: swift-user at ci.uchicago.edu > Sent: Monday, February 20, 2012 12:36:12 PM > Subject: Re: [Swift-user] loading modules > Some are scripts others are binaries. > > That's what I was thinking about doing, but was wondering if Swift had > a shortcut before I created wrapper scripts. > > Thanks, Sheri > > > On Feb 20, 2012, at 12:31 PM, Justin M Wozniak wrote: > > > Hi Sheri, > > Does your tc point to bash scripts or the binaries? I think it > > would be best to point to bash scripts and setup things there. > > Justin > > > > On Mon, 20 Feb 2012, Sheri Mickelson wrote: > > > >> Hi, > >> > >> Is there a way to have swift load modules? Several of our app > >> procedures run programs that are located within a module that needs > >> to > >> be loaded before they run. > >> > >> Thanks, Sheri > >> > >> _______________________________________________ > >> Swift-user mailing list > >> Swift-user at ci.uchicago.edu > >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > >> > > > > -- > > Justin M Wozniak > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From wilde at mcs.anl.gov Mon Feb 20 12:59:08 2012 From: wilde at mcs.anl.gov (Michael Wilde) Date: Mon, 20 Feb 2012 12:59:08 -0600 (CST) Subject: [Swift-user] loading modules In-Reply-To: <1354824339.10222.1329763320315.JavaMail.root@zimbra.anl.gov> Message-ID: <1152712619.10304.1329764348266.JavaMail.root@zimbra.anl.gov> Also - this may be obvious to others but it was a surprise to me: the module command is typically a shell function, so when putting it into a script you need to do something like this: source $MODULESHOME/init/csh # or sh module load mod1 # your modules here module load modN # your modules here ----- Original Message ----- > From: "Michael Wilde" > To: "Sheri Mickelson" > Cc: swift-user at ci.uchicago.edu > Sent: Monday, February 20, 2012 12:42:00 PM > Subject: Re: [Swift-user] loading modules > Maybe we could do this via the new INIT_COMMAND feature (trunk), but I > think for now, you should go ahead and create the wrappers, because > the modules needed will be very app-specific. > > I would think we could create a generic module-loading wrapper script > that works for any app, say: > > run-with-modules -m "gcc java python-2.7" command args... > > - Mike > > ----- Original Message ----- > > From: "Sheri Mickelson" > > To: "Justin M Wozniak" > > Cc: swift-user at ci.uchicago.edu > > Sent: Monday, February 20, 2012 12:36:12 PM > > Subject: Re: [Swift-user] loading modules > > Some are scripts others are binaries. > > > > That's what I was thinking about doing, but was wondering if Swift > > had > > a shortcut before I created wrapper scripts. > > > > Thanks, Sheri > > > > > > On Feb 20, 2012, at 12:31 PM, Justin M Wozniak wrote: > > > > > Hi Sheri, > > > Does your tc point to bash scripts or the binaries? I think it > > > would be best to point to bash scripts and setup things there. > > > Justin > > > > > > On Mon, 20 Feb 2012, Sheri Mickelson wrote: > > > > > >> Hi, > > >> > > >> Is there a way to have swift load modules? Several of our app > > >> procedures run programs that are located within a module that > > >> needs > > >> to > > >> be loaded before they run. > > >> > > >> Thanks, Sheri > > >> > > >> _______________________________________________ > > >> Swift-user mailing list > > >> Swift-user at ci.uchicago.edu > > >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > >> > > > > > > -- > > > Justin M Wozniak > > > > _______________________________________________ > > Swift-user mailing list > > Swift-user at ci.uchicago.edu > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > -- > Michael Wilde > Computation Institute, University of Chicago > Mathematics and Computer Science Division > Argonne National Laboratory > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From svemalayan at yahoo.com Thu Feb 23 18:03:02 2012 From: svemalayan at yahoo.com (Emalayan Vairavanathan) Date: Thu, 23 Feb 2012 16:03:02 -0800 (PST) Subject: [Swift-user] WORKER_INIT_CMD - with log file In-Reply-To: References: <1329174515.43886.YahooMailNeo@web39505.mail.mud.yahoo.com> <1329771862.41926.YahooMailNeo@web39501.mail.mud.yahoo.com> <1329772390.14447.YahooMailNeo@web39504.mail.mud.yahoo.com> <8742CFD8-8C54-4D67-A0D0-945BB6AF9948@mcs.anl.gov> <1329781225.86597.YahooMailNeo@web39505.mail.mud.yahoo.com> Message-ID: <1330041782.64906.YahooMailNeo@web39506.mail.mud.yahoo.com> Hi Justin, I copied swift-test from ~wozniak/Public/swift-test and try to run it. I followed the steps below. - Modified the coaster-service-conf - Started the coaster service. - Started swift The tc.data has entries for cat but I am getting the error below. Do you have any ideas ? Thank you Emalayan emalayan at login2.surveyor:~/swift-test> run.sh Swift trunk swift-r5662 (swift modified locally) cog-r3361 (cog modified locally) RunID: 20120224-0000-rec5hd4a Progress:? time: Fri, 24 Feb 2012 00:00:45 +0000 EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException Execution failed: ?? ?EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException The application "cat" is not available in the given site/pool in your tc.data catalog? ________________________________ From: Justin M Wozniak To: Jonathan Monette Cc: Emalayan Vairavanathan ; matei Sent: Tuesday, 21 February 2012 12:40 PM Subject: Re: WORKER_INIT_CMD - with log file Hi guys Yes, that version is based on trunk and is up-to-date with WORKER_INIT_CMD.? The recent bug fix for the BG/P is in there, I just tested it. I moved the location to ~wozniak/Public/swift .? The test case I used is in ~wozniak/Public/swift-test .? Both should be readable. ??? Justin On Mon, 20 Feb 2012, Jonathan Monette wrote: > It might....that is a question that Justin can answer.? If it doesn't I am sure the feature can be quickly added. > > On Feb 20, 2012, at 5:40 PM, Emalayan Vairavanathan wrote: > >> Hi Jon, >> >> I didn't try with the swift-version available in Justin's home directory. I can try and tell it now. >> >> But just a quick question: Does this version has WORKER_INIT_CMD ? >> >> Thank you >> Emalayan >> >> From: Jonathan Monette >> To: Emalayan Vairavanathan >> Cc: Justin Wozniak ; matei >> Sent: Monday, 20 February 2012 3:35 PM >> Subject: Re: WORKER_INIT_CMD - with log file >> >> I suggest to use the swift version in Justin's directory. This is the stable version for the bg/p. If you already are using it, then let me debug further. >> >> What login host where you running on, login1 or login2? >> >> On Feb 20, 2012, at 3:13 PM, Emalayan Vairavanathan wrote: >> >>> >>> Hi Jon and Justin, >>> >>> I checkout the swift-code from trunk and try to see whether ModFTDock+Swift works on Surveyor (without MosaStore). But the job did not complete for a long time. >>> >>> Could you please have a look ? >>> >>> (As I can remember, last time there was a bug when I tried to launch swift on Surveyor. Justin fixed the bug and asked me to use the swift executables from his home directory. May be this fix is not available in the trunk ?) >>> >>> Thank you >>> Emalayan >>> >>> From: Emalayan Vairavanathan >>> To: Jonathan Monette ; "emalayan at ece.ubc.ca" >>> Cc: Justin Wozniak ; matei ; MosaStore >>> Sent: Monday, 13 February 2012 3:08 PM >>> Subject: Re: WORKER_INIT_CMD >>> >>> Thank you very much Jon. I will ask you if I have questions. >>> >>> Regards >>> Emalayan >>> >>> From: Jonathan Monette >>> To: emalayan at ece.ubc.ca >>> Cc: Justin Wozniak >>> Sent: Sunday, 12 February 2012 4:50 PM >>> Subject: WORKER_INIT_CMD >>> >>> Emalayan, >>>? We have now added an environment variable to the worker script.? The variable is called WORKER_INIT_CMD and works like so: >>> >>> export WORKER_INIT_CMD= >>> >>> The worker will then run this script before entering it's main loop that waits for Swift apps to run.? You have to use manual coasters to use this variable, which I believe you already are doing. >>> >>> Let me know if you have any questions about this env variable. >>> >>> >>> >>> >>> >>> >> >> > -- Justin M Wozniak -------------- next part -------------- An HTML attachment was scrubbed... URL: From svemalayan at yahoo.com Thu Feb 23 18:08:18 2012 From: svemalayan at yahoo.com (Emalayan Vairavanathan) Date: Thu, 23 Feb 2012 16:08:18 -0800 (PST) Subject: [Swift-user] coaster-service.conf Message-ID: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> Hi All, When I launch coaster-service, it allocates job with default kernel profile "zeptoos". I want to change the profile to"zepto-vn-eval/mosatest". How can I do this ? Is there any configuration parameter available for kernel profile? Thank you Emalayan -------------- next part -------------- An HTML attachment was scrubbed... URL: From wozniak at mcs.anl.gov Thu Feb 23 18:08:39 2012 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Thu, 23 Feb 2012 18:08:39 -0600 (CST) Subject: [Swift-user] WORKER_INIT_CMD - with log file In-Reply-To: <1330041782.64906.YahooMailNeo@web39506.mail.mud.yahoo.com> References: <1329174515.43886.YahooMailNeo@web39505.mail.mud.yahoo.com> <1329771862.41926.YahooMailNeo@web39501.mail.mud.yahoo.com> <1329772390.14447.YahooMailNeo@web39504.mail.mud.yahoo.com> <8742CFD8-8C54-4D67-A0D0-945BB6AF9948@mcs.anl.gov> <1329781225.86597.YahooMailNeo@web39505.mail.mud.yahoo.com> <1330041782.64906.YahooMailNeo@web39506.mail.mud.yahoo.com> Message-ID: Do the pool names agree? You may want to check that you are using the right tc file. You might need tc.persistent.data . On Thu, 23 Feb 2012, Emalayan Vairavanathan wrote: > Hi Justin, > > I copied swift-test from ~wozniak/Public/swift-test and try to run it. I followed the steps below. > > - Modified the coaster-service-conf > > - Started the coaster service. > - Started swift > > > The tc.data has entries for cat but I am getting the error below. Do you have any ideas ? > > > Thank you > Emalayan > > emalayan at login2.surveyor:~/swift-test> run.sh > > Swift trunk swift-r5662 (swift modified locally) cog-r3361 (cog modified locally) > > RunID: 20120224-0000-rec5hd4a > Progress:? time: Fri, 24 Feb 2012 00:00:45 +0000 > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > Execution failed: > ?? ?EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > The application "cat" is not available in the given site/pool in your tc.data catalog? > > > > > > ________________________________ > From: Justin M Wozniak > To: Jonathan Monette > Cc: Emalayan Vairavanathan ; matei > Sent: Tuesday, 21 February 2012 12:40 PM > Subject: Re: WORKER_INIT_CMD - with log file > > Hi guys > > Yes, that version is based on trunk and is up-to-date with > WORKER_INIT_CMD.? The recent bug fix for the BG/P is in there, I just > tested it. > > I moved the location to ~wozniak/Public/swift .? The test case I used is > in ~wozniak/Public/swift-test .? Both should be readable. > > ??? Justin > > On Mon, 20 Feb 2012, Jonathan Monette wrote: > >> It might....that is a question that Justin can answer.? If it doesn't I am sure the feature can be quickly added. >> >> On Feb 20, 2012, at 5:40 PM, Emalayan Vairavanathan wrote: >> >>> Hi Jon, >>> >>> I didn't try with the swift-version available in Justin's home directory. I can try and tell it now. >>> >>> But just a quick question: Does this version has WORKER_INIT_CMD ? >>> >>> Thank you >>> Emalayan >>> >>> From: Jonathan Monette >>> To: Emalayan Vairavanathan >>> Cc: Justin Wozniak ; matei >>> Sent: Monday, 20 February 2012 3:35 PM >>> Subject: Re: WORKER_INIT_CMD - with log file >>> >>> I suggest to use the swift version in Justin's directory. This is the stable version for the bg/p. If you already are using it, then let me debug further. >>> >>> What login host where you running on, login1 or login2? >>> >>> On Feb 20, 2012, at 3:13 PM, Emalayan Vairavanathan wrote: >>> >>>> >>>> Hi Jon and Justin, >>>> >>>> I checkout the swift-code from trunk and try to see whether ModFTDock+Swift works on Surveyor (without MosaStore). But the job did not complete for a long time. >>>> >>>> Could you please have a look ? >>>> >>>> (As I can remember, last time there was a bug when I tried to launch swift on Surveyor. Justin fixed the bug and asked me to use the swift executables from his home directory. May be this fix is not available in the trunk ?) >>>> >>>> Thank you >>>> Emalayan >>>> >>>> From: Emalayan Vairavanathan >>>> To: Jonathan Monette ; "emalayan at ece.ubc.ca" >>>> Cc: Justin Wozniak ; matei ; MosaStore >>>> Sent: Monday, 13 February 2012 3:08 PM >>>> Subject: Re: WORKER_INIT_CMD >>>> >>>> Thank you very much Jon. I will ask you if I have questions. >>>> >>>> Regards >>>> Emalayan >>>> >>>> From: Jonathan Monette >>>> To: emalayan at ece.ubc.ca >>>> Cc: Justin Wozniak >>>> Sent: Sunday, 12 February 2012 4:50 PM >>>> Subject: WORKER_INIT_CMD >>>> >>>> Emalayan, >>>> ? We have now added an environment variable to the worker script.? The variable is called WORKER_INIT_CMD and works like so: >>>> >>>> export WORKER_INIT_CMD= >>>> >>>> The worker will then run this script before entering it's main loop that waits for Swift apps to run.? You have to use manual coasters to use this variable, which I believe you already are doing. >>>> >>>> Let me know if you have any questions about this env variable. >>>> >>>> >>>> >>>> >>>> >>>> >>> >>> >> > > -- > Justin M Wozniak -- Justin M Wozniak From wozniak at mcs.anl.gov Thu Feb 23 18:11:58 2012 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Thu, 23 Feb 2012 18:11:58 -0600 (CST) Subject: [Swift-user] coaster-service.conf In-Reply-To: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> References: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> Message-ID: That is set by the cqsub line in start-coaster-service. We will add a setting for that but you should feel free to change the cqsub line to include whatever settings you need. On Thu, 23 Feb 2012, Emalayan Vairavanathan wrote: > Hi All, > > When I launch coaster-service, it allocates job with default kernel profile "zeptoos". I want to change the profile to"zepto-vn-eval/mosatest". > How can I do this ? Is there any configuration parameter available for kernel profile? > > Thank you > Emalayan -- Justin M Wozniak From svemalayan at yahoo.com Thu Feb 23 18:28:35 2012 From: svemalayan at yahoo.com (Emalayan Vairavanathan) Date: Thu, 23 Feb 2012 16:28:35 -0800 (PST) Subject: [Swift-user] WORKER_INIT_CMD - with log file In-Reply-To: References: <1329174515.43886.YahooMailNeo@web39505.mail.mud.yahoo.com> <1329771862.41926.YahooMailNeo@web39501.mail.mud.yahoo.com> <1329772390.14447.YahooMailNeo@web39504.mail.mud.yahoo.com> <8742CFD8-8C54-4D67-A0D0-945BB6AF9948@mcs.anl.gov> <1329781225.86597.YahooMailNeo@web39505.mail.mud.yahoo.com> <1330041782.64906.YahooMailNeo@web39506.mail.mud.yahoo.com> Message-ID: <1330043315.75850.YahooMailNeo@web39506.mail.mud.yahoo.com> Thank you. I was not aware about that. Now I am getting the error below. Am I missing some configurations ? Thank you Emalayan Swift trunk swift-r5662 (swift modified locally) cog-r3361 (cog modified locally) RunID: 20120224-0021-jtfvfc90 Progress:? time: Fri, 24 Feb 2012 00:21:32 +0000 Find: http://172.17.3.12:12346 Find:? keepalive(120), reconnect - http://172.17.3.12:12346 Failed to transfer wrapper log for job cat-leiykink Failed to transfer wrapper log for job cat-qeiykink Failed to transfer wrapper log for job cat-jeiykink Failed to transfer wrapper log for job cat-meiykink Failed to transfer wrapper log for job cat-oeiykink Failed to transfer wrapper log for job cat-peiykink Failed to transfer wrapper log for job cat-keiykink Failed to transfer wrapper log for job cat-seiykink Failed to transfer wrapper log for job cat-neiykink Progress:? time: Fri, 24 Feb 2012 00:21:33 +0000? Stage in:3? Submitting:5 Failed but can retry:2 Failed to transfer wrapper log for job cat-reiykink Failed to transfer wrapper log for job cat-3fiykink Failed to transfer wrapper log for job cat-7fiykink Failed to transfer wrapper log for job cat-8fiykink Failed to transfer wrapper log for job cat-bfiykink Failed to transfer wrapper log for job cat-zeiykink Failed to transfer wrapper log for job cat-0fiykink Failed to transfer wrapper log for job cat-afiykink Failed to transfer wrapper log for job cat-yeiykink Failed to transfer wrapper log for job cat-1fiykink Failed to transfer wrapper log for job cat-dfiykink Failed to transfer wrapper log for job cat-ffiykink EXCEPTION Exception in cat: Arguments: [data.txt] Host: persistent-coasters Directory: 001-catsn-surveyor-20120224-0021-jtfvfc90/jobs/f/cat-ffiykink stderr.txt: stdout.txt: ---- Caused by: Task failed: null org.globus.cog.karajan.workflow.service.channels.ChannelException: Channel died and no contact available ??? at org.globus.cog.karajan.workflow.service.channels.ChannelManager.connect(ChannelManager.java:234) ??? at org.globus.cog.karajan.workflow.service.channels.ChannelManager.reserveChannel(ChannelManager.java:256) ??? at org.globus.cog.karajan.workflow.service.channels.ChannelManager.reserveChannel(ChannelManager.java:226) ??? at org.globus.cog.abstraction.coaster.service.job.manager.Node.getChannel(Node.java:132) ??? at org.globus.cog.abstraction.coaster.service.job.manager.Cpu.submit(Cpu.java:258) ??? at org.globus.cog.abstraction.coaster.service.job.manager.Cpu.launchSequential(Cpu.java:213) ??? at org.globus.cog.abstraction.coaster.service.job.manager.Cpu.launch(Cpu.java:199) ??? at org.globus.cog.abstraction.coaster.service.job.manager.Cpu.pull(Cpu.java:169) ??? at org.globus.cog.abstraction.coaster.service.job.manager.PullThread.run(PullThread.java:114) Execution failed: ??? Failed to transfer wrapper log for job cat-mfiykink EXCEPTION Exception in cat: Arguments: [data.txt] Host: persistent-coasters Directory: 001-catsn-surveyor-20120224-0021-jtfvfc90/jobs/m/cat-mfiykink stderr.txt: stdout.txt: ---- ________________________________ From: Justin M Wozniak To: Emalayan Vairavanathan Cc: Jonathan Monette ; swift user ; matei Sent: Thursday, 23 February 2012 4:08 PM Subject: Re: WORKER_INIT_CMD - with log file Do the pool names agree?? You may want to check that you are using the right tc file.? You might need tc.persistent.data . On Thu, 23 Feb 2012, Emalayan Vairavanathan wrote: > Hi Justin, > > I copied swift-test from ~wozniak/Public/swift-test and try to run it. I followed the steps below. > > - Modified the coaster-service-conf > > - Started the coaster service. > - Started swift > > > The tc.data has entries for cat but I am getting the error below. Do you have any ideas ? > > > Thank you > Emalayan > > emalayan at login2.surveyor:~/swift-test> run.sh > > Swift trunk swift-r5662 (swift modified locally) cog-r3361 (cog modified locally) > > RunID: 20120224-0000-rec5hd4a > Progress:? time: Fri, 24 Feb 2012 00:00:45 +0000 > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > Execution failed: > ?? ?EXCEPTION The application "cat" is not available in the given site/pool in your tc.data catalog > Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException > The application "cat" is not available in the given site/pool in your tc.data catalog? > > > > > > ________________________________ > From: Justin M Wozniak > To: Jonathan Monette > Cc: Emalayan Vairavanathan ; matei > Sent: Tuesday, 21 February 2012 12:40 PM > Subject: Re: WORKER_INIT_CMD - with log file > > Hi guys > > Yes, that version is based on trunk and is up-to-date with > WORKER_INIT_CMD.? The recent bug fix for the BG/P is in there, I just > tested it. > > I moved the location to ~wozniak/Public/swift .? The test case I used is > in ~wozniak/Public/swift-test .? Both should be readable. > > ??? Justin > > On Mon, 20 Feb 2012, Jonathan Monette wrote: > >> It might....that is a question that Justin can answer.? If it doesn't I am sure the feature can be quickly added. >> >> On Feb 20, 2012, at 5:40 PM, Emalayan Vairavanathan wrote: >> >>> Hi Jon, >>> >>> I didn't try with the swift-version available in Justin's home directory. I can try and tell it now. >>> >>> But just a quick question: Does this version has WORKER_INIT_CMD ? >>> >>> Thank you >>> Emalayan >>> >>> From: Jonathan Monette >>> To: Emalayan Vairavanathan >>> Cc: Justin Wozniak ; matei >>> Sent: Monday, 20 February 2012 3:35 PM >>> Subject: Re: WORKER_INIT_CMD - with log file >>> >>> I suggest to use the swift version in Justin's directory. This is the stable version for the bg/p. If you already are using it, then let me debug further. >>> >>> What login host where you running on, login1 or login2? >>> >>> On Feb 20, 2012, at 3:13 PM, Emalayan Vairavanathan wrote: >>> >>>> >>>> Hi Jon and Justin, >>>> >>>> I checkout the swift-code from trunk and try to see whether ModFTDock+Swift works on Surveyor (without MosaStore). But the job did not complete for a long time. >>>> >>>> Could you please have a look ? >>>> >>>> (As I can remember, last time there was a bug when I tried to launch swift on Surveyor. Justin fixed the bug and asked me to use the swift executables from his home directory. May be this fix is not available in the trunk ?) >>>> >>>> Thank you >>>> Emalayan >>>> >>>> From: Emalayan Vairavanathan >>>> To: Jonathan Monette ; "emalayan at ece.ubc.ca" >>>> Cc: Justin Wozniak ; matei ; MosaStore >>>> Sent: Monday, 13 February 2012 3:08 PM >>>> Subject: Re: WORKER_INIT_CMD >>>> >>>> Thank you very much Jon. I will ask you if I have questions. >>>> >>>> Regards >>>> Emalayan >>>> >>>> From: Jonathan Monette >>>> To: emalayan at ece.ubc.ca >>>> Cc: Justin Wozniak >>>> Sent: Sunday, 12 February 2012 4:50 PM >>>> Subject: WORKER_INIT_CMD >>>> >>>> Emalayan, >>>> ?? We have now added an environment variable to the worker script.? The variable is called WORKER_INIT_CMD and works like so: >>>> >>>> export WORKER_INIT_CMD= >>>> >>>> The worker will then run this script before entering it's main loop that waits for Swift apps to run.? You have to use manual coasters to use this variable, which I believe you already are doing. >>>> >>>> Let me know if you have any questions about this env variable. >>>> >>>> >>>> >>>> >>>> >>>> >>> >>> >> > > -- > Justin M Wozniak -- Justin M Wozniak -------------- next part -------------- An HTML attachment was scrubbed... URL: From svemalayan at yahoo.com Thu Feb 23 18:54:21 2012 From: svemalayan at yahoo.com (Emalayan Vairavanathan) Date: Thu, 23 Feb 2012 16:54:21 -0800 (PST) Subject: [Swift-user] coaster-service.conf In-Reply-To: References: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> Message-ID: <1330044861.69856.YahooMailNeo@web39504.mail.mud.yahoo.com> Hi Justin, Thank you for the reply. By the way .... How I can specify / pass this cqsub line ? (via start-coaster-service's command-line parameter or via a setting in coaster-service.conf) Also could you please tell me the exact format ? Please point to me a document if there is any. Thank you Emalayan ________________________________ From: Justin M Wozniak To: Emalayan Vairavanathan Cc: swift user ; MosaStore Sent: Thursday, 23 February 2012 4:11 PM Subject: Re: [Swift-user] coaster-service.conf That is set by the cqsub line in start-coaster-service.? We will add a setting for that but you should feel free to change the cqsub line to include whatever settings you need. On Thu, 23 Feb 2012, Emalayan Vairavanathan wrote: > Hi All, > > When I launch coaster-service, it allocates job with default kernel profile "zeptoos". I want to change the profile to"zepto-vn-eval/mosatest". > How can I do this ? Is there any configuration parameter available for kernel profile? > > Thank you > Emalayan -- Justin M Wozniak -- You received this message because you are subscribed to the Google Groups "MosaStore" group. To post to this group, send email to mosastore at googlegroups.com. To unsubscribe from this group, send email to mosastore+unsubscribe at googlegroups.com. For more options, visit this group at http://groups.google.com/group/mosastore?hl=en. -------------- next part -------------- An HTML attachment was scrubbed... URL: From iraicu at cs.iit.edu Sun Feb 26 07:57:48 2012 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Sun, 26 Feb 2012 07:57:48 -0600 Subject: [Swift-user] CFP: The 9th Int. Conf. on Autonomic Computing (ICAC) 2012 Message-ID: <4F4A3A5C.7010304@cs.iit.edu> CALL FOR PAPERS The 9th International Conference on Autonomic Computing (ICAC 2012) September 16-20, 2012. San Jose, CA, USA http://icac2012.cs.fiu.edu/ ----------------------------------------------------------------- IMPORTANT DATES Paper and Poster Submission: March 9, 2012, 11:59pm PST Notification: May 18, 2012 Camera-ready Due: June 8, 2012 ----------------------------------------------------------------- OVERVIEW ICAC is the leading conference on autonomic computing techniques, foundations, and applications. Autonomic computing refers to methods and means for automated management of performance, fault, security, and configuration with little involvement of users or administrators. Systems introducing new autonomic features are becoming increasingly prevalent, motivating research that spans a variety of areas, from computer systems, networking, software engineering, and data management to machine learning, control theory, and bio-inspired computing. ICAC brings together researchers and practitioners across these disciplines to address multiple facets of adaptation and self-management in computing systems and applications from different perspectives. Autonomic computing solutions are sought for clouds, grids, data centers, enterprise software, internet services, data services, smart phones, embedded systems, and sensor networks. In these environments, resources and applications must be managed to maximize performance and minimize cost, while maintaining predictable and reliable behavior in the face of varying workloads, failures, and malicious threats. Papers are solicited from all areas of autonomic computing, including (but not limited to): * End-to-end techniques for management of resources, workloads, performance, faults, power/cooling, security, and others. * Self-managing components, such as server, storage, network protocols, or specific application elements, and embedded and mobile end systems such as smart phones. * Decision and analysis techniques and their use, such as machine learning, control theory, predictive methods, probability and stochastic processes, queuing theory methodologies, emergent behavior, rule-based systems, and bio-inspired techniques. * Monitoring systems for autonomic computing. * Hypervisor, operating systems, hardware, or application support for autonomic computing. * Novel human interfaces for monitoring and controlling autonomic systems. * Management topics, such as specification and modeling of service-level agreements, behavior enforcement and tie-in with IT governance. * Toolkits, frameworks, principles and architectures, from software engineering practices and experimental methodologies to agent-based techniques and virtualization. * Fundamental science and theory of self-managing systems: understanding, controlling or exploiting system behaviors to enforce autonomic properties. * Applications of autonomic computing and experiences with prototyped or deployed systems solving real-world problems in science, engineering, business and society. Papers will be judged on originality, significance, interest, correctness, clarity and relevance to the broader community. Papers should report on experiences, measurements, user studies, or other evaluations, as appropriate. Evaluations of a prototype or large-scale deployment of systems and applications is expected. PAPER AND POSTER SUBMISSIONS Full papers (a maximum of 10 pages in the two-column ACM proceedings format) and posters (2 pages) are invited on a wide variety of topics relating to autonomic computing. Submitted papers must be original work, and may not be under consideration for another conference or journal. Complete formatting and submission instructions can be found on the conference web site. Accepted papers and posters will appear in proceedings distributed at the conference and available electronically. Relevant top ICAC'12 papers will be invited for "fast-track" submissions to the ACM Transactions on Autonomous and Adaptive Systems (TAAS). WORKSHOPS, DEMONSTRATIONS AND EXHIBITION ICAC'12 welcomes proposals for co-located workshops on topics of interest to the autonomic computing community. Workshop proposals should be submitted to the Workshop Chair, Fred Douglis (f.douglis at computer.org) by February 10, 2012. Workshops are expected to publish proceedings, and should cover areas that complement the main program. ICAC'12 will also feature a demonstration and exhibition session consisting of prototypes and technology artifacts such as demonstrating autonomic software or autonomic computing principles. Entries will be judged by a separate committee led by the demo/exhibit chair. INDUSTRY SESSION One of ICAC's important roles is to bring together researchers and practitioners from academia and industry. In its industry session, ICAC helps fulfill this role by presenting an industry viewpoint on technologies, products, and market needs. The industry session also addresses current challenges, and opportunities for academic and corporate research collaborations. We encourage industry leaders, including entrepreneurs, product developers, architects, managers, marketers and end users, to submit their papers and posters reflecting such industry perspectives as part of the regular submission process. ------------------------------------------------------------------ ORGANIZERS GENERAL CHAIR Dejan Milojicic, HP Labs PROGRAM CHAIRS Dongyan Xu, Purdue University Vanish Talwar, HP Labs INDUSTRY CHAIR Xiaoyun Zhu, VMware WORKSHOPS CHAIR Fred Douglis, EMC POSTERS/DEMO/EXHIBITS CHAIR Eno Thereska, Microsoft Research FINANCE CHAIR Michael Kozuch, Intel LOCAL ARRANGEMENT CHAIR Jessica Blaine PUBLICITY CHAIRS Daniel Batista, University of S?o Paulo Vartan Padaryan, ISP/Russian Academy of Sci. Ioan Raicu, Illinois Inst. of Technology Jianfeng Zhan, ICT/Chinese Academy of Sci. Ming Zhao, Florida Intl. University PROGRAM COMMITTEE Tarek Abdelzaher, UIUC Umesh Bellur, IIT, Bombay Ken Birman, Cornell University Rajkumar Buyya, Univ. of Melbourne Rocky Chang, Hong Kong Polytechnic University Yuan Chen, HP Labs Alva Couch, Tufts University Peter Dinda, Northwestern University Fred Douglis, EMC Renato Figueiredo, University of Florida Mohamed Hefeeda, Qatar Computing Research Institute Joe Hellerstein, Google Geoff Jiang, NEC Labs Jeff Kephart, IBM Research Emre Kiciman, Microsoft Research Fabio Kon, University of S?o Paulo Michael Kozuch, Intel Dejan Milojicic, HP Labs Klara Nahrstedt, UIUC Priya Narasimhan, CMU Manish Parashar, Rutgers University Ioan Raicu, Illinois Inst. of Technology Omer Rana, Cardiff University Masoud Sadjadi, Florida Intl. University Rick Schlichting, AT&T Labs Hartmut Schmeck, KIT Karsten Schwan, Georgia Tech Onn Shehory, IBM Research Eno Thereska, Microsoft Research Xiaoyun Zhu, VMware -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ ================================================================= ================================================================= From iraicu at cs.iit.edu Sun Feb 26 08:28:38 2012 From: iraicu at cs.iit.edu (Ioan Raicu) Date: Sun, 26 Feb 2012 08:28:38 -0600 Subject: [Swift-user] CFP: IEEE Int. Scalable Computing Challenge (SCALE) at CCGrid 2012 Message-ID: <4F4A4196.1090701@cs.iit.edu> CALL FOR PAPERS The Fifth IEEE International Scalable Computing Challenge (SCALE) Co-located with the 11th CCGrid Conference in Ottawa, Canada Sponsored by the IEEE Computer Society Technical Committee on Scalable Computing (TCSC) May 13-16, 2012 http://www.cloudbus.org/ccgrid2012/cfp-scale.html --------------------------------------------------------------------- Objective and Focus: The objective of the Fifth IEEE International Scalable Computing Challenge (SCALE 2012), sponsored by the IEEE Computer Society Technical Committee on Scalable Computing (TCSC), is to highlight and showcase real-world problem solving using computing that scales. Effective solutions to many scientific problems require applications that can scale. There are different dimensions to application scaling: for example, applications can scale-up to large number of cores or compute units, scale-out to utilize multiple distinct compute units, or scale-down to release resources that are no longer needed. In order to scale, applications need the support of tools, middleware, infrastructure, programming systems, etc. SCALE is concerned with advances in application development and supporting infrastructure that enable scaling. Call for Proposals: The Fifth IEEE International Scalable Computing Challenge (SCALE 2012) contest will focus on end-to-end problem solving using concepts, technologies and architectures (including Clusters, Grids and Clouds) that facilitate scaling. Participants in the challenge will be expected to identify significant current real-world problems where scalable computing techniques can be effectively used, and design, implement, evaluate and demonstrate solutions. SCALE2012 will be held in conjunction with the 11th CCGrid Conference in Ottawa, Canada on 13-16 May, 2012. We invite teams to submit white papers outlining the problem addressed and the technologies employed to enable applications to scale. White papers should be up to 4 pages long, 12-pt. font and single column, and in addition to listing team members and contact information, should clearly outline: 1. The problem being solved and the technology employed 2. The application scenario and its requirements 3. Performance data and a qualitative description of how the application scales -- scale-up, scale-out or any other type of scaling 4. The solution -- architecture, underlying concepts and technologies used -- highlighting the innovative aspects of the solution 5. Impact of the solution, including extensibility and uniqueness of results, and the extent to which the presented solution pushes the envelope in scalable computing 6. Analysis of solution and technology employed compared to related approaches In addition to the above, finalists will be judged on the quality of their presentation, which shall include a 5-minute demonstration, as well as their responses to questions by a technical committee. Papers will be shortlisted using the above 6 points as merit criteria, and up to 6 papers will be invited to compete in a final round at CCGrid 2012. Selected teams will receive an award of up to $1000 to help with travel to the conference. At least one member from each selected team will be expected to present and demonstrate their project at CCGrid 2012. Participation from students and young researchers, especially in leadership roles, is strongly encouraged. Awards: First prize: Plaque + $1000 Second prize: Plaque + $500 Tentative timeline: The deadline for submitting proposals is 15 March, 2012. Decisions: 01 April 2012. Final presentation/demo: 13-16 May, 2012. Coordinator: Shantenu Jha, Rutgers University, USA, shantenu dot jha at rutgers dot edu -- ================================================================= Ioan Raicu, Ph.D. Assistant Professor, Illinois Institute of Technology (IIT) Guest Research Faculty, Argonne National Laboratory (ANL) ================================================================= Data-Intensive Distributed Systems Laboratory, CS/IIT Distributed Systems Laboratory, MCS/ANL ================================================================= Cel: 1-847-722-0876 Office: 1-312-567-5704 Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/ Web: http://datasys.cs.iit.edu/ ================================================================= ================================================================= From svemalayan at yahoo.com Mon Feb 27 19:33:27 2012 From: svemalayan at yahoo.com (Emalayan Vairavanathan) Date: Mon, 27 Feb 2012 17:33:27 -0800 (PST) Subject: [Swift-user] coaster-service.conf In-Reply-To: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> References: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> Message-ID: <1330392807.45327.YahooMailNeo@web39506.mail.mud.yahoo.com> Hi All, When I launch coaster-service, it allocates job with default kernel profile "zeptoos". I want to change the profile to"zepto-vn-eval/mosatest". How can I do this ? Is there any configuration parameter available to change qsub command? If so how I can specify / pass this parameter?? (via start-coaster-service's command-line parameter or via a setting in coaster-service.conf) Also could you please tell me the exact format ? Please point to me a document if there is any. Thank you Emalayan -------------- next part -------------- An HTML attachment was scrubbed... URL: From jonmon at mcs.anl.gov Mon Feb 27 20:13:18 2012 From: jonmon at mcs.anl.gov (Jonathan Monette) Date: Mon, 27 Feb 2012 20:13:18 -0600 Subject: [Swift-user] coaster-service.conf In-Reply-To: <1330392807.45327.YahooMailNeo@web39506.mail.mud.yahoo.com> References: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> <1330392807.45327.YahooMailNeo@web39506.mail.mud.yahoo.com> Message-ID: <53278513-44C1-48AF-9026-92F9A34487F1@mcs.anl.gov> I assume you mean the "-k" option in the cqsub command. So currently this is hard coded into the start-coaster-service script, it always uses zeptoos. I have made a quick change that uses a KERNEL variable that needs to be set in the coaster-service.conf file. Are you using your own checkout of trunk or the one in Justin's home directory? On Feb 27, 2012, at 7:33 PM, Emalayan Vairavanathan wrote: > Hi All, > > When I launch coaster-service, it allocates job with default kernel profile "zeptoos". I want to change the profile to "zepto-vn-eval/mosatest". > How can I do this ? Is there any configuration parameter available to change qsub command? > > If so how I can specify / pass this parameter? (via start-coaster-service 's command-line parameter or via a setting in coaster-service.conf) > > Also could you please tell me the exact format ? Please point to me a document if there is any. > > > Thank you > Emalayan > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -------------- next part -------------- An HTML attachment was scrubbed... URL: From svemalayan at yahoo.com Mon Feb 27 21:06:33 2012 From: svemalayan at yahoo.com (Emalayan Vairavanathan) Date: Mon, 27 Feb 2012 19:06:33 -0800 (PST) Subject: [Swift-user] coaster-service.conf In-Reply-To: <53278513-44C1-48AF-9026-92F9A34487F1@mcs.anl.gov> References: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> <1330392807.45327.YahooMailNeo@web39506.mail.mud.yahoo.com> <53278513-44C1-48AF-9026-92F9A34487F1@mcs.anl.gov> Message-ID: <1330398393.5937.YahooMailNeo@web39503.mail.mud.yahoo.com> Hi Jon Thank you very much. Please find my ans below. I assume you mean the "-k" option in the cqsub command. What I meant was "--kernel" option in qsub. Are you using your own checkout of trunk or the one in Justin's home directory? Code from Justin's home directory Thank you very much. Emalayan ________________________________ From: Jonathan Monette To: Emalayan Vairavanathan Cc: swift user ; "swift-devel at ci.uchicago.edu" ; MosaStore Sent: Monday, 27 February 2012 6:13 PM Subject: Re: [Swift-user] coaster-service.conf I assume you mean the "-k" option in the cqsub command. ?So currently this is hard coded into the start-coaster-service script, it always uses zeptoos. ?I have made a quick change that uses a KERNEL variable that needs to be set in the coaster-service.conf file. ?Are you using your own checkout of trunk or the one in Justin's home directory? On Feb 27, 2012, at 7:33 PM, Emalayan Vairavanathan wrote: Hi All, > > >When I launch coaster-service, it allocates job with default kernel profile "zeptoos". I want to change the profile to"zepto-vn-eval/mosatest". >How can I do this ? Is there any configuration parameter available to change qsub command? > > >If so how I can specify / pass this parameter?? (via start-coaster-service's command-line parameter or via a setting in coaster-service.conf) > >Also could you please tell me the exact format ? Please point to me a document if there is any. > > > > >Thank you >Emalayan > > >_______________________________________________ >Swift-user mailing list >Swift-user at ci.uchicago.edu >https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user -------------- next part -------------- An HTML attachment was scrubbed... URL: From jonmon at mcs.anl.gov Mon Feb 27 21:39:14 2012 From: jonmon at mcs.anl.gov (Jonathan Monette) Date: Mon, 27 Feb 2012 21:39:14 -0600 Subject: [Swift-user] coaster-service.conf In-Reply-To: <1330398393.5937.YahooMailNeo@web39503.mail.mud.yahoo.com> References: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> <1330392807.45327.YahooMailNeo@web39506.mail.mud.yahoo.com> <53278513-44C1-48AF-9026-92F9A34487F1@mcs.anl.gov> <1330398393.5937.YahooMailNeo@web39503.mail.mud.yahoo.com> Message-ID: <37C4069A-300B-4FB8-BCFD-C8E97143FDBA@mcs.anl.gov> On Feb 27, 2012, at 9:06 PM, Emalayan Vairavanathan wrote: > Hi Jon > > Thank you very much. Please find my ans below. > > I assume you mean the "-k" option in the cqsub command. > > What I meant was "--kernel" option in qsub. So the start-coaster-service for cobalt uses cqsub and not qsub. qsub has the --kernel option while cqsub has the -k option. Looking at the man pages they seem to be the same, but not sure. Justin can probably provide more information on the difference, or point to a document that explains when one should be used over the other. > > > Are you using your own checkout of trunk or the one in Justin's home directory? > > Code from Justin's home directory Then Justin will have to do a svn up tomorrow for you. We probably should figure out a way for you to have your own stable copy to make changes too, so that us updating that copy is not a blocker for you progressing further. > > > Thank you very much. > Emalayan > From: Jonathan Monette > To: Emalayan Vairavanathan > Cc: swift user ; "swift-devel at ci.uchicago.edu" ; MosaStore > Sent: Monday, 27 February 2012 6:13 PM > Subject: Re: [Swift-user] coaster-service.conf > > I assume you mean the "-k" option in the cqsub command. So currently this is hard coded into the start-coaster-service script, it always uses zeptoos. I have made a quick change that uses a KERNEL variable that needs to be set in the coaster-service.conf file. Are you using your own checkout of trunk or the one in Justin's home directory? > > On Feb 27, 2012, at 7:33 PM, Emalayan Vairavanathan wrote: > >> Hi All, >> >> When I launch coaster-service, it allocates job with default kernel profile "zeptoos". I want to change the profile to "zepto-vn-eval/mosatest". >> How can I do this ? Is there any configuration parameter available to change qsub command? >> >> If so how I can specify / pass this parameter? (via start-coaster-service 's command-line parameter or via a setting in coaster-service.conf) >> >> Also could you please tell me the exact format ? Please point to me a document if there is any. >> >> >> Thank you >> Emalayan >> >> >> _______________________________________________ >> Swift-user mailing list >> Swift-user at ci.uchicago.edu >> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From svemalayan at yahoo.com Mon Feb 27 22:59:20 2012 From: svemalayan at yahoo.com (Emalayan Vairavanathan) Date: Mon, 27 Feb 2012 20:59:20 -0800 (PST) Subject: [Swift-user] coaster-service.conf In-Reply-To: <37C4069A-300B-4FB8-BCFD-C8E97143FDBA@mcs.anl.gov> References: <1330042098.422.YahooMailNeo@web39507.mail.mud.yahoo.com> <1330392807.45327.YahooMailNeo@web39506.mail.mud.yahoo.com> <53278513-44C1-48AF-9026-92F9A34487F1@mcs.anl.gov> <1330398393.5937.YahooMailNeo@web39503.mail.mud.yahoo.com> <37C4069A-300B-4FB8-BCFD-C8E97143FDBA@mcs.anl.gov> Message-ID: <1330405160.59260.YahooMailNeo@web39508.mail.mud.yahoo.com> So the start-coaster-service for cobalt uses cqsub and not qsub. ?qsub has the --kernel option while cqsub has the -k option. ?Looking at the man pages they seem to be the same, but not sure. ?Justin can probably provide more information on the difference, or point to a document that explains when one should be used over the other. >> Thank youvery much for fixing it Jon. I am not sure about the trade-offs though. I can switch to cqsub if it is necessary. Then Justin will have to do a svn up tomorrow for you. ?We probably should figure out a way for you to have your own stable copy to make changes too, so that us updating that copy is not a blocker for you progressing further. >> Yes. We need to talk about this in Wednesday meeting. Justin could you please take an update ? Thank you Emalayan ________________________________ From: Jonathan Monette To: Emalayan Vairavanathan Cc: swift user ; "swift-devel at ci.uchicago.edu" ; MosaStore Sent: Monday, 27 February 2012 7:39 PM Subject: Re: [Swift-user] coaster-service.conf On Feb 27, 2012, at 9:06 PM, Emalayan Vairavanathan wrote: Hi Jon > > >Thank you very much. Please find my ans below. > > >I assume you mean the "-k" option in the cqsub command. > > > >What I meant was "--kernel" option in qsub. > So the start-coaster-service for cobalt uses cqsub and not qsub. ?qsub has the --kernel option while cqsub has the -k option. ?Looking at the man pages they seem to be the same, but not sure. ?Justin can probably provide more information on the difference, or point to a document that explains when one should be used over the other. > > > >Are you using your own checkout of trunk or the one in Justin's home directory? > > >Code from Justin's home directory Then Justin will have to do a svn up tomorrow for you. ?We probably should figure out a way for you to have your own stable copy to make changes too, so that us updating that copy is not a blocker for you progressing further. > > > >Thank you very much. > >Emalayan > > >________________________________ > From: Jonathan Monette >To: Emalayan Vairavanathan >Cc: swift user ; "swift-devel at ci.uchicago.edu" ; MosaStore >Sent: Monday, 27 February 2012 6:13 PM >Subject: Re: [Swift-user] coaster-service.conf > > >I assume you mean the "-k" option in the cqsub command. ?So currently this is hard coded into the start-coaster-service script, it always uses zeptoos. ?I have made a quick change that uses a KERNEL variable that needs to be set in the coaster-service.conf file. ?Are you using your own checkout of trunk or the one in Justin's home directory? > > >On Feb 27, 2012, at 7:33 PM, Emalayan Vairavanathan wrote: > >Hi All, >> >> >>When I launch coaster-service, it allocates job with default kernel profile "zeptoos". I want to change the profile to"zepto-vn-eval/mosatest". >>How can I do this ? Is there any configuration parameter available to change qsub command? >> >> >>If so how I can specify / pass this parameter?? (via start-coaster-service's command-line parameter or via a setting in coaster-service.conf) >> >>Also could you please tell me the exact format ? Please point to me a document if there is any. >> >> >> >> >>Thank you >>Emalayan >> >> >>_______________________________________________ >>Swift-user mailing list >>Swift-user at ci.uchicago.edu >>https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: