From aespinosa at cs.uchicago.edu Mon May 3 18:39:20 2010 From: aespinosa at cs.uchicago.edu (Allan Espinosa) Date: Mon, 3 May 2010 18:39:20 -0500 Subject: [Swift-user] handling prestaged data on multiple sites Message-ID: Hi, I prestaged 11k small files (total ~2GB) to two sites. if I were just computing on 1 site, i can just place hardwired strings of absolute pathnames to disable staging. I was originally thinking of passing '$OSG_DATA' variable names since the app functions wraps to bash shell scripts. this backfired because swift passes these string args literally. any other recommended approaches? thanks! -Allan -- Allan M. Espinosa PhD student, Computer Science University of Chicago From aespinosa at cs.uchicago.edu Tue May 4 10:45:41 2010 From: aespinosa at cs.uchicago.edu (Allan Espinosa) Date: Tue, 04 May 2010 10:45:41 -0500 Subject: [Swift-user] handling prestaged data on multiple sites In-Reply-To: <20100504151909.0709919E00EB@zimbra.anl.gov> References: <20100504151909.0709919E00EB@zimbra.anl.gov> Message-ID: <1272987941.12927.10.camel@origin> Hi Justin, I used globus.org's data movement service. Right now I have the dataset on these OSG sites: ff-grid.unl.edu:/panfs/panasas/CMS/data/scec/RuptureVariations/* tuscany.med.harvard.edu:/osg/storage/data/engage/scec/RuptureVariations/* On Mar, 2010-05-04 at 10:20 -0500, Justin Wozniak wrote: > > This is probably a good use case for CDM. How did you prestage the > files? > > > > ______________________________________________________________________ > Allan Espinosa wrote: > > Hi, > > I prestaged 11k small files (total ~2GB) to two sites. if I were just > computing on 1 site, i can just place hardwired strings of absolute > pathnames to disable staging. I was originally thinking of passing > '$OSG_DATA' variable names since the app functions wraps to bash > shell > scripts. this backfired because swift passes these string args > literally. > > any other recommended approaches? > > thanks! > -Allan From foster at anl.gov Tue May 4 11:09:48 2010 From: foster at anl.gov (Ian Foster) Date: Tue, 4 May 2010 11:09:48 -0500 Subject: [Swift-user] handling prestaged data on multiple sites In-Reply-To: <1272987941.12927.10.camel@origin> References: <20100504151909.0709919E00EB@zimbra.anl.gov> <1272987941.12927.10.camel@origin> Message-ID: What is CDM? Ian On May 4, 2010, at 10:45 AM, Allan Espinosa wrote: > Hi Justin, > > I used globus.org's data movement service. > > Right now I have the dataset on these OSG sites: > > ff-grid.unl.edu:/panfs/panasas/CMS/data/scec/RuptureVariations/* > tuscany.med.harvard.edu:/osg/storage/data/engage/scec/RuptureVariations/* > > On Mar, 2010-05-04 at 10:20 -0500, Justin Wozniak wrote: >> >> This is probably a good use case for CDM. How did you prestage the >> files? >> >> >> >> ______________________________________________________________________ >> Allan Espinosa wrote: >> >> Hi, >> >> I prestaged 11k small files (total ~2GB) to two sites. if I were just >> computing on 1 site, i can just place hardwired strings of absolute >> pathnames to disable staging. I was originally thinking of passing >> '$OSG_DATA' variable names since the app functions wraps to bash >> shell >> scripts. this backfired because swift passes these string args >> literally. >> >> any other recommended approaches? >> >> thanks! >> -Allan > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user From wozniak at mcs.anl.gov Tue May 4 13:25:23 2010 From: wozniak at mcs.anl.gov (Justin M Wozniak) Date: Tue, 4 May 2010 13:25:23 -0500 (Central Daylight Time) Subject: [Swift-user] handling prestaged data on multiple sites In-Reply-To: References: <20100504151909.0709919E00EB@zimbra.anl.gov> <1272987941.12927.10.camel@origin> Message-ID: Collective Data Management. The general idea is to exploit user information to improve data access for Swift scripts. Specifically, you can plug in new data access mechanisms without modifying the application script- most of the details are specified in a small user configuration file (analogous to tc.data) and managed by extensions to the wrapper script (_swiftwrap, etc.). Dynamically renaming data sources is a big part of it. The framework is there in trunk and a few methods are implemented, including a staging-skipping DIRECT method, a BROADCAST, and an output-aggregating GATHER method. I can easily put in a new method for Globus.org, I'll take a look and get back to you, Allan. On Tue, 4 May 2010, Ian Foster wrote: > What is CDM? > > Ian > > On May 4, 2010, at 10:45 AM, Allan Espinosa wrote: > >> Hi Justin, >> >> I used globus.org's data movement service. >> >> Right now I have the dataset on these OSG sites: >> >> ff-grid.unl.edu:/panfs/panasas/CMS/data/scec/RuptureVariations/* >> tuscany.med.harvard.edu:/osg/storage/data/engage/scec/RuptureVariations/* >> >> On Mar, 2010-05-04 at 10:20 -0500, Justin Wozniak wrote: >>> >>> This is probably a good use case for CDM. How did you prestage the >>> files? >>> >>> >>> >>> ______________________________________________________________________ >>> Allan Espinosa wrote: >>> >>> Hi, >>> >>> I prestaged 11k small files (total ~2GB) to two sites. if I were just >>> computing on 1 site, i can just place hardwired strings of absolute >>> pathnames to disable staging. I was originally thinking of passing >>> '$OSG_DATA' variable names since the app functions wraps to bash >>> shell >>> scripts. this backfired because swift passes these string args >>> literally. >>> >>> any other recommended approaches? >>> >>> thanks! >>> -Allan >> >> >> _______________________________________________ >> Swift-user mailing list >> Swift-user at ci.uchicago.edu >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > -- Justin M Wozniak From foster at anl.gov Tue May 4 13:30:22 2010 From: foster at anl.gov (Ian Foster) Date: Tue, 4 May 2010 13:30:22 -0500 Subject: [Swift-user] handling prestaged data on multiple sites In-Reply-To: References: <20100504151909.0709919E00EB@zimbra.anl.gov> <1272987941.12927.10.camel@origin> Message-ID: <03E4F40A-A682-4710-AECA-1AEF13993EA7@anl.gov> yes, sorry, I know the term, just blanking on the connection here On May 4, 2010, at 1:25 PM, Justin M Wozniak wrote: > > Collective Data Management. The general idea is to exploit user information to improve data access for Swift scripts. Specifically, you can plug in new data access mechanisms without modifying the application script- most of the details are specified in a small user configuration file (analogous to tc.data) and managed by extensions to the wrapper script (_swiftwrap, etc.). Dynamically renaming data sources is a big part of it. > > The framework is there in trunk and a few methods are implemented, including a staging-skipping DIRECT method, a BROADCAST, and an output-aggregating GATHER method. I can easily put in a new method for Globus.org, I'll take a look and get back to you, Allan. > > On Tue, 4 May 2010, Ian Foster wrote: > >> What is CDM? >> >> Ian >> >> On May 4, 2010, at 10:45 AM, Allan Espinosa wrote: >> >>> Hi Justin, >>> >>> I used globus.org's data movement service. >>> >>> Right now I have the dataset on these OSG sites: >>> >>> ff-grid.unl.edu:/panfs/panasas/CMS/data/scec/RuptureVariations/* >>> tuscany.med.harvard.edu:/osg/storage/data/engage/scec/RuptureVariations/* >>> >>> On Mar, 2010-05-04 at 10:20 -0500, Justin Wozniak wrote: >>>> >>>> This is probably a good use case for CDM. How did you prestage the >>>> files? >>>> >>>> >>>> >>>> ______________________________________________________________________ >>>> Allan Espinosa wrote: >>>> >>>> Hi, >>>> >>>> I prestaged 11k small files (total ~2GB) to two sites. if I were just >>>> computing on 1 site, i can just place hardwired strings of absolute >>>> pathnames to disable staging. I was originally thinking of passing >>>> '$OSG_DATA' variable names since the app functions wraps to bash >>>> shell >>>> scripts. this backfired because swift passes these string args >>>> literally. >>>> >>>> any other recommended approaches? >>>> >>>> thanks! >>>> -Allan >>> >>> >>> _______________________________________________ >>> Swift-user mailing list >>> Swift-user at ci.uchicago.edu >>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user >> >> _______________________________________________ >> Swift-user mailing list >> Swift-user at ci.uchicago.edu >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user >> > > -- > Justin M Wozniak From foster at anl.gov Tue May 4 13:30:51 2010 From: foster at anl.gov (Ian Foster) Date: Tue, 4 May 2010 13:30:51 -0500 Subject: [Swift-user] handling prestaged data on multiple sites In-Reply-To: References: <20100504151909.0709919E00EB@zimbra.anl.gov> <1272987941.12927.10.camel@origin> Message-ID: <8D03C037-FA56-475F-AB8B-F5D5DFDE1048@anl.gov> PS: If we want to do wide area stuff with CDM, it should be invoking Globus.org. On May 4, 2010, at 1:25 PM, Justin M Wozniak wrote: > > Collective Data Management. The general idea is to exploit user information to improve data access for Swift scripts. Specifically, you can plug in new data access mechanisms without modifying the application script- most of the details are specified in a small user configuration file (analogous to tc.data) and managed by extensions to the wrapper script (_swiftwrap, etc.). Dynamically renaming data sources is a big part of it. > > The framework is there in trunk and a few methods are implemented, including a staging-skipping DIRECT method, a BROADCAST, and an output-aggregating GATHER method. I can easily put in a new method for Globus.org, I'll take a look and get back to you, Allan. > > On Tue, 4 May 2010, Ian Foster wrote: > >> What is CDM? >> >> Ian >> >> On May 4, 2010, at 10:45 AM, Allan Espinosa wrote: >> >>> Hi Justin, >>> >>> I used globus.org's data movement service. >>> >>> Right now I have the dataset on these OSG sites: >>> >>> ff-grid.unl.edu:/panfs/panasas/CMS/data/scec/RuptureVariations/* >>> tuscany.med.harvard.edu:/osg/storage/data/engage/scec/RuptureVariations/* >>> >>> On Mar, 2010-05-04 at 10:20 -0500, Justin Wozniak wrote: >>>> >>>> This is probably a good use case for CDM. How did you prestage the >>>> files? >>>> >>>> >>>> >>>> ______________________________________________________________________ >>>> Allan Espinosa wrote: >>>> >>>> Hi, >>>> >>>> I prestaged 11k small files (total ~2GB) to two sites. if I were just >>>> computing on 1 site, i can just place hardwired strings of absolute >>>> pathnames to disable staging. I was originally thinking of passing >>>> '$OSG_DATA' variable names since the app functions wraps to bash >>>> shell >>>> scripts. this backfired because swift passes these string args >>>> literally. >>>> >>>> any other recommended approaches? >>>> >>>> thanks! >>>> -Allan >>> >>> >>> _______________________________________________ >>> Swift-user mailing list >>> Swift-user at ci.uchicago.edu >>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user >> >> _______________________________________________ >> Swift-user mailing list >> Swift-user at ci.uchicago.edu >> http://mail.ci.uchicago.edu/mailman/listinfo/swift-user >> > > -- > Justin M Wozniak From wilde at mcs.anl.gov Wed May 5 08:15:32 2010 From: wilde at mcs.anl.gov (wilde at mcs.anl.gov) Date: Wed, 5 May 2010 08:15:32 -0500 (CDT) Subject: [Swift-user] Question on coaster job time calculations In-Reply-To: <10371919.886191273064831999.JavaMail.root@zimbra> Message-ID: <12986955.886351273065332373.JavaMail.root@zimbra> In a Swift run with coasters, I set the sites element "maxTime" to 3 hours to accommodate the longest jobs that the script runs. But the script starts by running a single pre-processing job that is set to maxWallTime 30 mins. I would have expected this single job to get placed in a coaster PBS job set to a wallTime closer to 30 mins, but the PBS walltime was set to 90 mins (causing the job to wait in the short queue rather than start right away in the fast queue; I have the sites "queue" element set to "route" which selects the best queue based on PBS walltime). Why is this? All the config files are on the CI net in: /home/wilde/protests/T0517/run.raptorloops.2260 log is in: RaptorLoops-20100505-0801-1dtuj463.log Mike -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From wilde at mcs.anl.gov Wed May 5 14:07:48 2010 From: wilde at mcs.anl.gov (wilde at mcs.anl.gov) Date: Wed, 5 May 2010 14:07:48 -0500 (CDT) Subject: [Swift-user] Question on coaster job time calculations In-Reply-To: <29344937.904731273085723381.JavaMail.root@zimbra> Message-ID: <2808220.905481273086468301.JavaMail.root@zimbra> I tried to work around this general problem of having a script with many sub-hour jobs followed by many multi-hour jobs, and wanting to get specific sized jobs into specific queues. What I did was marked each app in tc.data with an appropriate maxwalltime, and created 4 pool entries in sites.xml for the same coaster site, with maxtime of 1,2,3, and 4 hours. Each app was associated in tc.data with one of these pools: all the short jobs (the first 305 jobs of the script) were marked as being on site pbs1 (for 1-hour jobs), and the longer jobs, given 2h:55m walltime, were sent to pbs4. The first stage of the script ran fine, and jobs were sent to the fast queue in 1-hour blocks, just as desired. However, the second stage behaved as if coasters could not find a suitable block allocation for them, and the script then failed to progress: no PBS jobs were queued, and the log showed that the coaster scheduler was idling (same I think as would happen if the remaining jobs all had maxwalltime greater than maxtime of the pool). Mihael, can you check the log, and see if this is a config bug on my part or a code bug? It looks a bit like coasters is trying to fit my 2hr:55 jobs into a 60 minute coaster slot of pbs1, unaware that the 4hr slots of pbs4 should be started???? The logs, scripts, and config files are in: /home/wilde/protests/T0517/run.raptorloops.5732 Thanks, Mike ----- wilde at mcs.anl.gov wrote: > In a Swift run with coasters, I set the sites element "maxTime" to 3 > hours to accommodate the longest jobs that the script runs. But the > script starts by running a single pre-processing job that is set to > maxWallTime 30 mins. > > I would have expected this single job to get placed in a coaster PBS > job set to a wallTime closer to 30 mins, but the PBS walltime was set > to 90 mins (causing the job to wait in the short queue rather than > start right away in the fast queue; I have the sites "queue" element > set to "route" which selects the best queue based on PBS walltime). > > Why is this? > > All the config files are on the CI net in: > > /home/wilde/protests/T0517/run.raptorloops.2260 > > log is in: > > RaptorLoops-20100505-0801-1dtuj463.log > > Mike > > -- > Michael Wilde > Computation Institute, University of Chicago > Mathematics and Computer Science Division > Argonne National Laboratory > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From hategan at mcs.anl.gov Wed May 5 15:02:39 2010 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 05 May 2010 15:02:39 -0500 Subject: [Swift-user] Question on coaster job time calculations In-Reply-To: <12986955.886351273065332373.JavaMail.root@zimbra> References: <12986955.886351273065332373.JavaMail.root@zimbra> Message-ID: <1273089759.27891.182.camel@localhost> On Wed, 2010-05-05 at 08:15 -0500, wilde at mcs.anl.gov wrote: > In a Swift run with coasters, I set the sites element "maxTime" to 3 > hours to accommodate the longest jobs that the script runs. But the > script starts by running a single pre-processing job that is set to > maxWallTime 30 mins. > > I would have expected this single job to get placed in a coaster PBS > job set to a wallTime closer to 30 mins, Given that we are talking about coasters whose purpose is to bunch multiple jobs into one big job, I find that expectation odd :) What you want to play with is (low|high)Overallocation and overallocationDecayFactor. They are documented in the swift user guide. I believe that you want a slightly larger decay factor (say 0.003 instead of 0.001) > but the PBS walltime was set to 90 mins (causing the job to wait in > the short queue rather than start right away in the fast queue; I have > the sites "queue" element set to "route" which selects the best queue > based on PBS walltime). Though for 30 minutes and the default settings, you should get a block walltime of about 75 minutes, not 90. Are you sure about the 90? From wilde at mcs.anl.gov Wed May 5 20:48:35 2010 From: wilde at mcs.anl.gov (wilde at mcs.anl.gov) Date: Wed, 5 May 2010 20:48:35 -0500 (CDT) Subject: [Swift-user] Question on coaster job time calculations In-Reply-To: <28870612.918171273101546892.JavaMail.root@zimbra> Message-ID: <4947856.920021273110515564.JavaMail.root@zimbra> Your points below do not address the main problem I am pointing out: that my script ran the initial 300+ shorter jobs fine, and then *hung*, not running the last 100 longer jobs even though there was a coaster pool defined that should have accepted them. Why was that? I'll try a different approach though. More followup below on your other replies. ----- "Mihael Hategan" wrote: > Given that we are talking about coasters whose purpose is to bunch > multiple jobs into one big job, I find that expectation odd :) PADS frequently has a huge queue of jobs in the 1+ hour category. But jobs in the fast (<1 hour) queue start right away. So in this case its better not to batch these jobs. When I wound up in the short queue, I waited almost an hour without a single job starting. I realize that on PADS, I can move these jobs to an ordinary PBS queue (and will do that). But on almost all TeraGrid systems, which we're trying to use as well, we *must* use coasters in order to use all cores of multi-core nodes. SO we should still address the problem. > > What you want to play with is (low|high)Overallocation and > overallocationDecayFactor. They are documented in the swift user > guide. I have read this many times and still don't understand it well enough to apply it. It get the gist of it, but whats missing is the fundamental understanding of what it coaster scheduling and "packing" approach is. And one really needs to plot the exponential decay function you describe in the user guide text on "low overallocation". Lastly Im not sure that the formula as its describe there is correct. Some initial evaluations are confusing me; I need to re-run and plot the curve. > I believe that you want a slightly larger decay factor (say 0.003 > instead of 0.001) > > > but the PBS walltime was set to 90 mins (causing the job to wait > in > > the short queue rather than start right away in the fast queue; I > have > > the sites "queue" element set to "route" which selects the best > queue > > based on PBS walltime). > > Though for 30 minutes and the default settings, you should get a > block > walltime of about 75 minutes, not 90. Are you sure about the 90? Pretty sure, but I will check next chance I get to experiment; probably not for a while. - Mike -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From hategan at mcs.anl.gov Wed May 5 21:23:57 2010 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 05 May 2010 21:23:57 -0500 Subject: [Swift-user] Question on coaster job time calculations In-Reply-To: <4947856.920021273110515564.JavaMail.root@zimbra> References: <4947856.920021273110515564.JavaMail.root@zimbra> Message-ID: <1273112637.7340.10.camel@localhost> On Wed, 2010-05-05 at 20:48 -0500, wilde at mcs.anl.gov wrote: > Your points below do not address the main problem I am pointing out: > that my script ran the initial 300+ shorter jobs fine, and then > *hung*, not running the last 100 longer jobs even though there was a > coaster pool defined that should have accepted them. > > Why was that? No clue. I was responding to the previous email. I will try to look at the logs tonight. > > I'll try a different approach though. > > More followup below on your other replies. > > ----- "Mihael Hategan" wrote: > > > Given that we are talking about coasters whose purpose is to bunch > > multiple jobs into one big job, I find that expectation odd :) > > PADS frequently has a huge queue of jobs in the 1+ hour category. But > jobs in the fast (<1 hour) queue start right away. So in this case its > better not to batch these jobs. When I wound up in the short queue, I > waited almost an hour without a single job starting. > > I realize that on PADS, I can move these jobs to an ordinary PBS queue > (and will do that). But on almost all TeraGrid systems, which we're > trying to use as well, we *must* use coasters in order to use all > cores of multi-core nodes. SO we should still address the problem. Maybe there is a misunderstanding here. Coasters/glideins are supposed to increase performance by accommodating multiple job rounds into a single LRM job. As such, it is not entirely unexpected to have the LRM job have a larger walltime than the actual job. I understood your problem, but I am not sure why the behavior is surprising. > > > > > What you want to play with is (low|high)Overallocation and > > overallocationDecayFactor. They are documented in the swift user > > guide. > > I have read this many times and still don't understand it well enough > to apply it. It get the gist of it, but whats missing is the > fundamental understanding of what it coaster scheduling and "packing" > approach is. It sorts the jobs and divides them into bunches based on the spread. For each bunch then, it computes the overallocation (using the longest job in the bunch). That is the walltime of the block. > And one really needs to plot the exponential decay function you > describe in the user guide text on "low overallocation". Lastly Im not > sure that the formula as its describe there is correct. Could be. Here's the code, verbatim: (wt * ((settings.getLowOverallocation() - settings.getHighOverallocation()) * Math.exp(-wt * settings.getOverallocationDecayFactor()) + settings.getHighOverallocation())); That's jobwalltime * (lo - hi) * e^(-jobwalltime*decay) + hi. From hategan at mcs.anl.gov Wed May 5 22:50:34 2010 From: hategan at mcs.anl.gov (Mihael Hategan) Date: Wed, 05 May 2010 22:50:34 -0500 Subject: [Swift-user] Question on coaster job time calculations In-Reply-To: <2808220.905481273086468301.JavaMail.root@zimbra> References: <2808220.905481273086468301.JavaMail.root@zimbra> Message-ID: <1273117834.9034.1.camel@localhost> On Wed, 2010-05-05 at 14:07 -0500, wilde at mcs.anl.gov wrote: > The logs, scripts, and config files are in: > > /home/wilde/protests/T0517/run.raptorloops.5732 I'll need something from you (before you kill the process): jstack >some-file-that-ill-get-to-see. Mihael From aespinosa at cs.uchicago.edu Tue May 25 15:19:28 2010 From: aespinosa at cs.uchicago.edu (Allan Espinosa) Date: Tue, 25 May 2010 15:19:28 -0500 Subject: [Swift-user] half/quarter maximized site utilization Message-ID: Hi, I would like to have my initial resource request at 25% max for each site and then let the scoring system decide the steady state resource requests: For 100 % utilization, we just set initialScore to some ridiculously high value like 10,000. For 25%, is it just 2,500 or some other magic number? a plot of % jobThrottle vs. initialScore would be useful for this. -Allan -- Allan M. Espinosa PhD student, Computer Science University of Chicago From iraicu at cs.uchicago.edu Wed May 26 10:24:17 2010 From: iraicu at cs.uchicago.edu (Ioan Raicu) Date: Wed, 26 May 2010 10:24:17 -0500 Subject: [Swift-user] Call for Participation at ACM ScienceCloud2010 Message-ID: <4BFD3D21.5020505@cs.uchicago.edu> Dear all, We are less than a month away from the 1st ACM Workshop on Scientific Cloud Computing (ScienceCloud2010, http://dsl.cs.uchicago.edu/ScienceCloud2010/), which is co-located with the ACM International Symposium on High Performance Distributed Computing (HPDC, http://hpdc2010.eecs.northwestern.edu/), and will take place in Chicago Illinois on Monday June 21st. I wanted to bring a few things to your attention: 1. We have Dr. Dennis Gannon from Microsoft Research giving the keynote talk (http://dsl.cs.uchicago.edu/ScienceCloud2010/program.htm#Keynote)! 2. The complete program is now online at http://dsl.cs.uchicago.edu/ScienceCloud2010/program.htm, including all session chairs and accepted papers. 3. We have a panel discussion organized as a conclusion to the workshop; more information on the panel can be found at http://dsl.cs.uchicago.edu/ScienceCloud2010/program.htm#Panel_on_Scientific_Cloud_Computing. The panel discussion moderator is Dr. Pete Beckman (Argonne National Laboratory & University of Chicago), and the five panelists are Dr. Manish Parashar (Rutgers University), Dr. Dennis Gannon (Microsoft Research), Dr. Kate Keahey (Argonne National Laboratory & University of Chicago), Dr. Peter Dinda (Northwestern University), and Dr. Bob Grossman (University of Illinois at Chicago). Please submit questions for the panel discussion you would like to see answered during the panel to iraicu at eecs.northwestern.edu with a subject "ScienceCloud2010: panel discussion questions". 4. With the generous sponsorship of Microsoft Research and Indiana University, we will be organizing and hosting a general workshop reception/dinner on Monday evening, for which all registered HPDC and/or workshops attendees will be able to attend free of charge. The specifics around this reception/dinner are still in the works, but if you will be in Chicago on Monday evening, keep your calendar open. Don't forget that the HPDC/workshop early registration ends June 1st, after which the registration fees will increase. We look forward to seeing you in Chicago next month! Regards, Dr. Ioan Raicu, Dr. Pete Beckman, and Dr. Ian Foster ACM ScienceCloud2010 Chairs http://dsl.cs.uchicago.edu/ScienceCloud2010/ -- ================================================================= Ioan Raicu, Ph.D. NSF/CRA Computing Innovation Fellow ================================================================= Center for Ultra-scale Computing and Information Security (CUCIS) Department of Electrical Engineering and Computer Science Northwestern University 2145 Sheridan Rd, Tech M384 Evanston, IL 60208-3118 ================================================================= Cel: 1-847-722-0876 Tel: 1-847-491-8163 Email: iraicu at eecs.northwestern.edu Web: http://www.eecs.northwestern.edu/~iraicu/ https://wiki.cucis.eecs.northwestern.edu/ ================================================================= ================================================================= -------------- next part -------------- An HTML attachment was scrubbed... URL: From iraicu at cs.uchicago.edu Wed May 26 11:50:21 2010 From: iraicu at cs.uchicago.edu (Ioan Raicu) Date: Wed, 26 May 2010 11:50:21 -0500 Subject: [Swift-user] Call for Participation: 19th ACM International Symposium on High Performance Distributed Computing (HPDC) 2010 Message-ID: <4BFD514D.3020209@cs.uchicago.edu> HPDC 2010 Call For Participation 19^th ACM International Symposium on High Performance Distributed Computing Chicago, Illinois, USA June 20-25, 2010 http://hpdc2010.eecs.northwestern.edu/ Overview The ACM International Symposium on High Performance Distributed Computing (HPDC) is the premier venue for presenting the latest research on the design, implementation, evaluation, and use of parallel and distributed systems for high performance and high end computing. The 19th installment of HPDC will take place in the heart of Chicago, Illinois, the third largest city in the United States and a major technological and cultural capital located on the shore of Lake Michigan, one of the largest freshwater lakes in the world. Highlights # 3 Keynotes: Guy Steele (Sun/Oracle), Randal Bryant (CMU), Robert Harrison (ORNL) # Single track presentation of 23 full papers (25% acceptance rate) and 22 posters / Workflows, Resources and Clouds, Map Reduce and Debugging, Data Centers and Virtualization, Storage and I/O, Applications and Provenance, Communication and Scheduling, Best Papers/ # Panel on expanding parallel programming beyond the usual suspects # Industry session /(email hpdc2010-industry-session at presciencelab.org for participation)/ # Wild and crazy ideas session / (email hpdc2010-wild at presciencelab.org for participation)/ # 8 co-located workshops , including 8 keynotes, 5 panels, and 62 paper presentations / *ECMLS*: Emerging Computational Methods for the Life Sciences; *LSAP*: Large-Scale System and Application Performance; *MDQCS*: Managing Data Quality for Collaborative Science; *ScienceCloud*: Workshop on Scientific Cloud Computing; *CLADE*: Challenges of Large Applications in Distributed Environments; *DIDC*: Data Intensive Distributed Computing; *MAPREDUCE*: Map Reduce and its Applications; *VTDC*: Virtualization Technologies for Distributed Computing/ # Co-located Open Grid Forum meeting (OGF29) # Full program available from web site (hpdc.org) Venue, Registration, Student Travel Grants, and Sponsorship All events will take place at the Doubletree Hotel Chicago Magnificent Mile, located within easy walking distance of numerous downtown Chicago attractions and Lake Michigan (including beaches), with easy access to the entire Chicago area via subway. Discounted registration is available through May 31. For more information and to register, please visit http://hpdc2010.eecs.northwestern.edu/. HPDC is pleased to acknowledge support or sponsorship from ACM, NSF, Intel, Google, NVIDIA, Microsoft Research, the Computation Institute at the University of Chicago, Argonne National Lab, the Digital Science Center at Indiana University, the NSF Center for Autonomic Computing at the University of Arizona, and the Department of Electrical Engineering and Computer Science at Northwestern University. -- ================================================================= Ioan Raicu, Ph.D. NSF/CRA Computing Innovation Fellow ================================================================= Center for Ultra-scale Computing and Information Security (CUCIS) Department of Electrical Engineering and Computer Science Northwestern University 2145 Sheridan Rd, Tech M384 Evanston, IL 60208-3118 ================================================================= Cel: 1-847-722-0876 Tel: 1-847-491-8163 Email: iraicu at eecs.northwestern.edu Web: http://www.eecs.northwestern.edu/~iraicu/ https://wiki.cucis.eecs.northwestern.edu/ ================================================================= ================================================================= -------------- next part -------------- An HTML attachment was scrubbed... URL: From trsines0 at frostburg.edu Fri May 28 10:51:12 2010 From: trsines0 at frostburg.edu (Taleena R Sines) Date: Fri, 28 May 2010 11:51:12 -0400 Subject: [Swift-user] Question: Setting environment variables Message-ID: Hello, In swift, how would I set an environment variable? For example, in a c-script: setenv WKDIR /user/bin would translate to swift how? Thank you T. R. Sines -------------- next part -------------- An HTML attachment was scrubbed... URL: From wilde at mcs.anl.gov Fri May 28 11:15:55 2010 From: wilde at mcs.anl.gov (wilde at mcs.anl.gov) Date: Fri, 28 May 2010 11:15:55 -0500 (CDT) Subject: [Swift-user] Question: Setting environment variables In-Reply-To: <3111376.194921275063161104.JavaMail.root@zimbra> Message-ID: <20550963.195311275063355747.JavaMail.root@zimbra> Taleena, You set env vars for a given app in the tc.data file using an "Env profile": http://www.ci.uchicago.edu/swift/guides/userguide.php#profile.env For example: localhost myapp /usr/bin/env none none ENV::myenvvar="something"; Thats not real clear in the User Guide - we will fix that. - Mike ----- "Taleena R Sines" wrote: > Hello, > In swift, how would I set an environment variable? > For example, in a c-script: > setenv WKDIR /user/bin > > would translate to swift how? > Thank you > > T. R. Sines > > > > _______________________________________________ > Swift-user mailing list > Swift-user at ci.uchicago.edu > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From wilde at mcs.anl.gov Fri May 28 11:48:21 2010 From: wilde at mcs.anl.gov (Michael Wilde) Date: Fri, 28 May 2010 11:48:21 -0500 (CDT) Subject: [Swift-user] Question: Setting environment variables In-Reply-To: Message-ID: <28892276.196751275065301480.JavaMail.root@zimbra> For: setenv CODE_HOME /trsines/code/my_code the example: localhost myapp /usr/bin/env none none ENV::myenvvar="something"; would become: localhost myapp /usr/bin/env none none ENV::CODE_HOME ="/trsines/code/my_code"; - Mike ----- "Taleena R Sines" wrote: > If my code in c-script is : > setenv CODE_HOME /trsines/code/my_code > > What would actually be typed in the swift-script in place of that? > thank you > > T. R. Sines > > > > > -----Original Message----- > From: wilde at mcs.anl.gov [ mailto:wilde at mcs.anl.gov ] > Sent: Fri 5/28/2010 12:15 PM > To: Taleena R Sines > Cc: swift-user at ci.uchicago.edu > Subject: Re: [Swift-user] Question: Setting environment variables > > Taleena, > > You set env vars for a given app in the tc.data file using an "Env > profile": > > http://www.ci.uchicago.edu/swift/guides/userguide.php#profile.env > > For example: > > localhost myapp /usr/bin/env none none ENV::myenvvar="something"; > > Thats not real clear in the User Guide - we will fix that. > > - Mike > > > ----- "Taleena R Sines" wrote: > > > Hello, > > In swift, how would I set an environment variable? > > For example, in a c-script: > > setenv WKDIR /user/bin > > > > would translate to swift how? > > Thank you > > > > T. R. Sines > > > > > > > > _______________________________________________ > > Swift-user mailing list > > Swift-user at ci.uchicago.edu > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > > -- > Michael Wilde > Computation Institute, University of Chicago > Mathematics and Computer Science Division > Argonne National Laboratory -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From wilde at mcs.anl.gov Fri May 28 12:04:33 2010 From: wilde at mcs.anl.gov (Michael Wilde) Date: Fri, 28 May 2010 12:04:33 -0500 (CDT) Subject: [Swift-user] Question: Setting environment variables In-Reply-To: Message-ID: <9132289.197581275066273288.JavaMail.root@zimbra> Did you make sure that all the fields are separated by a tab character, not spaces? If that was not the cause, I'll need to double-check and test my syntax. (please send all your replies back to the swift-user list). - Mike ----- "Taleena R Sines" wrote: > I inserted that line and it is giving me the error: > unexpected token: / > > > Taleena R. Sines > Major: Computer Science > > > > -----Original Message----- > From: Michael Wilde [ mailto:wilde at mcs.anl.gov ] > Sent: Fri 5/28/2010 12:48 PM > To: Taleena R Sines > Cc: Swift User > Subject: Re: [Swift-user] Question: Setting environment variables > > For: > > setenv CODE_HOME /trsines/code/my_code > > the example: > > localhost myapp /usr/bin/env none none ENV::myenvvar="something"; > > would become: > > localhost myapp /usr/bin/env none none ENV::CODE_HOME > ="/trsines/code/my_code"; > > - Mike > > ----- "Taleena R Sines" wrote: > > > If my code in c-script is : > > setenv CODE_HOME /trsines/code/my_code > > > > What would actually be typed in the swift-script in place of that? > > thank you > > > > T. R. Sines > > > > > > > > > > -----Original Message----- > > From: wilde at mcs.anl.gov [ mailto:wilde at mcs.anl.gov ] > > Sent: Fri 5/28/2010 12:15 PM > > To: Taleena R Sines > > Cc: swift-user at ci.uchicago.edu > > Subject: Re: [Swift-user] Question: Setting environment variables > > > > Taleena, > > > > You set env vars for a given app in the tc.data file using an "Env > > profile": > > > > http://www.ci.uchicago.edu/swift/guides/userguide.php#profile.env > > > > For example: > > > > localhost myapp /usr/bin/env none none ENV::myenvvar="something"; > > > > Thats not real clear in the User Guide - we will fix that. > > > > - Mike > > > > > > ----- "Taleena R Sines" wrote: > > > > > Hello, > > > In swift, how would I set an environment variable? > > > For example, in a c-script: > > > setenv WKDIR /user/bin > > > > > > would translate to swift how? > > > Thank you > > > > > > T. R. Sines > > > > > > > > > > > > _______________________________________________ > > > Swift-user mailing list > > > Swift-user at ci.uchicago.edu > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > > > > -- > > Michael Wilde > > Computation Institute, University of Chicago > > Mathematics and Computer Science Division > > Argonne National Laboratory > > -- > Michael Wilde > Computation Institute, University of Chicago > Mathematics and Computer Science Division > Argonne National Laboratory -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From wilde at mcs.anl.gov Fri May 28 12:39:57 2010 From: wilde at mcs.anl.gov (Michael Wilde) Date: Fri, 28 May 2010 12:39:57 -0500 (CDT) Subject: [Swift-user] Question: Setting environment variables In-Reply-To: Message-ID: <18946360.199021275068397988.JavaMail.root@zimbra> ----- "Taleena R Sines" wrote: > What needs to be entered in the data file and what needs to be entered > in the actual script? > > Thank you, I will post to the list Lets say you want to invoke the program "myprog" from a Swift script. You write an "app" function called myprog() in the .swift file, and in tc.data you add entries to specify the pathname of that program on each "site" (e.g., cluster) that you want to compute on. This is described in the Swift Tutorial, in sec 3.2, Adding Another Application: http://www.ci.uchicago.edu/swift/guides/tutorial.php#id2884021 - Mike > > Taleena R. Sines > Major: Computer Science > > > > -----Original Message----- > From: Michael Wilde [ mailto:wilde at mcs.anl.gov ] > Sent: Fri 5/28/2010 1:04 PM > To: Taleena R Sines > Cc: Swift User > Subject: Re: [Swift-user] Question: Setting environment variables > > Did you make sure that all the fields are separated by a tab > character, not spaces? > If that was not the cause, I'll need to double-check and test my > syntax. > > (please send all your replies back to the swift-user list). > > - Mike > > > ----- "Taleena R Sines" wrote: > > > I inserted that line and it is giving me the error: > > unexpected token: / > > > > > > Taleena R. Sines > > Major: Computer Science > > > > > > > > -----Original Message----- > > From: Michael Wilde [ mailto:wilde at mcs.anl.gov ] > > Sent: Fri 5/28/2010 12:48 PM > > To: Taleena R Sines > > Cc: Swift User > > Subject: Re: [Swift-user] Question: Setting environment variables > > > > For: > > > > setenv CODE_HOME /trsines/code/my_code > > > > the example: > > > > localhost myapp /usr/bin/env none none ENV::myenvvar="something"; > > > > would become: > > > > localhost myapp /usr/bin/env none none ENV::CODE_HOME > > ="/trsines/code/my_code"; > > > > - Mike > > > > ----- "Taleena R Sines" wrote: > > > > > If my code in c-script is : > > > setenv CODE_HOME /trsines/code/my_code > > > > > > What would actually be typed in the swift-script in place of that? > > > thank you > > > > > > T. R. Sines > > > > > > > > > > > > > > > -----Original Message----- > > > From: wilde at mcs.anl.gov [ mailto:wilde at mcs.anl.gov ] > > > Sent: Fri 5/28/2010 12:15 PM > > > To: Taleena R Sines > > > Cc: swift-user at ci.uchicago.edu > > > Subject: Re: [Swift-user] Question: Setting environment variables > > > > > > Taleena, > > > > > > You set env vars for a given app in the tc.data file using an "Env > > > profile": > > > > > > http://www.ci.uchicago.edu/swift/guides/userguide.php#profile.env > > > > > > For example: > > > > > > localhost myapp /usr/bin/env none none ENV::myenvvar="something"; > > > > > > Thats not real clear in the User Guide - we will fix that. > > > > > > - Mike > > > > > > > > > ----- "Taleena R Sines" wrote: > > > > > > > Hello, > > > > In swift, how would I set an environment variable? > > > > For example, in a c-script: > > > > setenv WKDIR /user/bin > > > > > > > > would translate to swift how? > > > > Thank you > > > > > > > > T. R. Sines > > > > > > > > > > > > > > > > _______________________________________________ > > > > Swift-user mailing list > > > > Swift-user at ci.uchicago.edu > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > > > > > > -- > > > Michael Wilde > > > Computation Institute, University of Chicago > > > Mathematics and Computer Science Division > > > Argonne National Laboratory > > > > -- > > Michael Wilde > > Computation Institute, University of Chicago > > Mathematics and Computer Science Division > > Argonne National Laboratory > > -- > Michael Wilde > Computation Institute, University of Chicago > Mathematics and Computer Science Division > Argonne National Laboratory -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From wilde at mcs.anl.gov Fri May 28 12:55:50 2010 From: wilde at mcs.anl.gov (wilde at mcs.anl.gov) Date: Fri, 28 May 2010 12:55:50 -0500 (CDT) Subject: [Swift-user] Question: Setting environment variables In-Reply-To: <9254299.199311275068797772.JavaMail.root@zimbra> Message-ID: <5905145.200161275069350209.JavaMail.root@zimbra> ----- "Taleena R Sines" wrote: > The code I'm transforming has several environment variable sets, so > would I be adding every one to the data file? You can specify multiple environment variables on a single application in tc.data like this: localhost env /usr/bin/env none none ENV::VAR1="value1";ENV::VAR2="value2" > After adding them to the file, would I need to do anything in the > actual script to invoke changes? Environment variables are typically specified entirely in tc.data, so you don't need to do anything in your .swift script related to them (unless you need to change their value with each invocation of your program, which would require some coordination between your .swift script and a shell wrapper around your program to pass such values on the command line. But I suspect you are not doing that at this point.) Regarding "invoke changes" - sounds like you might be thinking in terms of compiling or building, as in "cc" and "make". But Swift basically compiles, interprets, and executes your script from the .swift source code each time you run the swift command. So there is effectively nothing that needs to be done between changing your tc.data and .swift file, and then executing the swift command again to try your changes. - Mike > > Thank you, I'm sorry for the stream of questions No problem, but please please please send them to swift-user :) so that more people can answer you and more can benefit from the answers. > Taleena R. Sines > Major: Computer Science > > > > -----Original Message----- > From: Michael Wilde [ mailto:wilde at mcs.anl.gov ] > Sent: Fri 5/28/2010 1:04 PM > To: Taleena R Sines > Cc: Swift User > Subject: Re: [Swift-user] Question: Setting environment variables > > Did you make sure that all the fields are separated by a tab > character, not spaces? > If that was not the cause, I'll need to double-check and test my > syntax. > > (please send all your replies back to the swift-user list). > > - Mike > > > ----- "Taleena R Sines" wrote: > > > I inserted that line and it is giving me the error: > > unexpected token: / > > > > > > Taleena R. Sines > > Major: Computer Science > > > > > > > > -----Original Message----- > > From: Michael Wilde [ mailto:wilde at mcs.anl.gov ] > > Sent: Fri 5/28/2010 12:48 PM > > To: Taleena R Sines > > Cc: Swift User > > Subject: Re: [Swift-user] Question: Setting environment variables > > > > For: > > > > setenv CODE_HOME /trsines/code/my_code > > > > the example: > > > > localhost myapp /usr/bin/env none none ENV::myenvvar="something"; > > > > would become: > > > > localhost myapp /usr/bin/env none none ENV::CODE_HOME > > ="/trsines/code/my_code"; > > > > - Mike > > > > ----- "Taleena R Sines" wrote: > > > > > If my code in c-script is : > > > setenv CODE_HOME /trsines/code/my_code > > > > > > What would actually be typed in the swift-script in place of that? > > > thank you > > > > > > T. R. Sines > > > > > > > > > > > > > > > -----Original Message----- > > > From: wilde at mcs.anl.gov [ mailto:wilde at mcs.anl.gov ] > > > Sent: Fri 5/28/2010 12:15 PM > > > To: Taleena R Sines > > > Cc: swift-user at ci.uchicago.edu > > > Subject: Re: [Swift-user] Question: Setting environment variables > > > > > > Taleena, > > > > > > You set env vars for a given app in the tc.data file using an "Env > > > profile": > > > > > > http://www.ci.uchicago.edu/swift/guides/userguide.php#profile.env > > > > > > For example: > > > > > > localhost myapp /usr/bin/env none none ENV::myenvvar="something"; > > > > > > Thats not real clear in the User Guide - we will fix that. > > > > > > - Mike > > > > > > > > > ----- "Taleena R Sines" wrote: > > > > > > > Hello, > > > > In swift, how would I set an environment variable? > > > > For example, in a c-script: > > > > setenv WKDIR /user/bin > > > > > > > > would translate to swift how? > > > > Thank you > > > > > > > > T. R. Sines > > > > > > > > > > > > > > > > _______________________________________________ > > > > Swift-user mailing list > > > > Swift-user at ci.uchicago.edu > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > > > > > > -- > > > Michael Wilde > > > Computation Institute, University of Chicago > > > Mathematics and Computer Science Division > > > Argonne National Laboratory > > > > -- > > Michael Wilde > > Computation Institute, University of Chicago > > Mathematics and Computer Science Division > > Argonne National Laboratory > > -- > Michael Wilde > Computation Institute, University of Chicago > Mathematics and Computer Science Division > Argonne National Laboratory -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From wilde at mcs.anl.gov Fri May 28 13:21:24 2010 From: wilde at mcs.anl.gov (Michael Wilde) Date: Fri, 28 May 2010 13:21:24 -0500 (CDT) Subject: [Swift-user] Question: Setting environment variables In-Reply-To: Message-ID: <19853115.201691275070884015.JavaMail.root@zimbra> I dont know what your current script does, but in many or most cases, users use Swift to execute their *existing* application scripts, rather than re-writing the wrapper script in Swift. You'd use Swift to run multiple invocations of your existing script in parallel. For example, lets say you have an executable program "myprog". You might be running this from a shell script, say "run_myprog.sh" that sets up all the files and environment vars the programs expects. In such cases, a common mode of using Swift is to define run_myprog.sh as the "application" in tc.data, and write a swift app function myprog() to call the run_myprog.sh wrapper. Then, once you have a single invocation of the program working OK from Swift, you'd add a Swift "foreach" statement to run many invocations of the program in parallel. So to answer your question more directly: you likely want to leave things like checking for the existence of environment variables to your shell script, and call your shell script from Swift. - Mike ----- "Taleena R Sines" wrote: > The weird question about using the script to invoke them was in > reference to if I'm checking, let's say, to see if an environmental > variable exists: > In the c-script: > if(!$MY_ROOT) > echo error > > in the swift script, how would I check to see if this exists? > > Taleena R. Sines > Major: Computer Science > > > > -----Original Message----- > From: wilde at mcs.anl.gov [ mailto:wilde at mcs.anl.gov ] > Sent: Fri 5/28/2010 1:55 PM > To: Taleena R Sines > Cc: Swift User > Subject: Re: [Swift-user] Question: Setting environment variables > > > ----- "Taleena R Sines" wrote: > > > The code I'm transforming has several environment variable sets, so > > would I be adding every one to the data file? > > You can specify multiple environment variables on a single application > in tc.data like this: > > localhost env /usr/bin/env none none > ENV::VAR1="value1";ENV::VAR2="value2" > > > After adding them to the file, would I need to do anything in the > > actual script to invoke changes? > > Environment variables are typically specified entirely in tc.data, so > you don't need to do anything in your .swift script related to them > (unless you need to change their value with each invocation of your > program, which would require some coordination between your .swift > script and a shell wrapper around your program to pass such values on > the command line. But I suspect you are not doing that at this point.) > > Regarding "invoke changes" - sounds like you might be thinking in > terms of compiling or building, as in "cc" and "make". But Swift > basically compiles, interprets, and executes your script from the > .swift source code each time you run the swift command. So there is > effectively nothing that needs to be done between changing your > tc.data and .swift file, and then executing the swift command again to > try your changes. > > - Mike > > > > > Thank you, I'm sorry for the stream of questions > > No problem, but please please please send them to swift-user :) so > that more people can answer you and more can benefit from the answers. > > > Taleena R. Sines > > Major: Computer Science > > > > > > > > -----Original Message----- > > From: Michael Wilde [ mailto:wilde at mcs.anl.gov ] > > Sent: Fri 5/28/2010 1:04 PM > > To: Taleena R Sines > > Cc: Swift User > > Subject: Re: [Swift-user] Question: Setting environment variables > > > > Did you make sure that all the fields are separated by a tab > > character, not spaces? > > If that was not the cause, I'll need to double-check and test my > > syntax. > > > > (please send all your replies back to the swift-user list). > > > > - Mike > > > > > > ----- "Taleena R Sines" wrote: > > > > > I inserted that line and it is giving me the error: > > > unexpected token: / > > > > > > > > > Taleena R. Sines > > > Major: Computer Science > > > > > > > > > > > > -----Original Message----- > > > From: Michael Wilde [ mailto:wilde at mcs.anl.gov ] > > > Sent: Fri 5/28/2010 12:48 PM > > > To: Taleena R Sines > > > Cc: Swift User > > > Subject: Re: [Swift-user] Question: Setting environment variables > > > > > > For: > > > > > > setenv CODE_HOME /trsines/code/my_code > > > > > > the example: > > > > > > localhost myapp /usr/bin/env none none ENV::myenvvar="something"; > > > > > > would become: > > > > > > localhost myapp /usr/bin/env none none ENV::CODE_HOME > > > ="/trsines/code/my_code"; > > > > > > - Mike > > > > > > ----- "Taleena R Sines" wrote: > > > > > > > If my code in c-script is : > > > > setenv CODE_HOME /trsines/code/my_code > > > > > > > > What would actually be typed in the swift-script in place of > that? > > > > thank you > > > > > > > > T. R. Sines > > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > From: wilde at mcs.anl.gov [ mailto:wilde at mcs.anl.gov ] > > > > Sent: Fri 5/28/2010 12:15 PM > > > > To: Taleena R Sines > > > > Cc: swift-user at ci.uchicago.edu > > > > Subject: Re: [Swift-user] Question: Setting environment > variables > > > > > > > > Taleena, > > > > > > > > You set env vars for a given app in the tc.data file using an > "Env > > > > profile": > > > > > > > > > http://www.ci.uchicago.edu/swift/guides/userguide.php#profile.env > > > > > > > > For example: > > > > > > > > localhost myapp /usr/bin/env none none > ENV::myenvvar="something"; > > > > > > > > Thats not real clear in the User Guide - we will fix that. > > > > > > > > - Mike > > > > > > > > > > > > ----- "Taleena R Sines" wrote: > > > > > > > > > Hello, > > > > > In swift, how would I set an environment variable? > > > > > For example, in a c-script: > > > > > setenv WKDIR /user/bin > > > > > > > > > > would translate to swift how? > > > > > Thank you > > > > > > > > > > T. R. Sines > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > Swift-user mailing list > > > > > Swift-user at ci.uchicago.edu > > > > > http://mail.ci.uchicago.edu/mailman/listinfo/swift-user > > > > > > > > -- > > > > Michael Wilde > > > > Computation Institute, University of Chicago > > > > Mathematics and Computer Science Division > > > > Argonne National Laboratory > > > > > > -- > > > Michael Wilde > > > Computation Institute, University of Chicago > > > Mathematics and Computer Science Division > > > Argonne National Laboratory > > > > -- > > Michael Wilde > > Computation Institute, University of Chicago > > Mathematics and Computer Science Division > > Argonne National Laboratory > > -- > Michael Wilde > Computation Institute, University of Chicago > Mathematics and Computer Science Division > Argonne National Laboratory -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory