[Swift-devel] qsub env

[Mihael Hategan]

There is no user-customizable way to pass environment variables to the
block job through coasters, mostly because worker.pl is the only entity
that could use them.

So this should be a cobalt provider option. The way you would do it is
similar to how, for example, PBS handles custom options (see, for
example pbs.resource_list).

If you give me the specifics, I could do it.

Mihael


On Fri, 2015-05-08 at 14:04 -0500, Ketan Maheshwari wrote:
> Cobalt uses the environment variable in the way it allocates compute
> blocks: bootable vs non-bootable. --Ketan
> 
> On Fri, May 8, 2015 at 2:02 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
> 
> > Let me rephrase the question. What entity uses this environment
> > variable?
> >
> > Mihael
> >
> > On Fri, 2015-05-08 at 13:34 -0500, Ketan Maheshwari wrote:
> > > Hi Mihael,
> > >
> > > I am trying to pass an environment variable at the qsub level.
> > >
> > > In the Swift source, CobalExecutor.java, I find the following code as
> > part
> > > of qsub commandline builder:
> > >
> > > Collection<String> names = getSpec().getEnvironmentVariableNames();
> > >         if (names != null && names.size() > 0) {
> > >             result.add("--env");
> > >             StringBuffer sb = new StringBuffer();
> > >             Iterator<String> i = names.iterator();
> > >             while (i.hasNext()) {
> > >                 String name = i.next();
> > >                 sb.append(name);
> > >                 sb.append('=');
> > >                 sb.append(quote(getSpec().getEnvironmentVariable(name)));
> > >                 if (i.hasNext()) {
> > >                     sb.append(':');
> > >                 }
> > >             }
> > >             result.add(sb.toString());
> > >
> > > I am wondering how to add my environment variable to this list.
> > >
> > > --
> > > Ketan
> > >
> > >
> > > On Fri, May 8, 2015 at 1:18 PM, Mihael Hategan <hategan at mcs.anl.gov>
> > wrote:
> > >
> > > > Are you trying to pass an environment variable to an app or to the
> > > > worker?
> > > >
> > > > Mihael
> > > >
> > > > On Fri, 2015-05-08 at 13:00 -0500, Ketan Maheshwari wrote:
> > > > > Hi,
> > > > >
> > > > > Question about the cobalt provider with 0.96: how to set an
> > environment
> > > > so
> > > > > that it ends up on the qsub line:
> > > > >
> > > > > qsub --env MY_ENV=true ...
> > > > >
> > > > > I tried to add the env.MY_ENV line under site.cluster
> > > > > and site.cluster.execution.options but to no avail.
> > > > >
> > > > > From logs of my current runs, I see that the qsub line contains one
> > > > > environment variable:
> > > > >
> > > > > qsub --env WORKER_LOGGING_LEVEL=NONE --mode script --proccount 32 ...
> > > > >
> > > > > but I do not see it being specified anywhere in my conf file.
> > > > >
> > > > > Thanks for any suggestions.
> > > > >
> > > > > --
> > > > > Ketan
> > > > > _______________________________________________
> > > > > Swift-devel mailing list
> > > > > Swift-devel at ci.uchicago.edu
> > > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > >
> > > >
> > > > _______________________________________________
> > > > Swift-devel mailing list
> > > > Swift-devel at ci.uchicago.edu
> > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > >
> >
> >
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >