[Swift-devel] qsub env

Ketan Maheshwari ketan at mcs.anl.gov
Fri May 8 14:41:45 CDT 2015


In terms of cobalt provider option, it would be the switch
"--disable_preboot". The corresponding environment variable is "--env
RUNJOB_DISABLE_PREBOOT=true". --Ketan

On Fri, May 8, 2015 at 2:22 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> There is no user-customizable way to pass environment variables to the
> block job through coasters, mostly because worker.pl is the only entity
> that could use them.
>
> So this should be a cobalt provider option. The way you would do it is
> similar to how, for example, PBS handles custom options (see, for
> example pbs.resource_list).
>
> If you give me the specifics, I could do it.
>
> Mihael
>
>
> On Fri, 2015-05-08 at 14:04 -0500, Ketan Maheshwari wrote:
> > Cobalt uses the environment variable in the way it allocates compute
> > blocks: bootable vs non-bootable. --Ketan
> >
> > On Fri, May 8, 2015 at 2:02 PM, Mihael Hategan <hategan at mcs.anl.gov>
> wrote:
> >
> > > Let me rephrase the question. What entity uses this environment
> > > variable?
> > >
> > > Mihael
> > >
> > > On Fri, 2015-05-08 at 13:34 -0500, Ketan Maheshwari wrote:
> > > > Hi Mihael,
> > > >
> > > > I am trying to pass an environment variable at the qsub level.
> > > >
> > > > In the Swift source, CobalExecutor.java, I find the following code as
> > > part
> > > > of qsub commandline builder:
> > > >
> > > > Collection<String> names = getSpec().getEnvironmentVariableNames();
> > > >         if (names != null && names.size() > 0) {
> > > >             result.add("--env");
> > > >             StringBuffer sb = new StringBuffer();
> > > >             Iterator<String> i = names.iterator();
> > > >             while (i.hasNext()) {
> > > >                 String name = i.next();
> > > >                 sb.append(name);
> > > >                 sb.append('=');
> > > >
>  sb.append(quote(getSpec().getEnvironmentVariable(name)));
> > > >                 if (i.hasNext()) {
> > > >                     sb.append(':');
> > > >                 }
> > > >             }
> > > >             result.add(sb.toString());
> > > >
> > > > I am wondering how to add my environment variable to this list.
> > > >
> > > > --
> > > > Ketan
> > > >
> > > >
> > > > On Fri, May 8, 2015 at 1:18 PM, Mihael Hategan <hategan at mcs.anl.gov>
> > > wrote:
> > > >
> > > > > Are you trying to pass an environment variable to an app or to the
> > > > > worker?
> > > > >
> > > > > Mihael
> > > > >
> > > > > On Fri, 2015-05-08 at 13:00 -0500, Ketan Maheshwari wrote:
> > > > > > Hi,
> > > > > >
> > > > > > Question about the cobalt provider with 0.96: how to set an
> > > environment
> > > > > so
> > > > > > that it ends up on the qsub line:
> > > > > >
> > > > > > qsub --env MY_ENV=true ...
> > > > > >
> > > > > > I tried to add the env.MY_ENV line under site.cluster
> > > > > > and site.cluster.execution.options but to no avail.
> > > > > >
> > > > > > From logs of my current runs, I see that the qsub line contains
> one
> > > > > > environment variable:
> > > > > >
> > > > > > qsub --env WORKER_LOGGING_LEVEL=NONE --mode script --proccount
> 32 ...
> > > > > >
> > > > > > but I do not see it being specified anywhere in my conf file.
> > > > > >
> > > > > > Thanks for any suggestions.
> > > > > >
> > > > > > --
> > > > > > Ketan
> > > > > > _______________________________________________
> > > > > > Swift-devel mailing list
> > > > > > Swift-devel at ci.uchicago.edu
> > > > > >
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > > >
> > > > >
> > > > > _______________________________________________
> > > > > Swift-devel mailing list
> > > > > Swift-devel at ci.uchicago.edu
> > > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > > >
> > >
> > >
> > > _______________________________________________
> > > Swift-devel mailing list
> > > Swift-devel at ci.uchicago.edu
> > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > >
>
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20150508/e6f4789b/attachment.html>


More information about the Swift-devel mailing list