[Swift-devel] qsub env
Mihael Hategan
hategan at mcs.anl.gov
Fri May 8 14:52:17 CDT 2015
Done:
options.jobOptions.cobalt.disablePreboot: <boolean>
It was a one liner in Cobalt executor. For reference, if you need to do
something similar:
https://github.com/swift-lang/swift-k/commit/4177dc0a6f7597c05924df10f0b617df535f5c5a
Let me know if it doesn't work properly.
Mihael
On Fri, 2015-05-08 at 14:41 -0500, Ketan Maheshwari wrote:
> In terms of cobalt provider option, it would be the switch
> "--disable_preboot". The corresponding environment variable is "--env
> RUNJOB_DISABLE_PREBOOT=true". --Ketan
>
> On Fri, May 8, 2015 at 2:22 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
>
> > There is no user-customizable way to pass environment variables to the
> > block job through coasters, mostly because worker.pl is the only entity
> > that could use them.
> >
> > So this should be a cobalt provider option. The way you would do it is
> > similar to how, for example, PBS handles custom options (see, for
> > example pbs.resource_list).
> >
> > If you give me the specifics, I could do it.
> >
> > Mihael
> >
> >
> > On Fri, 2015-05-08 at 14:04 -0500, Ketan Maheshwari wrote:
> > > Cobalt uses the environment variable in the way it allocates compute
> > > blocks: bootable vs non-bootable. --Ketan
> > >
> > > On Fri, May 8, 2015 at 2:02 PM, Mihael Hategan <hategan at mcs.anl.gov>
> > wrote:
> > >
> > > > Let me rephrase the question. What entity uses this environment
> > > > variable?
> > > >
> > > > Mihael
> > > >
> > > > On Fri, 2015-05-08 at 13:34 -0500, Ketan Maheshwari wrote:
> > > > > Hi Mihael,
> > > > >
> > > > > I am trying to pass an environment variable at the qsub level.
> > > > >
> > > > > In the Swift source, CobalExecutor.java, I find the following code as
> > > > part
> > > > > of qsub commandline builder:
> > > > >
> > > > > Collection<String> names = getSpec().getEnvironmentVariableNames();
> > > > > if (names != null && names.size() > 0) {
> > > > > result.add("--env");
> > > > > StringBuffer sb = new StringBuffer();
> > > > > Iterator<String> i = names.iterator();
> > > > > while (i.hasNext()) {
> > > > > String name = i.next();
> > > > > sb.append(name);
> > > > > sb.append('=');
> > > > >
> > sb.append(quote(getSpec().getEnvironmentVariable(name)));
> > > > > if (i.hasNext()) {
> > > > > sb.append(':');
> > > > > }
> > > > > }
> > > > > result.add(sb.toString());
> > > > >
> > > > > I am wondering how to add my environment variable to this list.
> > > > >
> > > > > --
> > > > > Ketan
> > > > >
> > > > >
> > > > > On Fri, May 8, 2015 at 1:18 PM, Mihael Hategan <hategan at mcs.anl.gov>
> > > > wrote:
> > > > >
> > > > > > Are you trying to pass an environment variable to an app or to the
> > > > > > worker?
> > > > > >
> > > > > > Mihael
> > > > > >
> > > > > > On Fri, 2015-05-08 at 13:00 -0500, Ketan Maheshwari wrote:
> > > > > > > Hi,
> > > > > > >
> > > > > > > Question about the cobalt provider with 0.96: how to set an
> > > > environment
> > > > > > so
> > > > > > > that it ends up on the qsub line:
> > > > > > >
> > > > > > > qsub --env MY_ENV=true ...
> > > > > > >
> > > > > > > I tried to add the env.MY_ENV line under site.cluster
> > > > > > > and site.cluster.execution.options but to no avail.
> > > > > > >
> > > > > > > From logs of my current runs, I see that the qsub line contains
> > one
> > > > > > > environment variable:
> > > > > > >
> > > > > > > qsub --env WORKER_LOGGING_LEVEL=NONE --mode script --proccount
> > 32 ...
> > > > > > >
> > > > > > > but I do not see it being specified anywhere in my conf file.
> > > > > > >
> > > > > > > Thanks for any suggestions.
> > > > > > >
> > > > > > > --
> > > > > > > Ketan
> > > > > > > _______________________________________________
> > > > > > > Swift-devel mailing list
> > > > > > > Swift-devel at ci.uchicago.edu
> > > > > > >
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > > > >
> > > > > >
> > > > > > _______________________________________________
> > > > > > Swift-devel mailing list
> > > > > > Swift-devel at ci.uchicago.edu
> > > > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > > > >
> > > >
> > > >
> > > > _______________________________________________
> > > > Swift-devel mailing list
> > > > Swift-devel at ci.uchicago.edu
> > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > >
> >
> >
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >
More information about the Swift-devel
mailing list