<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Here is what I get at the UC/ANL TG site:<br>
qsub -I -l nodes=1:ppn=1:ia32-compute,walltime=0:30:00 -A TG-CCR070008T<br>
qsub -I -l nodes=1:ppn=2:ia32-compute,walltime=0:30:00 -A TG-CCR070008T<br>
<br>
iraicu@tg-viz-login2:~> showq -u iraicu<br>
<br>
active jobs------------------------<br>
JOBID USERNAME STATE PROCS REMAINING
STARTTIME<br>
<br>
1574623 iraicu Running 2 00:29:55 Tue Nov 6
12:34:23<br>
1574621 iraicu Running 2 00:29:21 Tue Nov 6
12:33:49<br>
<br>
2 active jobs 4 of 242 processors in use by local jobs
(1.65%)<br>
20 of 121 nodes active (16.53%)<br>
<br>
eligible jobs----------------------<br>
JOBID USERNAME STATE PROCS WCLIMIT
QUEUETIME<br>
<br>
<br>
0 eligible jobs <br>
<br>
blocked jobs-----------------------<br>
JOBID USERNAME STATE PROCS WCLIMIT
QUEUETIME<br>
<br>
<br>
0 blocked jobs <br>
<br>
Total jobs: 2<br>
<br>
Notice that both jobs have 2 processors allocated! These same commands
on TeraPort would have yielded one allocation with 1 processor and
another with 2 processors. This is what I meant by "it a policy
thing", because PBS can be configured to ignore the ppn field.<br>
<br>
Ioan<br>
<br>
Ben Clifford wrote:
<blockquote
cite="mid:Pine.LNX.4.64.0711061829380.5551@dildano.hawaga.org.uk"
type="cite">
<pre wrap="">That's what the ppn parameter specifies to PBS.
On Tue, 6 Nov 2007, Ioan Raicu wrote:
</pre>
<blockquote type="cite">
<pre wrap="">Right, its not that PBS doesn't support it, its more of a policy thing. On
the TeraGrid, my experience has been that when PBS (or whatever LRM is being
used) allocates CPUs, it always allocates at the machine level, not at the CPU
level. That means, if you have an 8 processor machine, and you get 1
processor on that machine, then you get (and are charged for) the whole
machine as you have exclusive rights to this machine for the duration of your
reservation. I have seen this behave differently in other environments, such
as TeraPort, where PBS was allocating at the processor level, and not the
machine level. This is why I said that I think Swift would need to somehow
handle this at the worker node scripts, and not rely necessarily on the LRM
doing this.
Ioan
Ben Clifford wrote:
</pre>
<blockquote type="cite">
<pre wrap="">On Tue, 6 Nov 2007, Ioan Raicu wrote:
</pre>
<blockquote type="cite">
<pre wrap="">2) the LRM allows the partitioning of the SMP machine into smaller pieces;
for
example, with 8 processor node, if it lets you submit 8 jobs that only
need 1
processor, and it will launch 8 different jobs on the same node, then you
are
fine... the parallelism will be done automatically by the LRM, as long as
you
ask for only 1 process at a time; on the TG at least, I don't think this
is
how things work, and when you get a node, regardless of how many
processors it
has, you get full access to all processors, not just the ones you asked
for.
</pre>
</blockquote>
<pre wrap="">
PBS allows the specification of multiple processes per node, like this
(grabbed from google)
</pre>
<blockquote type="cite">
<pre wrap="">qsub -l walltime=15:00,nodes=1:ppn=1 script.pbs
</pre>
</blockquote>
<pre wrap="">It looks like abe runs PBS.
So I think you could specify a globus profile key in the sites.xml, perhaps
something like this:
<profile namespace="globus" key="ppn">8</profile>
I haven't tried this myself, but I'd be interested to hear your results.
</pre>
</blockquote>
<pre wrap="">
</pre>
</blockquote>
<pre wrap=""><!---->
</pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
============================================
Ioan Raicu
Ph.D. Student
============================================
Distributed Systems Laboratory
Computer Science Department
University of Chicago
1100 E. 58th Street, Ryerson Hall
Chicago, IL 60637
============================================
Email: <a class="moz-txt-link-abbreviated" href="mailto:iraicu@cs.uchicago.edu">iraicu@cs.uchicago.edu</a>
Web: <a class="moz-txt-link-freetext" href="http://www.cs.uchicago.edu/~iraicu">http://www.cs.uchicago.edu/~iraicu</a>
<a class="moz-txt-link-freetext" href="http://dsl.cs.uchicago.edu/">http://dsl.cs.uchicago.edu/</a>
============================================
============================================</pre>
</body>
</html>