<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div dir="ltr">
<div dir="ltr"><br>
<br>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Feb 27, 2019 at 7:03 PM Sajid Ali <<a href="mailto:sajidsyed2021@u.northwestern.edu">sajidsyed2021@u.northwestern.edu</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div class="gmail-m_533769283401793589markdown-here-wrapper">
<p style="margin:0px 0px 1.2em">Hi Junchao, </p>
<p style="margin:0px 0px 1.2em">I’m confused with the syntax. If I submit the following as my job script, I get an error :</p>
<pre style="font-family:Consolas,Inconsolata,Courier,monospace;font-size:1em;line-height:1.2em;margin:1.2em 0px"><code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;background-color:rgb(248,248,248);white-space:pre-wrap;overflow:auto;border-radius:3px;border:1px solid rgb(204,204,204);padding:0.5em 0.7em;display:block">#!/bin/bash
#SBATCH --job-name=petsc_test
#SBATCH -N 1
#SBATCH -C knl,quad,flat
#SBATCH -p apsxrmd
#SBATCH --time=1:00:00
module load intel/18.0.3-d6gtsxs
module load intel-parallel-studio/cluster.2018.3-xvnfrfz
module load numactl-2.0.12-intel-18.0.3-wh44iog
srun -n 64 -c 64 --cpu_bind=cores numactl -m 1 aps ./ex_modify -ts_type cn -prop_steps 25 -pc_type gamg -ts_monitor -log_view
</code></pre>
<p style="margin:0px 0px 1.2em">The error is :<br>
srun: cluster configuration lacks support for cpu binding<br>
</p>
</div>
</div>
</blockquote>
<div>This cluster does not support cpu binding. You need to remove --cpu_bind=cores. In addition, I don't know what is the 'aps' argument</div>
<div> </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div class="gmail-m_533769283401793589markdown-here-wrapper">
<p style="margin:0px 0px 1.2em">srun: error: Unable to create step for job 916208: More processors requested than permitted</p>
</div>
</div>
</blockquote>
<div>I remember the product of -n -c has to be 256. You can try srun -n 64 -c 4 numactl -m 1 ./ex_modify ...</div>
<div> </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div class="gmail-m_533769283401793589markdown-here-wrapper">
<p style="margin:0px 0px 1.2em">I’m following the advice as given at slide 33 of <a href="https://www.nersc.gov/assets/Uploads/02-using-cori-knl-nodes-20170609.pdf" target="_blank">
https://www.nersc.gov/assets/Uploads/02-using-cori-knl-nodes-20170609.pdf</a></p>
<p style="margin:0px 0px 1.2em">For further info, I’m using LCRC at ANL. </p>
<p style="margin:0px 0px 1.2em">Thank You,<br>
Sajid Ali<br>
Applied Physics<br>
Northwestern University</p>
<div title="MDH:PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0
ciI+PGRpdj5IaSBKdW5jaGFvLCA8YnI+PGJyPjwvZGl2PkknbSBjb25mdXNlZCB3aXRoIHRoZSBz
eW50YXguIElmIEkgc3VibWl0IHRoZSBmb2xsb3dpbmcgYXMgbXkgam9iIHNjcmlwdCwgSSBnZXQg
YW4gZXJyb3IgOjxicj48L2Rpdj48ZGl2IGRpcj0ibHRyIj48YnI+PC9kaXY+PGRpdiBkaXI9Imx0
ciI+YGBgPGJyPiMhL2Jpbi9iYXNoPGJyPiNTQkFUQ0ggLS1qb2ItbmFtZT1wZXRzY190ZXN0PGJy
PiNTQkFUQ0ggLU4gMSA8YnI+I1NCQVRDSCAtQyBrbmwscXVhZCxmbGF0PGJyPiNTQkFUQ0ggLXAg
YXBzeHJtZDxicj4jU0JBVENIIC0tdGltZT0xOjAwOjAwPGJyPjxicj5tb2R1bGUgbG9hZCBpbnRl
bC8xOC4wLjMtZDZndHN4czxicj5tb2R1bGUgbG9hZCBpbnRlbC1wYXJhbGxlbC1zdHVkaW8vY2x1
c3Rlci4yMDE4LjMteHZuZnJmejxicj5tb2R1bGUgbG9hZCBudW1hY3RsLTIuMC4xMi1pbnRlbC0x
OC4wLjMtd2g0NGlvZzwvZGl2PjxkaXYgZGlyPSJsdHIiPnNydW4gLW4gNjQgLWMgNjQgLS1jcHVf
YmluZD1jb3JlcyBudW1hY3RsIC1tIDEgYXBzIC4vZXhfbW9kaWZ5IC10c190eXBlIGNuIC1wcm9w
X3N0ZXBzIDI1IC1wY190eXBlIGdhbWcgLXRzX21vbml0b3IgLWxvZ192aWV3IDxicj5gYGA8YnI+
PGJyPjwvZGl2PjxkaXY+VGhlIGVycm9yIGlzIDogPGJyPnNydW46IGNsdXN0ZXIgY29uZmlndXJh
dGlvbiBsYWNrcyBzdXBwb3J0IGZvciBjcHUgYmluZGluZzxicj5zcnVuOiBlcnJvcjogVW5hYmxl
IHRvIGNyZWF0ZSBzdGVwIGZvciBqb2IgOTE2MjA4OiBNb3JlIHByb2Nlc3NvcnMgcmVxdWVzdGVk
IHRoYW4gcGVybWl0dGVkPGJyPjwvZGl2PjxkaXYgZGlyPSJsdHIiPjxicj48L2Rpdj48ZGl2Pkkn
bSBmb2xsb3dpbmcgdGhlIGFkdmljZSBhcyBnaXZlbiBhdCBzbGlkZSAzMyBvZiBodHRwczovL3d3
dy5uZXJzYy5nb3YvYXNzZXRzL1VwbG9hZHMvMDItdXNpbmctY29yaS1rbmwtbm9kZXMtMjAxNzA2
MDkucGRmPGJyPjxicj48L2Rpdj48ZGl2PkZvciBmdXJ0aGVyIGluZm8sIEknbSB1c2luZyBMQ1JD
IGF0IEFOTC4gPGJyPjwvZGl2PjxkaXYgZGlyPSJsdHIiPjxkaXY+PGRpdj48ZGl2PjxkaXY+PGJy
PjwvZGl2PjxkaXY+VGhhbmsgWW91LCA8YnI+PC9kaXY+PGRpdj48ZGl2IGRpcj0ibHRyIiBjbGFz
cz0iZ21haWxfc2lnbmF0dXJlIj48ZGl2IGRpcj0ibHRyIj48ZGl2IHN0eWxlPSJmb250LXNpemU6
IDEyLjhweDsiPlNhamlkIEFsaTxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LXNpemU6IDEyLjhw
eDsiPkFwcGxpZWQgUGh5c2ljczxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LXNpemU6IDEyLjhw
eDsiPk5vcnRod2VzdGVybiBVbml2ZXJzaXR5PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+
PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+PC9kaXY+" style="height:0px;width:0px;max-height:0px;max-width:0px;overflow:hidden;font-size:0em;padding:0px;margin:0px">
</div>
</div>
</div>
</blockquote>
</div>
</div>
</body>
</html>