[Swift-user] cray (Edison)

[Ketan Maheshwari]

Hi,

I am trying to submit to a cray machine (Edison) with 24 cores per node. I
am looking to submit a 25 node 600 tasks job but with my sites
configuration, it results in a 25 node 25 tasks submission.

The sites file bits are:

   <profile namespace="globus" key="jobsPerNode">24</profile>
    <profile namespace="globus"
key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile>
    <profile namespace="globus" key="maxTime">1000</profile>
    <profile namespace="globus" key="wallTime">00:30:00</profile>
    <profile namespace="globus" key="slots">1</profile>
    <profile namespace="globus" key="nodeGranularity">25</profile>
    <profile namespace="globus" key="maxNodes">25</profile>

The resulting job is:


      Req'd    Req'd       Elap
Job ID                  Username    Queue    Jobname          SessID  NDS
TSK   Memory   Time    S   Time
----------------------- ----------- -------- ---------------- ------ -----
------ ------ --------- - ---------
2204800.edique02        ketan       debug    B1218-5106290-0     --     25
    25    --   00:16:00 C       --

The resulting submit script is:

#PBS -S /bin/bash
#PBS -N B1218-5106290-0
#PBS -m n
#PBS -l mppwidth=25,mppnppn=1,mppdepth=24
#PBS -l walltime=00:16:00
#PBS -q debug
#PBS -o
/scratch2/scratchdirs/ketan/WRF_LES/WRFV3/ketanrun/run001/scripts/PBS8090417396448920648.submit.stdout
#PBS -e
/scratch2/scratchdirs/ketan/WRF_LES/WRFV3/ketanrun/run001/scripts/PBS8090417396448920648.submit.stderr
export WORKER_LOGGING_LEVEL=NONE
#PBS -v WORKER_LOGGING_LEVEL
cd / && aprun -n 25 -N 1 -cc none -d 24 -F exclusive /bin/sh -c
'/usr/bin/perl /global/homes/k/ketan/.globus/coasters/
cscript6966010727500767046.pl http://10.10.20.170:58984,
http://10.100.100.52:58984,http://10.141.1.2:58984,http://127.0.0.2:58984,
http://128.55.34.2:58984,http://128.55.72.100:58984,
http://128.55.72.22:58984 1218-5106290-000000 NOLOGGING'
/bin/echo $?
>/scratch2/scratchdirs/ketan/WRF_LES/WRFV3/ketanrun/run001/scripts/PBS8090417396448920648.submit.exitcode


I am looking to get mppwidth and -n switch of aprun to 600

Thanks for any suggestions.

Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20141218/7f8280b4/attachment.html>