[Swift-devel] Re: Q about wrapper.sh

[Zhao Zhang]

I am also attaching one info file:

dev/shm/swift-info/k/k # cat thetaworker-kk8c9l1j-info
Progress  2008-10-30 21:25:13  LOG_START
Missing -of argument

_____________________________________________________________________________

        uname -a
_____________________________________________________________________________

Linux (none) 2.6.19.2 #1 SMP Thu Jul 31 17:08:44 CDT 2008 ppc unknown

_____________________________________________________________________________

        id
_____________________________________________________________________________

uid=0(root) gid=0(root)

_____________________________________________________________________________

        env
_____________________________________________________________________________

PLOTICUS_HOME=/home/falkon/users/zzhang/0671/ploticus
FALKON_CLIENT_HOME=/home/falkon/users/zzhang/0671/client
GLOBUS_OPTIONS_MISC=-Xms512M -Xmx512M -Xss128K
GLOBUS_LOCATION=/home/falkon/users/zzhang/0671/container
FALKON_CONFIG=/home/falkon/users/zzhang/0671/config
GLOBUS_PATH=/home/falkon/users/zzhang/0671/container
ANT_HOME=/home/falkon/users/zzhang/0671/apache-ant-1.7.0
LD_LIBRARY_PATH=.:/lib:/fuse/lib:/fuse/usr/lib:/home/falkon/users/zzhang/0671/container/lib:/lib:/fuse/lib:/fuse/usr/lib
FALKON_LOGS=/home/falkon/users/zzhang/0671/logs
FALKON_CLIENT_WORKLOADS_HOME=/home/falkon/users/zzhang/0671/workloads
FALKON_HOME=/home/falkon/users/zzhang/0671
PATH=/home/falkon/users/zzhang/0671/bin:/home/falkon/users/zzhang/0671/service:/home/falkon/users/zzhang/0671/worker:/home/falkon/users/zzhang/0671/client:/home/falkon/users/zzhang/0671/monitor:/home/falkon/users/zzhang/0671/webserver:/home/falkon/users/zzhang/0671/ploticus/src:/home/falkon/users/zzhang/0671/apache-ant-1.7.0:/home/falkon/users/zzhang/0671/apache-ant-1.7.0/bin:/home/falkon/users/zzhang/0671/ibm-java2-ppc-50/jre:/home/falkon/users/zzhang/0671/ibm-java2-ppc-50/jre/bin:/home/falkon/users/zzhang/0671/container:/home/falkon/users/zzhang/0671/container/bin:/home/falkon/users/zzhang/0671/cog/modules/vdsk/dist/vdsk-svn/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:.
PWD=/fuse/gpfs/home/falkon/economics/tibi-20081030-1624-9mvoav3f
JAVA_HOME=/home/falkon/users/zzhang/0671/ibm-java2-ppc-50/jre
COBALT_JOBID=78356
SWIFT_HOME=/home/falkon/users/zzhang/0671/cog/modules/vdsk/dist/vdsk-svn
SHLVL=2
GLOBUS_TCP_PORT_RANGE=50000,59999
FALKON_WWW_HOME=/home/falkon/users/zzhang/0671/webserver
BG_SIZE=1
FALKON_MONITOR_HOME=/home/falkon/users/zzhang/0671/monitor
FALKON_WORKER_HOME=/home/falkon/users/zzhang/0671/worker
FALKON_SERVICE_HOME=/home/falkon/users/zzhang/0671/service
CONTROL_INIT=4195440,0,1,0,44
FALKON_ROOT=/home/falkon/users/zzhang
_=/bin/env

_____________________________________________________________________________

        df
_____________________________________________________________________________

Filesystem           1k-blocks      Used Available Use% Mounted on
none                    782528       896    781632   0% /dev/shm

_____________________________________________________________________________

        /proc/cpuinfo
_____________________________________________________________________________

processor       : 0
cpu             : 450 Blue Gene/P DD2
revision        : 24.128 (pvr 5213 1880)
bogomips        : 1700.00

processor       : 1
cpu             : 450 Blue Gene/P DD2
revision        : 24.128 (pvr 5213 1880)
bogomips        : 1700.00

processor       : 2
cpu             : 450 Blue Gene/P DD2
revision        : 24.128 (pvr 5213 1880)
bogomips        : 1700.00

processor       : 3
cpu             : 450 Blue Gene/P DD2
revision        : 24.128 (pvr 5213 1880)
bogomips        : 1700.00

total bogomips  : 6800.00
vendor          : IBM
machine         : Blue Gene

_____________________________________________________________________________

        /proc/meminfo
_____________________________________________________________________________

MemTotal:      1565120 kB
MemFree:       1517696 kB
Buffers:             0 kB
Cached:          27072 kB
SwapCached:          0 kB
Active:          26240 kB
Inactive:         8256 kB
SwapTotal:           0 kB
SwapFree:            0 kB
Dirty:               0 kB
Writeback:           0 kB
AnonPages:        5888 kB
Mapped:           4544 kB
Slab:             6400 kB
SReclaimable:      896 kB
SUnreclaim:       5504 kB
PageTables:       1984 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:    782528 kB
Committed_AS:    69376 kB
VmallocTotal:   212928 kB
VmallocUsed:       512 kB
VmallocChunk:   212416 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:    16384 kB

_____________________________________________________________________________

        command line
_____________________________________________________________________________

thetaworker-kk8c9l1j -jobdir k/k -e 
/home/falkon/economics/bin/runWorker-bgp.sh -out stdout.txt -err 
stderr.txt -i -d iofiles -if iofiles/DataInit1.txt


Zhao Zhang wrote:
> Hi,
>
> I got a problem when running swift and falkon together on BGP. Here is 
> the description.
> If there are multiple input files from swift, the command falkon would 
> receive is
> shared/wrapper.sh thetaworker-9ypial1j -jobdir 9/y -e 
> /home/falkon/economics/bin/runWorker-bgp.sh -out stdout.txt -err 
> stderr.txt -i -d iofiles -if 
> *iofiles/DataInit1.txt|iofiles/ApproxData1.txt* -of  -k  -a 1 
> iofiles/DataInit1.txt iofiles/ApproxData1.txt
> the delimiter is "|"
>
> When the following code in wrapper tried to parse "-if", it only take 
> one file out, what kind of change do I need to change? Thanks
>
> best wishes
> zhangzhao
>
> getarg() {
>        NAME=$1
>        shift
>        VALUE=""
>        SHIFTCOUNT=0
>        if [ "$1" == "$NAME" ]; then
>                shift
>                let "SHIFTCOUNT=$SHIFTCOUNT+1"
>                while [ "${1:0:1}" != "-" ] && [ "$#" != "0" ]; do
>                        VALUE="$VALUE $1"
>                        shift
>                        let "SHIFTCOUNT=$SHIFTCOUNT+1"
>                done
>        else
>                fail 254 "Missing $NAME argument"
>        fi
>        VALUE="${VALUE:1}"
> }
>
>