[Swift-devel] Swift PBS coaster jobs seem to bypass automounter

[Michael Wilde]

At the moment I'm fairly certain this is a PADS automount problem. Ive seen the same script work and fail; I finally saw the problem manually with qsub -I. It seems ot be occurring on sporadic PADS nodes. Ive reported it to Support.

- Mike

----- "Michael Wilde" <wilde at mcs.anl.gov> wrote:

> As far as I can tell, the same problem occurs in the plain PBS
> provider.
> 
> I'll try to capture the pbs submit file and see if the error can be
> reproduced submitting the same file manually.
> 
> - Mike
> 
> ----- wilde at mcs.anl.gov wrote:
> 
> > Mihael, Neil Best is having problems accessing PADS datasets on the
> > SEE project from Swift jobs run to the coaster pbs provider.
> > 
> > The same file access works fine from a simple qsub job or a qsub -I
> > 
> > The path that's unreachable/unmounted from a Swift PBS coaster job
> > is:
> > 
> >   /gpfs/pads
> > 
> > In that dir, ls run under swift sees only:
> > 
> > drwxr-xr-x 5 root root 4096 Feb 25 12:35 scratch
> > 
> > ...while it should see the files below. I'm debugging further to
> find
> > out why.
> > Something different in the user startup processing under Swift than
> > under plain qsub?
> > 
> > - Mike
> > 
> > 
> > login1$ ls -l 
> > total 10848
> > lrwxrwxrwx  1 root  root         21 Jun 17  2009 angle ->
> > projects/CI-NCR000005/
> > -rw-r--r--  1 root  root    3491069 Jun  2  2009 bad-files
> > drwxr-xr-x  2 root  root      32768 Jan  9 08:53 cnfs/
> > lrwxrwxrwx  1 root  root         21 Jun 15  2009 esg ->
> > projects/CI-ATM000007/
> > ----------  1 root  root      20608 Feb 25 13:23 fileset.quota
> > lrwxrwxrwx  1 root  root         21 Jun 23  2009 flash ->
> > projects/CI-AST000010/
> > drwxrwsr-x 32 root  fmri      32768 Jan  8 12:42 fmri/
> > lrwxrwxrwx  1 root  root         21 Jun 15  2009 gedi ->
> > projects/CI-IBN000008/
> > lrwxrwxrwx  1 root  root         25 Jun 15  2009 gedi-dev ->
> > projects/CI-IBN000008/dev
> > lrwxrwxrwx  1 root  root         21 Jun 19  2009 gridts ->
> > projects/CI-CCR000016/
> > ----------  1 root  root      51840 Feb 25 13:23 group.quota
> > lrwxrwxrwx  1 root  root         21 Jun 23  2009 i2u2 ->
> > projects/CI-SEE000014/
> > lrwxrwxrwx  1 root  root         21 Jun 23  2009 ligandatlas ->
> > projects/CI-MCB000012/
> > lrwxrwxrwx  1 root  root         21 Jun 17  2009 margoliash ->
> > projects/CI-IBN000003/
> > lrwxrwxrwx  1 root  root         21 Jun 19  2009 media ->
> > projects/CI-STA000015/
> > drwxrwsr-x 21 root  newslab   32768 Sep 12 11:30 newslab/
> > drwxrwsr-x  9 wilde oops      32768 Feb 24 13:59 oops/
> > lrwxrwxrwx  1 root  root         21 Jun 19  2009 osgedu ->
> > projects/CI-SEE000004/
> > drwxr-xr-x 41 root  root      32768 Feb 16 21:25 projects/
> > drwxr-xr-x 31 root  root      32768 Feb 25 10:11 scratch/
> > lrwxrwxrwx  1 root  root         21 Jun 23  2009 swift ->
> > projects/CI-CCR000013/
> > drwxr-xr-x  2 grog  root      32768 Jan  9 11:38 test/
> > ----------  1 root  root      89728 Feb 25 13:23 user.quota
> > lrwxrwxrwx  1 root  root         21 Jun 19  2009 whitelab ->
> > projects/CI-MCB000017/
> > login1$ pwd
> > /gpfs/pads
> > login1$ df .
> > Filesystem           1K-blocks      Used Available Use% Mounted on
> > nfs.ci.uchicago.edu:/exports/pads-gpfs
> >                      359446007808 136176995328 223269012480  38%
> > /autonfs/gpfs-pads
> > login1$ 
> > 
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel