[Swift-user] Swift-MosaStore integration problem

[Michael Wilde]

----- Original Message -----
> From: "Emalayan Vairavanathan" <svemalayan at yahoo.com>
> To: "Michael Wilde" <wilde at mcs.anl.gov>
> Cc: swift-user at ci.uchicago.edu
> Sent: Thursday, October 27, 2011 9:11:51 PM
> Subject: Re: [Swift-user] Swift-MosaStore integration problem
> Emalyan, did you try filtering strace to zero in on open/close/creat
> etc?
> Mike could you please explain ?

strace has many options to trace on specific system calls, or *families* of system calls, to help reduce the volume of the trace and help you zero in on the things you care about. In particular, the -e file option:

"-e trace=file
                   Trace all system calls which take a file name as an argument.  You can think of this as an abbreviation
                   for -e trace=open,stat,chmod,unlink,...  which is useful to seeing what files the process is  referenc-
                   ing.   Furthermore,  using the abbreviation will ensure that you don't accidentally forget to include a
                   call like lstat in the list.  Betchya woulda forgot that one."

- Mike

> 
> Also, to try compiling the smallest possible Swift script, like a
> single trace or assignment statement?
> Yes I agree, this may make debugging simple.
> 
> But now that I think about it further, why are you running Swift on
> Mosa at all? Dont you just want to test that Swift can execute
> applications using Mosa as the workdirectory (in sites.xml)?
> Yes this make sense and help us to make quick progress. I will try
> this and get back to you.
> 
> 
> Thank you
> 
> Emalayan
> 
> 
> 
> 
> 
> 
> 
> From: Michael Wilde <wilde at mcs.anl.gov>
> To: Emalayan Vairavanathan <svemalayan at yahoo.com>
> Cc: swift-user at ci.uchicago.edu
> Sent: Thursday, 27 October 2011 2:59 PM
> Subject: Re: [Swift-user] Swift-MosaStore integration problem
> 
> Emalyan, did you try filtering strace to zero in on open/close/creat
> etc?
> 
> Also, to try compiling the smallest possible Swift script, like a
> single trace or assignment statement?
> 
> But now that I think about it further, why are you running Swift on
> Mosa at all? Dont you just want to test that Swift can execute
> applications using Mosa as the workdirectory (in sites.xml)?
> 
> Regards,
> 
> - Mike
> 
> ----- Original Message -----
> > From: "Emalayan Vairavanathan" < svemalayan at yahoo.com >
> > To: "Michael Wilde" < wilde at mcs.anl.gov >
> > Cc: swift-user at ci.uchicago.edu
> > Sent: Thursday, October 27, 2011 4:34:11 PM
> > Subject: Re: [Swift-user] Swift-MosaStore integration problem
> > Thank you Mike, I was using STrace but it seems very complex to find
> > the bug. So we are now using the profiler to mimic file system and
> > comparing the input and output of its fuse callbacks with Mosa.
> >
> >
> > Also I agree with you that Mosa is doing something wired.
> >
> >
> > Regards
> > Emalayan
> >
> >
> >
> >
> >
> > From: Michael Wilde < wilde at mcs.anl.gov >
> > To: Emalayan Vairavanathan < svemalayan at yahoo.com >
> > Cc: swift-user at ci.uchicago.edu
> > Sent: Thursday, 27 October 2011 12:57 PM
> > Subject: Re: [Swift-user] Swift-MosaStore integration problem
> >
> > Emalyan, can you use strace on the Swift jvm invocation to trave
> > Java's systems calls, and debug it in that manner?
> >
> > I suspect that Mosa is doing something that's not quite POSIX
> > compliant, and confusing Java and hence Swift.
> >
> > - Mike
> >
> >
> > ----- Original Message -----
> > > From: "Emalayan Vairavanathan" < svemalayan at yahoo.com >
> > > To: swift-user at ci.uchicago.edu
> > > Sent: Thursday, October 27, 2011 2:35:13 PM
> > > Subject: [Swift-user] Swift-MosaStore integration problem
> > > Dear All,
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > When I try to run the HelloWorld.swift with MosaStore (MosaStore
> > > is
> > > a
> > > distributed storage developed by us) it is terminating with an
> > > error.
> > >
> > >
> > >
> > > Here HelloWorld.swift script is copied into the MosaStore
> > > filesystem.
> > > Also Swift has write permission in the file system. Because it can
> > > create some temporary files (swift.log and
> > > first-20111026-1848-hmo97vu7.log). But then it prints the error
> > > below
> > > and terminates (I have attached the log files. I am using swift
> > > 0.93).
> > >
> > >
> > >
> > > Max heap: 259522560
> > > Recompilation suppressed.
> > > Detailed exception:
> > > java.io.FileNotFoundException: /tmp/mount/dir1/first.kml (No such
> > > file
> > > or directory)
> > > at java.io.FileInputStream.open(Native Method)
> > > at java.io.FileInputStream.<init>(FileInputStream.java:137)
> > > at java.io.FileInputStream.<init>(FileInputStream.java:96)
> > > at java.io.FileReader.<init>(FileReader.java:58)
> > > at org.globus.cog.karajan.Loader.load(Loader.java:209)
> > > at org.griphyn.vdl.karajan.Loader.main(Loader.java:157)
> > > Could not start execution.
> > > /tmp/mount/dir1/first.kml (No such file or directory)
> > >
> > >
> > > It seems the Mosastore didnt receive any callback to create
> > > first.kml.
> > > I think, due to some reasons JVM assumes the storage is not
> > > available
> > > and terminate the swift program. So I am wondering whether you can
> > > provide any hint about this issue.
> > >
> > > Also I would like to build the swift in debug mode in order to run
> > > it
> > > with jdb (to get more information). Please let me know how to
> > > build
> > > the swift in debug mode?
> > >
> > >
> > > Thank you
> > > Emalayan
> > >
> > >
> > >
> > >
> > >
> > > _______________________________________________
> > > Swift-user mailing list
> > > Swift-user at ci.uchicago.edu
> > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
> >
> > --
> > Michael Wilde
> > Computation Institute, University of Chicago
> > Mathematics and Computer Science Division
> > Argonne National Laboratory
> 
> --
> Michael Wilde
> Computation Institute, University of Chicago
> Mathematics and Computer Science Division
> Argonne National Laboratory

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory