[Swift-devel] Problems with coasters and managedfork jobmanager

[Mihael Hategan]

----- Michael Wilde <wilde at mcs.anl.gov> wrote:
> Was it not possible and/or easy to let GRAM stage in bootstrap.sh as a 
> stdin file to /bin/bash,

With GT4 that would have required users to have a gridftp server on the
Swift side. Which seems to come in conflict with ease of use, so I think
it's a bad idea.

>From a theoretical perspective, it also annoys me that with staging in,
there is no way to guarantee lack of contention in file naming without
globally unique identifiers.

> the equivalent of:
> 
> com$ globus-job-run tp-osg.uchicago.edu -stdin -s longscript.sh /bin/sh
> hello
> world
> com$
> 
> - Mike
> 
> On 2/9/09 6:16 PM, Mihael Hategan wrote:
> > I did get a one-liner perl which contains an encoded bootstrap jar file
> > (only printable characters). Perl cares less about whitespace, which
> > makes me think it's a better candidate if we want to go that way.
> > 
> > Thoughts?
> > 
> > On Mon, 2009-02-09 at 17:05 -0600, Michael Wilde wrote:
> >> No, correction, I mis-spoke.  When I try this direct to the shell (as 
> >> opposed to via swift and coaster bootstrap) I get the same error as you 
> >> show. I cant get sh to accept function defs on 1 line.
> >>
> >> So I must have mis-interpreted my result from last Friday.
> >>
> >> - Mike
> >>
> >>
> >> On 2/9/09 4:06 PM, Michael Wilde wrote:
> >>> sorry, i think i put the wrong version there; i dealt with that specific 
> >>> problem and hit a subtler one, deeper in the bootstrap process.
> >>>
> >>> On 2/9/09 2:34 PM, Mihael Hategan wrote:
> >>>> I asked because I couldn't figure out how to get it to work.
> >>>>
> >>>> But it seems like yours has problems, too:
> >>>> mike at blabla tmp$ sh bootstrap.nonl.sh
> >>>> bootstrap.nonl.sh: line 1: syntax error near unexpected token `;'
> >>>> ...
> >>>>
> >>>> On Mon, 2009-02-09 at 14:23 -0600, Michael Wilde wrote:
> >>>>> its www.ci.uchicago.edu/~wilde/bootstrap.nonl.sh, plus I removed the 
> >>>>> code in ServiceManager that inserted the extra newlines when reading 
> >>>>> it into a string buffer. I checked as far as verifying in the gram 
> >>>>> log that it was seen by gram as a single line in the rsl.  I never 
> >>>>> got a successful run from it, though - it ran into other problems later.
> >>>>>
> >>>>> On 2/9/09 1:46 PM, Mihael Hategan wrote:
> >>>>>> On Fri, 2009-02-06 at 10:33 -0600, Michael Wilde wrote:
> >>>>>>> I dont know, but I am testing a version where I removed the 
> >>>>>>> newlines from bootstrap.pl (and adjusted a few bits manually)
> >>>>>> May we see that?
> >>>>>>
> >>>>>>>  and I *think* its moving on to the next stage and trying to start 
> >>>>>>> the workers.
> >>>>>>>
> >>>>>>> Ben, it seems that *some* whitespace is passed on OK, in that I can 
> >>>>>>> run a job that does echo "hello world" and that blank after hello 
> >>>>>>> is preserved, and the job runs. I assume the whitespace problem is 
> >>>>>>> more subtle than that?
> >>>>>>>
> >>>>>>> On 2/6/09 10:24 AM, Mihael Hategan wrote:
> >>>>>>>> On Fri, 2009-02-06 at 16:17 +0000, Ben Clifford wrote:
> >>>>>>>>> On Fri, 6 Feb 2009, Mihael Hategan wrote:
> >>>>>>>>>
> >>>>>>>>>> I guess we'll have to stage in the bootstrap script using the 
> >>>>>>>>>> stage-in
> >>>>>>>>>> directive if we are to support managed fork, since I don't see OSG
> >>>>>>>>>> fixing the issue.
> >>>>>>>>> They are fixing the whitespace in parameters - see the gram-user 
> >>>>>>>>> thread I sent in a different message.
> >>>>>>>> Does this include the new lines?
> >>>>>>>>
> >>> _______________________________________________
> >>> Swift-devel mailing list
> >>> Swift-devel at ci.uchicago.edu
> >>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
> >