[Swift-devel] Example of wrapper staging?
Michael Wilde
wilde at anl.gov
Sat Nov 8 16:37:30 CST 2014
I get this error:
org.griphyn.vdl.util.SwiftConfigException: swift.conf:4 unexpected
property 'site.local.wrapperStagingLocalServer'
at
org.griphyn.vdl.util.SwiftConfigSchema.validate(SwiftConfigSchema.java:214)
Ive tried spelling this property both as in your sample .conf and as in
your text:
wrapperStagingLocalServer and wrapperStageingLocalServer
Neither is accepted. Did a schema change not get committed?
For general info: where is the json schema file that a user can check to
find all valid conf parameters?
Thanks,
- Mike
On 11/8/14 4:13 PM, Mihael Hategan wrote:
> type file;
>
> app (file c) cat(file a, file b) {
> cat filename(a) filename(b) stdout=filename(c);
> }
>
> file c <"c.txt">;
> file a <"a.txt">;
> file b <"http://mirror.internode.on.net/pub/test/1meg.test">;
>
> c = cat(a, b);
> --------------------------------------------------------
>
> You would need a proper swift.conf. Here's an example of that:
> --------------------------------------------------------
> site.local {
> staging: "wrapper"
> scratch: "/some/scratch/dir"
> # *see email comments for details on the following option
> # wrapperStagingLocalServer:"file://"
> }
> --------------------------------------------------------
>
>
> With a proper scratch dir there, this*should* work for you without any
> additional tweaking.
>
> Check _swiftwrap.wrapperstaging's stagein() and stageout() functions.
> That's where you would add additional protocols.
>
> The wrapperStagingLocalServer sets the default staging location for
> things that do not have an explicit scheme. In the case above, "c.txt"
> and "a.txt" are staged in and out using"file://". If you wanted the
> default to be some gridftp server, you would say something like
> 'wrapperStageingLocalServer: "gsiftp://gridftp.server.org/"'. Of course,
> _swiftwrap.wrapperstaging would need to know how to handle gsiftp URLs,
> which it doesn't at the moment.
>
> Mihael
--
Michael Wilde
Mathematics and Computer Science Computation Institute
Argonne National Laboratory The University of Chicago
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20141108/b116783a/attachment.html>
More information about the Swift-devel
mailing list