[Swift-devel] Example of wrapper staging?

Yadu Nand Babuji yadunand at uchicago.edu
Sat Nov 8 16:45:45 CST 2014


Hi Mike,

The schema is here swift-k/resources/swift.conf.schema, and I do see 
this wrapperStagingLocalServer
defined in the schema.

Here's a github link to the schema : 
https://github.com/swift-lang/swift-k/blob/master/resources/swift.conf.schema

-Yadu



On 11/08/2014 04:37 PM, Michael Wilde wrote:
> I get this error:
>
> org.griphyn.vdl.util.SwiftConfigException: swift.conf:4 unexpected 
> property 'site.local.wrapperStagingLocalServer'
>     at 
> org.griphyn.vdl.util.SwiftConfigSchema.validate(SwiftConfigSchema.java:214)
>
> Ive tried spelling this property both as in your sample .conf and as 
> in your text:
>
> wrapperStagingLocalServer and wrapperStageingLocalServer
>
> Neither is accepted.  Did a schema change not get committed?
>
> For general info: where is the json schema file that a user can check 
> to find all valid conf parameters?
>
> Thanks,
>
> - Mike
>
>
>
> On 11/8/14 4:13 PM, Mihael Hategan wrote:
>> type file;
>>
>> app (file c) cat(file a, file b) {
>> 	cat filename(a) filename(b) stdout=filename(c);
>> }
>>
>> file c <"c.txt">;
>> file a <"a.txt">;
>> file b <"http://mirror.internode.on.net/pub/test/1meg.test">;
>>
>> c = cat(a, b);
>> --------------------------------------------------------
>>
>> You would need a proper swift.conf. Here's an example of that:
>> --------------------------------------------------------
>> site.local {
>> 	staging: "wrapper"
>> 	scratch: "/some/scratch/dir"
>>          # *see email comments for details on the following option
>> 	# wrapperStagingLocalServer:"file://"
>> }
>> --------------------------------------------------------
>>
>>
>> With a proper scratch dir there, this*should*  work for you without any
>> additional tweaking.
>>
>> Check _swiftwrap.wrapperstaging's stagein() and stageout() functions.
>> That's where you would add additional protocols.
>>
>> The wrapperStagingLocalServer sets the default staging location for
>> things that do not have an explicit scheme. In the case above, "c.txt"
>> and "a.txt" are staged in and out using"file://". If you wanted the
>> default to be some gridftp server, you would say something like
>> 'wrapperStageingLocalServer: "gsiftp://gridftp.server.org/"'. Of course,
>> _swiftwrap.wrapperstaging would need to know how to handle gsiftp URLs,
>> which it doesn't at the moment.
>>
>> Mihael
>
> -- 
> Michael Wilde
> Mathematics and Computer Science          Computation Institute
> Argonne National Laboratory               The University of Chicago
>
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20141108/797c23cd/attachment.html>


More information about the Swift-devel mailing list