<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Mihael,
<div class=""><br class="">
</div>
<div class="">Thanks. Is there a document that explains the details of each of the staging options?</div>
<div class=""><br class="">
</div>
<div class="">As reference, when I tried to use the <b class="">wrapper</b> or <b class="">
swift</b> staging or omitted the staging specifier I got errors. The <b class="">
direct</b>, <b class="">local</b>, and <b class="">shared-fs</b> staging didn’t throw errors. For the swift staging I got the error:</div>
<div class="">
<div style="margin: 0px; min-height: 14px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">Could not initialize shared directory on midway_debug</div>
<div style="margin: 0px;" class=""><span class="Apple-tab-span" style="white-space:pre"></span>exception @ swift-int.k, line: 303</div>
<div style="margin: 0px;" class="">Caused by: Could not find a suitable service/provider for host midway_debug</div>
<div style="margin: 0px;" class="">Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException: Could not find a suitable service/provider for host midway_debug</div>
<div style="margin: 0px;" class=""><span class="Apple-tab-span" style="white-space:pre"></span>k:assign @ swift.k, line: 174</div>
<div style="margin: 0px;" class="">Caused by: Could not initialize shared directory on midway_debug</div>
<div style="margin: 0px;" class=""><span class="Apple-tab-span" style="white-space:pre"></span>exception @ swift-int.k, line: 303</div>
<div style="margin: 0px;" class="">Caused by: Could not find a suitable service/provider for host midway_debug</div>
<div style="margin: 0px;" class="">Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException: Could not find a suitable service/provider for host midway_debug</div>
<div style="margin: 0px;" class="">Final status: Fri, 05 Dec 2014 00:38:21+0000 Failed:1</div>
<div style="margin: 0px;" class="">The following errors have occurred:</div>
<div style="margin: 0px;" class="">1. Could not initialize shared directory on midway_debug</div>
<div style="margin: 0px;" class=""><span class="Apple-tab-span" style="white-space:pre"></span>exception @ swift-int.k, line: 303</div>
<div style="margin: 0px;" class="">Caused by: Could not find a suitable service/provider for host midway_debug</div>
<div style="margin: 0px;" class="">Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException: Could not find a suitable service/provider for host midway_debug</div>
<div style="margin: 0px; min-height: 14px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">Execution failed:</div>
<div style="margin: 0px;" class="">Execution completed with errors</div>
<div style="margin: 0px;" class=""><span class="Apple-tab-span" style="white-space:pre"></span>throw @ swift.k, line: 116</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">Jonathan</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div>
<blockquote type="cite" class="">
<div class="">On Dec 5, 2014, at 12:24 AM, Mihael Hategan <<a href="mailto:hategan@mcs.anl.gov" class="">hategan@mcs.anl.gov</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">On Fri, 2014-12-05 at 04:11 +0000, Ozik, Jonathan wrote:<br class="">
<blockquote type="cite" class="">I’ve looked a bit closer into the differences between the different staging options, and chose the “local” option for now, even though this is probably not the most efficient in terms of creating unnecessarily large amounts
of copies of the input files needed for each app invocation.<br class="">
Speaking of which, in the User Guide<br class="">
(<a href="http://swift-lang.org/guides/trunk/userguide/userguide.html" class="">http://swift-lang.org/guides/trunk/userguide/userguide.html</a>), there<br class="">
is a section that states “The wrapper script creates the application<br class="">
workspace directory; places the input files for that job into the<br class="">
application workspace directory using either cp or ln -s (depending on<br class="">
a configuration option)…,” but I couldn’t find any more information on<br class="">
enabling the symlinking of input files. Is this associated with a<br class="">
specific type of staging or configuration?<br class="">
</blockquote>
<br class="">
I think that only applies to "swift" staging. Symlinking is the default.<br class="">
If you specify a scratch directory (site.x.scratch: "/blabla"), then<br class="">
copying is done.<br class="">
<br class="">
Mihael<br class="">
<br class="">
<br class="">
_______________________________________________<br class="">
Swift-user mailing list<br class="">
<a href="mailto:Swift-user@ci.uchicago.edu" class="">Swift-user@ci.uchicago.edu</a><br class="">
https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>