[Swift-user] Block task failed: Connection to worker lost

[Ozik, Jonathan]

Mihael,

Thanks. Is there a document that explains the details of each of the staging options?

As reference, when I tried to use the wrapper or swift staging or omitted the staging specifier I got errors. The direct, local, and shared-fs staging didn’t throw errors. For the swift staging I got the error:

Could not initialize shared directory on midway_debug
exception @ swift-int.k, line: 303
Caused by: Could not find a suitable service/provider for host midway_debug
Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException: Could not find a suitable service/provider for host midway_debug
k:assign @ swift.k, line: 174
Caused by: Could not initialize shared directory on midway_debug
exception @ swift-int.k, line: 303
Caused by: Could not find a suitable service/provider for host midway_debug
Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException: Could not find a suitable service/provider for host midway_debug
Final status: Fri, 05 Dec 2014 00:38:21+0000  Failed:1
The following errors have occurred:
1. Could not initialize shared directory on midway_debug
exception @ swift-int.k, line: 303
Caused by: Could not find a suitable service/provider for host midway_debug
Caused by: org.globus.cog.karajan.scheduler.NoSuchResourceException: Could not find a suitable service/provider for host midway_debug

Execution failed:
Execution completed with errors
throw @ swift.k, line: 116

Jonathan

On Dec 5, 2014, at 12:24 AM, Mihael Hategan <hategan at mcs.anl.gov<mailto:hategan at mcs.anl.gov>> wrote:

On Fri, 2014-12-05 at 04:11 +0000, Ozik, Jonathan wrote:
I’ve looked a bit closer into the differences between the different staging options, and chose the “local” option for now, even though this is probably not the most efficient in terms of creating unnecessarily large amounts of copies of the input files needed for each app invocation.
Speaking of which, in the User Guide
(http://swift-lang.org/guides/trunk/userguide/userguide.html), there
is a section that states “The wrapper script creates the application
workspace directory; places the input files for that job into the
application workspace directory using either cp or ln -s (depending on
a configuration option)…,” but I couldn’t find any more information on
enabling the symlinking of input files. Is this associated with a
specific type of staging or configuration?

I think that only applies to "swift" staging. Symlinking is the default.
If you specify a scratch directory (site.x.scratch: "/blabla"), then
copying is done.

Mihael


_______________________________________________
Swift-user mailing list
Swift-user at ci.uchicago.edu<mailto:Swift-user at ci.uchicago.edu>
https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20141205/b951b8fc/attachment.html>