<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: times new roman,new york,times,serif; font-size: 12pt; color: #000000'>Thanks for the info Mihael. Right now, I am seeing really good performance using /tmp and provider staging, so I'm happy to stick with that. It's been pretty consistent as I scale up in my tests. I'll send you all the plots/benchmarks when I am finished.<div><div><br><hr id="zwchr"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>From: </b>"Mihael Hategan" <hategan@mcs.anl.gov><br><b>To: </b>"David Kelly" <davidk@ci.uchicago.edu><br><b>Cc: </b>"swift-devel" <swift-devel@ci.uchicago.edu><br><b>Sent: </b>Thursday, February 7, 2013 9:43:02 PM<br><b>Subject: </b>Re: [Swift-devel] Work directory on a non-shared filesystem<br><br>_swiftwrap needs to make it to the compute nodes somehow.<br><br>The scenarios you list below make sense:<br>1. work dir on shared fs, scratch on /tmp: _swiftwrap is accessed<br>through the shared fs so it works.<br>2. provider staging with workdir and scratch on /tmp: _swiftwrap is<br>staged in by coasters, so that works too.<br>3. no provider staging, workdir and scratch on /tmp: _swiftwrap has no<br>way of making it to the compute node, so 127 (command/function not found<br>- see COMMAND EXECUTION section of man bash).<br><br>That's standard stuff. A hack would be to install _swiftwrap along with<br>the app and convince swift to run that instead of its own swiftwrap.<br>That might require hacking vdl-int.k, around line 502. Let me know if<br>you want to go that route, and we can chat on how to get it done.<br><br>Mihael<br><br>On Thu, 2013-02-07 at 20:10 -0600, David Kelly wrote:<br>> Is it possible to have a work directory on a non-shared filesystem<br>> (/tmp) without using provider staging? I'm not staging any files in or<br>> out with swift, just passing strings. When I try this, I get an 127<br>> app failure for some reason (the app is /bin/bash). <br>> <br>> <br>> I've been able to set the work directory to a shared filesystem, and<br>> set the scratch tag to /tmp. That combination seems to work fine. But<br>> ideally I'd like to avoid the shared filesystem as much as possible. <br>> <br>> <br>> It also seems to work fine with /tmp as the work directory and with provider staging enabled. <br>> <br>> <br>> Just curious if this configuration is possible somehow. Thanks! <br>> <br>> <br>> <br>> <br>> <br>> <br>> <br>> <br>> <br>> <br>> David Michael Kelly <br>> Systems Programmer <br>> University of Chicago Computation Institute <br>> 5735 S. Ellis Ave. Chicago, IL 60637 <br>> Is it possible to have a work directory on a non-shared filesystem<br>> (/tmp) without using provider staging? I'm not staging any files in or<br>> out with swift, just passing strings. When I try this, I get an 127<br>> app failure for some reason (the app is /bin/bash). <br>> <br>> <br>> I've been able to set the work directory to a shared filesystem, and<br>> set the scratch tag to /tmp. That combination seems to work fine. But<br>> ideally I'd like to avoid the shared filesystem as much as possible.<br>> <br>> <br>> It also seems to work fine with /tmp as the work directory and with<br>> provider staging enabled.<br>> <br>> <br>> Just curious if this configuration is possible somehow. Thanks!<br>> <br>> <br>> <br>> <br>> <br>> David Michael Kelly<br>> Systems Programmer<br>> University of Chicago Computation Institute<br>> 5735 S. Ellis Ave. Chicago, IL 60637<br>> <br>> <br>> _______________________________________________<br>> Swift-devel mailing list<br>> Swift-devel@ci.uchicago.edu<br>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel<br><br><br></blockquote><br></div></div></div></body></html>