<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Thanks, Ben<br>
<br>
zhao<br>
<br>
Ben Clifford wrote:
<blockquote
cite="mid:Pine.LNX.4.64.0803310723010.9854@dildano.hawaga.org.uk"
type="cite">
<pre wrap="">On Mon, 31 Mar 2008, Ben Clifford wrote:
</pre>
<blockquote type="cite">
<pre wrap="">This temporary directory handling is pretty ugly - it should be a couple
lines change to wrapper.sh to get similar functionality using the existing
swift temporary direcotry handling - change the path to /tmp and use cp
instead of ln -s. That way you can take advantage of Swift's existing
unique job IDs and error handling too.
</pre>
</blockquote>
<pre wrap=""><!---->
Attached are three patches that will apply against svn r1775:
The first puts temporary directories in /tmp rather than on shared fs.
<a class="moz-txt-link-freetext" href="http://www.ci.uchicago.edu/~benc/tmp/wrapper-tmp-dirs-on-tmp">http://www.ci.uchicago.edu/~benc/tmp/wrapper-tmp-dirs-on-tmp</a>
The second copies the application file to the worker in each job execution
(though doesn't do any worker-node caching of such between jobs)
<a class="moz-txt-link-freetext" href="http://www.ci.uchicago.edu/~benc/tmp/wrapper-tmp-dirs-mv-executable">http://www.ci.uchicago.edu/~benc/tmp/wrapper-tmp-dirs-mv-executable</a>
The third creates the worker node log on /tmp and copies it at the end.
<a class="moz-txt-link-freetext" href="http://www.ci.uchicago.edu/~benc/tmp/wrapper-tmp-log-locally">http://www.ci.uchicago.edu/~benc/tmp/wrapper-tmp-log-locally</a>
The three modify all wrapper.sh and should be applied in the above order.
With the first two patches, the timestamps in the usual info logs will
provide information about how long the copies take, in the same way that
they usually indicate times for other execution stages.
</pre>
</blockquote>
</body>
</html>