<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
<br>
<br>
Ben Clifford wrote:
<blockquote
cite="mid:Pine.LNX.4.64.0705152317520.22628@dildano.hawaga.org.uk"
type="cite">
<pre wrap="">On Tue, 15 May 2007, Ioan Raicu wrote:
</pre>
<blockquote type="cite">
<pre wrap="">If we can get the data caching working in Falkon, we might be able to
run Swift over Falkon without a shared file system. This is still work
in progress, but we might be closer to achieving this that not. BTW,
the data caching would mean that Swift does not stage in any data
anymore, but wold essentially stand up a GridFTP server from where
Falkon workers would get the needed data just when they need it. We are
still ironing out all this stuff, but it could potentially do away with
the shared file sytem assumption.
</pre>
</blockquote>
<pre wrap=""><!---->
In the longer term, Swift possibly won't have its input data on the
submitting system - for example, if data is mapped from remote gridftp
servers, then it should be transferred directly from those ftp servers to
the execute side (perhaps to a shared filesystem, perhaps direct to a
worker node), and output data should be transferred back fairly directly,
rather than going via the submit system.
</pre>
</blockquote>
Right, from Falon's point of view, this would not be any different than
having the GridFTP server at the submit host. <br>
<blockquote
cite="mid:Pine.LNX.4.64.0705152317520.22628@dildano.hawaga.org.uk"
type="cite">
<pre wrap="">
If Falkon is doing its own 'interesting' data movement stuff, then it
would probably be a good idea for it to mesh in with what Swift (eg. swift
provides a list of stage-these-in and stage-these-out URLs or something
like that and has various ways of performing that, such as submitting a
transfer job, or passing that information onto falkon)
</pre>
</blockquote>
The idea is to do just this! Get Swift to pass in its normal URLs of
input and output data, and then have Falkon do its own data management
using those URLs! The idea is to not change anything fundamental in
Swift, but ensure that enough information is passed to Falkon so it can
operate properly, and do its own data management! <br>
<br>
Ioan<br>
<br>
<pre class="moz-signature" cols="72">--
============================================
Ioan Raicu
Ph.D. Student
============================================
Distributed Systems Laboratory
Computer Science Department
University of Chicago
1100 E. 58th Street, Ryerson Hall
Chicago, IL 60637
============================================
Email: <a class="moz-txt-link-abbreviated" href="mailto:iraicu@cs.uchicago.edu">iraicu@cs.uchicago.edu</a>
Web: <a class="moz-txt-link-freetext" href="http://www.cs.uchicago.edu/~iraicu">http://www.cs.uchicago.edu/~iraicu</a>
<a class="moz-txt-link-freetext" href="http://dsl.cs.uchicago.edu/">http://dsl.cs.uchicago.edu/</a>
============================================
============================================
</pre>
</body>
</html>