<div class="gmail_quote">On Tue, Nov 1, 2011 at 8:46 AM, Michael Wilde <span dir="ltr"><<a href="mailto:wilde@mcs.anl.gov">wilde@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
We have been discussing the feasibility of adding a data management option to Swift that performs data transfer via globus-url-copy from the worker node, likely issued from within a CDM function.<br>
<br>
This is mainly intended for OSG sites where no other straightforward transfer option exists (e.g. on sites that have storage servers like SRM-DCache and no mounted access to the primary GridFTP server's filesystem).<br>
<br>
I'm wondering how worker-side GridFTP will work with respect to data management functions like creation of the work directory, job directory, and transfer of utility files like swiftwrap etc.<br>
<br>
Any ideas on how best to do this? Its almost like we should first try this in coasters using provider staging, where we start by replacing the data transfer with a worker-side invocation of guc.<br>
<br>
Mihael, is this something that you could do for us? If you could create a test version of this using a simple "cp" in a <a href="http://worker.pl" target="_blank">worker.pl</a> callout script for doing data transfer, we could then do the testing with actual guc.<br>
</blockquote><div><br></div><div>I can start working on this. Will keep posted as and when I have questions or need help debug.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<br>
- Mike<br>
_______________________________________________<br>
Swift-devel mailing list<br>
<a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br>Ketan<br><br><br>