<div dir="ltr">My suspicion is that since you're using ssh-cl, the relevant lines related to staging in and staging out are getting buried in ~/.globus/coasters/coasters.log on the SSH site. In the test I did was running with local:condor staging in and out directly to OSG nodes.</div>
<div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Jan 22, 2014 at 3:39 PM, Ketan Maheshwari <span dir="ltr"><<a href="mailto:ketan@mcs.anl.gov" target="_blank">ketan@mcs.anl.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">In the log I have from Swift trunk swift-r7228 cog-r3817, I do not see 'sending data' messages.</div>
<div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Jan 22, 2014 at 3:09 PM, David Kelly <span dir="ltr"><<a href="mailto:davidkelly@uchicago.edu" target="_blank">davidkelly@uchicago.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div dir="ltr">I was just looking more closely through a log I just created that used provider staging. I think there is some info about timings there that look like this:<div>
<br></div>2014-01-22 14:11:50,249-0600 INFO PutFileHandler Handler(tag: 7644, PUT) source: ./hostname-run000/jobs/a/hostname-azak6dll/hostfile.out<br>
2014-01-22 14:11:50,249-0600 INFO PutFileHandler Handler(tag: 7644, PUT) destination: proxy://u2086f356-143bb93f2a2--7fff-u2086f356-143bb93f2a2--8000S//home/davidk/test/./hostfile.out<br>2014-01-22 14:11:50,251-0600 INFO PutFileCommand Sending Command(tag: 10, PUT) (t) on cpipe://1<br>
2014-01-22 14:11:50,251-0600 INFO PutFileCommand Command(tag: 10, PUT) (t) sending data<br>2014-01-22 14:11:50,251-0600 INFO PutFileHandler Handler(tag: 7644, PUT) -> 10<br>2014-01-22 14:11:50,251-0600 INFO PutFileHandler Handler(tag: 10, PUT) source: ./hostname-run000/jobs/a/hostname-azak6dll/hostfile.out<br>
2014-01-22 14:11:50,251-0600 INFO PutFileHandler Handler(tag: 10, PUT) destination: file://localhost//home/davidk/test/hostfile.out<br>2014-01-22 14:11:50,252-0600 INFO PutFileHandler Handler(tag: 10, PUT) Transfer done<br>
2014-01-22 14:11:50,252-0600 INFO RequestHandler Handler(tag: 10, PUT) unregistering (send)<br>2014-01-22 14:11:50,252-0600 INFO PutFileHandler Handler(tag: 7644, PUT) Transfer done<br>2014-01-22 14:11:50,253-0600 INFO RequestHandler Handler(tag: 7644, PUT) unregistering (send)<div>
<br></div><div>Maybe you could keep track of the tag number and record the difference from "sending data" to "Transfer done" to get an estimate. I'm not sure how to correlate the file transfers to a jobid though.</div>
</div></div><div class="gmail_extra"><br><br><div class="gmail_quote"><div>On Wed, Jan 22, 2014 at 2:54 PM, Ketan Maheshwari <span dir="ltr"><<a href="mailto:ketan@mcs.anl.gov" target="_blank">ketan@mcs.anl.gov</a>></span> wrote:<br>
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Hi,<div><br></div><div>Is it possible to find staging in and out times per job with Swift logs with provider staging? </div>
<div><br></div><div>Speaking with David about this, he mentioned it is not currently possible with provider staging but there may be some options in log4j that could achieve it.</div>
<div><br></div><div>Does anyone know about any such options or any indirect methods?</div><div><br></div><div>Thanks,</div><div>Ketan</div></div>
<br></div></div><div>_______________________________________________<br>
Swift-devel mailing list<br>
<a href="mailto:Swift-devel@ci.uchicago.edu" target="_blank">Swift-devel@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
<br></div></blockquote></div><br></div>
<br>_______________________________________________<br>
Swift-devel mailing list<br>
<a href="mailto:Swift-devel@ci.uchicago.edu" target="_blank">Swift-devel@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
<br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>