[Swift-devel] Swift gsiftp staging issues on OSG

Ketan Maheshwari ketancmaheshwari at gmail.com
Sun Oct 16 09:54:40 CDT 2011


Hello,

While running an Extenci workflow on OSG with persistent coasters (multiple
coasters services, 1 per OSG site) and gsiftp staging, I am facing some
gridftp related issues. Following are some details of the run:

A set of 15 OSG sites were selected after testing them for being responsive
('greensites'). I performed a separate guc test on these sites which seemed
to have succeeded for each site (200MB roundtrip transfer in 7 mins for all
sites).

However, while running my workflow from Swift, many of these transfers fail
showing a variety of errors, most pertaining to the data transfers.

I noticed, that these transfers fail irrespective of data sizes (250K -
150M) and also seems to fail intermittently for different sites.

The log for this run is here:
http://www.mcs.anl.gov/~ketan/postproc-gridftp-20111013-2324-5qzebq16.log

I am providing a 7G of Heap space at Swift commandline and the host has 50G
of total memory.

Any ideas?


Regards,
-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20111016/0aebd056/attachment.html>


More information about the Swift-devel mailing list