logging file transfer status (was Re: [Swift-user] throttle transfers and vdl:stagein graphs)

[Allan Espinosa]

Hi Mihael,

Bumping the thread.

What's the name of the specific class? I tried
log4j.logger.org.globus.cog.abstraction.tools.transfer.FileTransfer=DEBUG

in my log4j.properties file and I didn't see any transfer log messages
that occurred during the stagein/stageout period of my workflows.

Where is the scheduling of transfer made ?  VDSAdaptiveScheduler
doesn't seem to have entries on those transfer policies set in
throttle.transfers and throttle.file.operations.

Thanks,
-Allan

2010/11/18 Mihael Hategan <hategan at mcs.anl.gov>:
> On Thu, 2010-11-18 at 18:54 -0600, Allan Espinosa wrote:
>> Ah.  I see that the the log entries that is nearest the actual
>> task:transfer() task is in vdl:dostageinfile (no parallelFor loop
>> here).  But i still see the transfers being more than the throttle in
>> swift.properties.
>>
>> One of the classes invoked by task:transfer() is
>> /org/globus/cog/karajan/workflow/nodes/grid/GridTransfer.class ?
>>
>> I'll try adding this to my log4j.properties and see what will happen.
>
> The transfer task status is the best choice. That's in the abstractions
> module.
>
> Mihael
>
>
>
>



-- 
Allan M. Espinosa <http://amespinosa.wordpress.com>
PhD student, Computer Science
University of Chicago <http://people.cs.uchicago.edu/~aespinosa>