[Swift-user] guc-like log messages on transfers

[Mihael Hategan]

If you are looking for transfer progress, then that may not be there.

You can try enabling debug on the jglobus gridftp stuff
(org.globus.ftp/gridftp). But I'm not sure it will contain what you
want. We can talk about implementing something like this.

On Wed, 2011-04-13 at 14:48 -0500, Allan Espinosa wrote:
> "-dbg" gives update on a transfer per buffer(?):
> debug: response from
> gsiftp://top.ucr.edu/data/down/osg_data/engage/scec/SgtFiles/TEST/TEST_fx_644.sgt:
> 111 Range Marker
> 386662400-386924544,387448832-387973120,388235264-622329856,622854144-623378432,623902720-624427008
> 
> debug: response from
> gsiftp://top.ucr.edu/data/down/osg_data/engage/scec/SgtFiles/TEST/TEST_fx_644.sgt:
> 112-Perf Marker
>  Timestamp:  1302723888.6
>  Stripe Index: 0
>  Stripe Bytes Transferred: 877658112
>  Total Stripe Count: 1
> 112 End.
> 
> 
> "-vb" gives an instantaenous measure of bandwidth.  perhaps it is
> based from the debug message above:
> Source: gsiftp://gridftp.pads.ci.uchicago.edu/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations/100/1/
> Dest:   gsiftp://ff-grid3.unl.edu/panfs/panasas/CMS/data/engage/scec/swift_scratch/guc-tests/
>   100_1.txt.variation-s0000-h0005
> 
>       1304838 bytes         0.62 MB/sec avg         0.62 MB/sec inst
> Source: gsiftp://gridftp.pads.ci.uchicago.edu/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations/100/1/
> Dest:   gsiftp://ff-grid3.unl.edu/panfs/panasas/CMS/data/engage/scec/swift_scratch/guc-tests/
>   100_1.txt.variation-s0000-h0002
> 
>       1304838 bytes         0.44 MB/sec avg         0.44 MB/sec inst
> Source: gsiftp://gridftp.pads.ci.uchicago.edu/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations/100/1/
> Dest:   gsiftp://ff-grid3.unl.edu/panfs/panasas/CMS/data/engage/scec/swift_scratch/guc-tests/
>   100_1.txt.variation-s0000-h0000
> 
>       1304838 bytes         0.30 MB/sec avg         0.30 MB/sec inst
> Source: gsiftp://gridftp.pads.ci.uchicago.edu/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations/100/1/
> Dest:   gsiftp://ff-grid3.unl.edu/panfs/panasas/CMS/data/engage/scec/swift_scratch/guc-tests/
>   100_1.txt.variation-s0001-h0000
> 
>       1304838 bytes         0.39 MB/sec avg         0.39 MB/sec inst
> 
> 
> From GlobusOnline, it is somehow equivalent to the 'events' output:
> 
> $ globus help events
> Usage: events [options] <taskid>
> 
> Display start, stop, performance, and error events for a task.
> Type 'man events' for details.
> 
> Options:
>   -h, --help        show this help message and exit
>   -l LIMIT          Limit the number of results.  Default: Unlimited
> 
>   Output Formatting:
>     -f FIELD[,...]  Select field(s) to display. -f 'all' selects all. -f
>                     'help' displays all fields.
>     -O FORMAT       Change output format: 'csv', 'csvh', 'kv'
> 
> Sample that I dumped:
> $globus events 710dab8c-6539-11e0-bfc5-1231390f14a1
> Task ID       : 710dab8c-6539-11e0-bfc5-1231390f14a1
> Parent Task ID: 70e52342-6539-11e0-bfc5-1231390f14a1
> Time          : 2011-04-13 15:07:21.965616Z
> Code          : PROGRESS
> Description   : Performance monitoring event
> Details       : bytes=16777216 mbps=2.237
> 
> Task ID       : 7135589e-6539-11e0-bfc5-1231390f14a1
> Parent Task ID: 70e52342-6539-11e0-bfc5-1231390f14a1
> Time          : 2011-04-13 15:07:22.297131Z
> Code          : PROGRESS
> Description   : Performance monitoring event
> Details       : bytes=22806528 mbps=3.041
> 
> 
> 
> 2011/4/12 Mihael Hategan <hategan at mcs.anl.gov>:
> > On Tue, 2011-04-12 at 19:49 -0500, Allan Espinosa wrote:
> >> Hi,
> >>
> >>
> >> Just to elaborate the my question in a bumped thread, How can I get
> >> "globus-url-copy -vb (or -dbg)"-like messages on the data stagings
> >> made in the workflow?
> >>
> >
> > I don't have one of those handy. Can you be specific about what events
> > you'd like to see?
> >
> >
> >
> 
> 
>