[Swift-user] guc-like log messages on transfers

[Allan Espinosa]

"-dbg" gives update on a transfer per buffer(?):
debug: response from
gsiftp://top.ucr.edu/data/down/osg_data/engage/scec/SgtFiles/TEST/TEST_fx_644.sgt:
111 Range Marker
386662400-386924544,387448832-387973120,388235264-622329856,622854144-623378432,623902720-624427008

debug: response from
gsiftp://top.ucr.edu/data/down/osg_data/engage/scec/SgtFiles/TEST/TEST_fx_644.sgt:
112-Perf Marker
 Timestamp:  1302723888.6
 Stripe Index: 0
 Stripe Bytes Transferred: 877658112
 Total Stripe Count: 1
112 End.


"-vb" gives an instantaenous measure of bandwidth.  perhaps it is
based from the debug message above:
Source: gsiftp://gridftp.pads.ci.uchicago.edu/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations/100/1/
Dest:   gsiftp://ff-grid3.unl.edu/panfs/panasas/CMS/data/engage/scec/swift_scratch/guc-tests/
  100_1.txt.variation-s0000-h0005

      1304838 bytes         0.62 MB/sec avg         0.62 MB/sec inst
Source: gsiftp://gridftp.pads.ci.uchicago.edu/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations/100/1/
Dest:   gsiftp://ff-grid3.unl.edu/panfs/panasas/CMS/data/engage/scec/swift_scratch/guc-tests/
  100_1.txt.variation-s0000-h0002

      1304838 bytes         0.44 MB/sec avg         0.44 MB/sec inst
Source: gsiftp://gridftp.pads.ci.uchicago.edu/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations/100/1/
Dest:   gsiftp://ff-grid3.unl.edu/panfs/panasas/CMS/data/engage/scec/swift_scratch/guc-tests/
  100_1.txt.variation-s0000-h0000

      1304838 bytes         0.30 MB/sec avg         0.30 MB/sec inst
Source: gsiftp://gridftp.pads.ci.uchicago.edu/gpfs/pads/swift/aespinosa/science/cybershake/RuptureVariations/100/1/
Dest:   gsiftp://ff-grid3.unl.edu/panfs/panasas/CMS/data/engage/scec/swift_scratch/guc-tests/
  100_1.txt.variation-s0001-h0000

      1304838 bytes         0.39 MB/sec avg         0.39 MB/sec inst


>From GlobusOnline, it is somehow equivalent to the 'events' output:

$ globus help events
Usage: events [options] <taskid>

Display start, stop, performance, and error events for a task.
Type 'man events' for details.

Options:
  -h, --help        show this help message and exit
  -l LIMIT          Limit the number of results.  Default: Unlimited

  Output Formatting:
    -f FIELD[,...]  Select field(s) to display. -f 'all' selects all. -f
                    'help' displays all fields.
    -O FORMAT       Change output format: 'csv', 'csvh', 'kv'

Sample that I dumped:
$globus events 710dab8c-6539-11e0-bfc5-1231390f14a1
Task ID       : 710dab8c-6539-11e0-bfc5-1231390f14a1
Parent Task ID: 70e52342-6539-11e0-bfc5-1231390f14a1
Time          : 2011-04-13 15:07:21.965616Z
Code          : PROGRESS
Description   : Performance monitoring event
Details       : bytes=16777216 mbps=2.237

Task ID       : 7135589e-6539-11e0-bfc5-1231390f14a1
Parent Task ID: 70e52342-6539-11e0-bfc5-1231390f14a1
Time          : 2011-04-13 15:07:22.297131Z
Code          : PROGRESS
Description   : Performance monitoring event
Details       : bytes=22806528 mbps=3.041



2011/4/12 Mihael Hategan <hategan at mcs.anl.gov>:
> On Tue, 2011-04-12 at 19:49 -0500, Allan Espinosa wrote:
>> Hi,
>>
>>
>> Just to elaborate the my question in a bumped thread, How can I get
>> "globus-url-copy -vb (or -dbg)"-like messages on the data stagings
>> made in the workflow?
>>
>
> I don't have one of those handy. Can you be specific about what events
> you'd like to see?
>
>
>



-- 
Allan M. Espinosa <http://amespinosa.wordpress.com>
PhD student, Computer Science
University of Chicago <http://people.cs.uchicago.edu/~aespinosa>