[Swift-devel] Swift usage statistics

[David Kelly]

Hello all,

I have been working on putting together a process for recording Swift usage
statistics. The new swift shell script (attached) will gather information
such as the swift return code, length of swift script, hashed user id and
script id. It will then use a utility called netcat to send the information
via UDP packets to a remote listener (swift_listener.pl attached). The
listener is currently running on bridled.ci.uchicago.edu. The listener is a
perl script which will record that information, along with start time, stop
time, hostname, and ip address. The listener stores this data in a MySQL
database on db.ci.uchicago.edu called swiftusage. Cron will execute a script
called check_listener.sh every 15 minutes to ensure the listener is still
running. The data can then be used to detect patterns and usage trends over
time.

Usage statistics can be disabled by setting ALLOW_USAGE_STATS to 0. What
data is recorded, and how it is recorded, closely matches the Globus policy
for usage statistics (
http://www.globus.org/toolkit/docs/4.2/4.2.1/admin/install/#gtadmin-config-usage-stats<http://www.globus.org/toolkit/docs/4.2/4.2.1/admin/install/#gtadmin-config-usage-stats>).

I would like to add this to svn in the next few days. Please let me know if
you have any concerns about how this works or have any ideas for how it
could be improved. Thanks!

Regards,
David
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20100806/95041ae3/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: swift_listener.pl
Type: application/x-perl
Size: 2587 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20100806/95041ae3/attachment.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: swift
Type: application/octet-stream
Size: 3860 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20100806/95041ae3/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: check_listener.sh
Type: application/x-sh
Size: 158 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20100806/95041ae3/attachment.sh>