[Swift-devel] Globus contact for Swift usage logging support?

[Michael Wilde]

was: Re: [Swift-devel] Swift usage summary

Right David - once you move the logging hooks from the front end swift shell script to the Java code, you should use the Globus logging API.

That will involve using an existing data collector/database server (preferably) or standing up a new one (which would be good to avoid).

Stu, who is the best contact on the Globus team for David to work with on this (Swift usage logging)

- Mike

----- "David Kelly" <dk0966 at cs.ship.edu> wrote:

> That's a good question. I was thinking of starting with Java
> replacements for the current implementation, but perhaps integrating
> Globus usage reporting should be the goal? Would it be overkill for
> the type of data that we need?
> 
> 
> 
> 
> David
> 
> 
> On Fri, Sep 24, 2010 at 7:50 PM, Ian Foster < foster at anl.gov > wrote:
> 
> 
> 
> 
> You're using Globus usage reporting, I assume? There is lots of code
> people have written to generate various reports
> 
> 
> 
> 
> On Sep 24, 2010, at 6:44 PM, David Kelly < dk0966 at cs.ship.edu > wrote:
> 
> 
> 
> 
> 
> 
> 
> 
> 
> IP addresses, return codes and anonymized user id's are among the data
> currently being collected. So far there have been 51 unique users from
> 35 different IP addresses. The only way to get this data right now is
> by manually connecting to the database. I will work on adding more of
> this information to the weekly email script.
> 
> 
> Right now all of the usage statistics are gathered outside of swift in
> a shell script, so it is somewhat limited. I am working on a way to
> get this integrated directly into swift, which should allow for more
> detail.
> 
> David
> 
> 
> On Fri, Sep 24, 2010 at 6:56 PM, Ian Foster < foster at anl.gov > wrote:
> 
> 
> 
> David:
> 
> 
> This looks great.
> 
> 
> It would be good to have some information about the location where the
> script was invoked from (e.g., IP address) so we can analyze number of
> unique users.
> 
> 
> Information about number of nodes, tasks, data transfers, etc., would
> be neat too. Failure information can be interesting too.
> 
> 
> Ian.
> 
> 
> 
> 
> 
> 
> 
> On Sep 24, 2010, at 2:49 PM, David Kelly wrote:
> 
> 
> 
> It is the total number of times the Swift shell script was invoked by
> those who have a recent version of Swift from trunk and have not
> disabled usage tracking.
> 
> 
> Right now it does not track CPU hours. The closest thing would be the
> real start and stop time for each invocation. If you find that useful,
> I could add a graph which shows the total amount of real time it uses
> per day.
> 
> 
> David
> 
> 
> On Fri, Sep 24, 2010 at 3:07 PM, Ioan Raicu < iraicu at cs.uchicago.edu >
> wrote:
> 
> 
> 
> What are the numbers? Is it the times Swift was invoked? Or the number
> of jobs Swift generated? Can you also plot the number of CPU hours
> used?
> 
> Ioan
> --
> =================================================================
> Ioan Raicu, Ph.D.
> Assistant Professor
> =================================================================
> Computer Science Department
> Illinois Institute of Technology
> 10 W. 31st Street
> Stuart Building, Room 237D
> Chicago, IL 60616
> =================================================================
> Cel:    1-847-722-0876
> Office: 1-312-567-5704
> Email: iraicu at cs.iit.edu Web: http://www.cs.iit.edu/~iraicu/
> =================================================================
> =================================================================
> On 9/24/2010 2:01 PM, dk0966 at cs.ship.edu wrote:
> 
> Swift usage summary attached.
> _______________________________________________
> Swift-devel mailing list Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
> 
> 
> 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory