[Swift-user] Swift log parser

[David Kelly]

Hey Ravi, Lorenzo,

I modified the script so it should work now with logs generated by 0.94.
You can run the attached script as:

$ ./swiftlog /path/to/<logfile>

A version of this will be included with 0.95 when it's released, I'll send
some more details about that soon.

 Hope this is helpful - let me know if you run into any problems.


On Wed, Dec 18, 2013 at 5:40 PM, Ravi K Madduri <madduri at mcs.anl.gov> wrote:

> David
> This is the swift version on cox globus genomics instance:
>
> madduri at cox2:/nfs/software/galaxy/tools$ sudo
> /mnt/galaxyTools/tools/swift/swift-trunk/bin/swift -version
> Swift trunk swift-r6209 (swift modified locally) cog-r3574 (cog modified
> locally)
>
> I am just trying to get some aggregate details on the number of jobs run
> and how long they took, number of nodes spawned etc.
>
>
> On Dec 18, 2013, at 4:58 PM, David Kelly <davidk at ci.uchicago.edu> wrote:
>
> Hey Ravi,
>
> Which version of Swift are you using? I just wrote something like this
> yesterday that parses a Swift log and prints information about jobs in a
> clear format (start time, stop time, files staged in and out, etc). But it
> was written for 0.95 log files.. not sure it will work with 0.94 or older
> logs.
>
> There are other scripts available to get generate of # of active tasks and
> # of tasks completed if that would be helpful?
>
>
> On Wed, Dec 18, 2013 at 4:26 PM, Ravi K Madduri <madduri at mcs.anl.gov>wrote:
>
>> Hi
>> I wonder if you guys have any scripts that help me parse swift logs and
>> provide me with information about how many jobs launched, how long they ran
>> etc.
>>
>> Thanks
>>   --
>> Ravi K Madduri
>> MCS, Argonne National Laboratory
>> Computation Institute, University of Chicago
>>
>>
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>>
>
>
> --
> Ravi K Madduri
> MCS, Argonne National Laboratory
> Computation Institute, University of Chicago
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20131219/84c1913b/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: swiftlog
Type: application/octet-stream
Size: 2979 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20131219/84c1913b/attachment.obj>