[Swift-devel] switchable copious provenance logging

[Michael Wilde]

My perhaps uninformed and random observation on logging:

the debug log seems very noisy, and it seems whats needed for 
provenance (ie, the major events, not all the minor ones) could be made 
much more compact.

I think ultimately we want 2 control bits on logging:

- debug level
- provenance (on/off) but maybe a level as well.

Its possible these should go to separate channels, or be separable by a 
clear descriptor on the log line (for space management)

It seems that while Swift is stll a young system, having debug on all 
the time is useful, so that error info gets captured without having to 
do re-runs. It seems that for most work we can afford the time overhead 
of these logs; the space overhead may become burdensome.

Is the provenance logging making the size of the log unmanageable?

On 4/21/09 3:06 AM, Ben Clifford wrote:
> As I work on provenance, the amount of log output for that becomes larger.
> 
> Two things are probably interesting wrt that:
> 
>   i) make logging of provenance stuff switchable to on/off
>  ii) move the provenance related log information to a separate file
> 
> Comments.
>