pcp
[Top] [All Lists]

Re: Trends again (fwd)

To: Mark Goodwin <markgw@xxxxxxx>
Subject: Re: Trends again (fwd)
From: Ken McDonell <kenmcd@xxxxxxxxxxxxxxxxx>
Date: Thu, 7 Dec 2000 20:08:08 +1100
Cc: lemming@xxxxxxxxxxxxxxxxxxx, pcp@xxxxxxxxxxx
In-reply-to: <Pine.LNX.4.21.0012071833520.21996-100000@xxxxxxxxxxxxxxxxxxxxxxxxx>
Reply-to: kenmcd@xxxxxxx
Sender: owner-pcp@xxxxxxxxxxx
[I'm moving this to a wider forum as others may have input or be
interested in collaboration]

I have no problem with giving Michal the pmderive source under the
terms you propose, but I would warn:

1. Data reduction is not the same as trend analysis ... operationally
   and statistically they are quite different, so I'm not sure now
   useful pmderive source will be, and

2. Ania and I never resolved some of the hard parts of the semantics of
   reduced PCP archive data so I would question how "almost finished"
   it is ... last I recall she had hit the wall on some curly issues
   and did not have a proposal for moving forwards (remember pmderive
   came from a boatload of functionality culled from pmlogextract when I
   was unhappy about the semantic soundness of the output archive).

We need trend analysis tools, and I would encourage collaboration in
this area.  If someone believes pmderive would help, by all means make
it available.

On Thu, 7 Dec 2000, Mark Goodwin wrote:

> Ken,
> 
> do you know if Annia's pmderive tool is up to scratch? If so,
> can we give it to Michal on the understanding he would work
> on it and release the result as open source?
> 
> 
> ---------- Forwarded message ----------
> Date: Thu, 7 Dec 2000 18:32:35 +1100 (EST)
> From: Mark Goodwin <markgw@xxxxxxx>
> To: Michal Kara <lemming@xxxxxxxxxxxxxxxxxxx>
> Subject: Re: Trends again
> 
> On Wed, 6 Dec 2000, Michal Kara wrote:
> 
> >    Hello!
> > 
> >    I have written you about two weeks ago about the architectural decision I
> > need to make: How to implement trend-generating?
> > 
> >    I can either modify pmlogextract/pmlogmerge or write yet another utility
> > which will process relevant metrics to a PCP metrics archive. Or I can write
> > a script which will work with pmlogextract and process the values to files
> > readable by gnuplot.
> > 
> >    I would really like to know your opinion on this. Thanks.
> > 
> 
> sorry for not getting back to you: I did actually take some action on
> this request. I asked our group here at SGI if anyone had any ideas or
> tools that might fit with your requirements .. and it turned out
> we have an "almost finished" tool called "pmderive". This is a bit
> like pmlogextract/pmlogmerge, and was developed by the same author,
> but never quite finished and the author has since left SGI.
> 
> The idea behind pmderive is log reduction. A conf file is used
> to define arbitrary expressions whose operands are PCP metrics
> in a log. Pmderive reads the conf file, and walks the archive,
> writing a new archive with metrics corresponding to the expressions,
> i.e. data reduction.
> 
> Would this be a reasonable starting point for what you need to do?
> Let me know : I'll see if I can find the src for pmderive, and quite
> likely we'll be able to let you have it (I need to speak to Ken about
> that though).
> 
> thanks
> -- Mark
> 
> ps: is the apache PMDA in pcp-2.1.11-8 building OK now?
> 
> 


<Prev in Thread] Current Thread [Next in Thread>