pcp
[Top] [All Lists]

Re: [pcp] QA tests and pmlogreduce setting hours to "01"

To: Martin Hicks <mort@xxxxxxx>
Subject: Re: [pcp] QA tests and pmlogreduce setting hours to "01"
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Wed, 02 Sep 2009 13:35:25 +1000
Cc: pcp@xxxxxxxxxxx
In-reply-to: <20090901180959.GE16972@xxxxxxxxxxxxxxxxxxxxxxxxx>
References: <20090901163152.GC16972@xxxxxxxxxxxxxxxxxxxxxxxxx> <20090901180959.GE16972@xxxxxxxxxxxxxxxxxxxxxxxxx>
Reply-to: kenj@xxxxxxxxxxxxxxxx
Good guess Martin.

A better fix would be to use -z on the two pmval commands ...
unfortunately this produces output that is off by one hour, as the
144.out was created when the local timezone was EST-10, but the archive
was created when the timezone was EST-11.

I've attached updated versions of 144 and 144.out.

On Tue, 2009-09-01 at 13:09 -0500, Martin Hicks wrote:
> 
> aha.  Perhaps timezone related?
> 
> 
> pcpqa@laplace:/home/mort/src/pcpqa.git$ git diff 144
> diff --git a/144 b/144
> index e20e566..54b5198 100755
> --- a/144
> +++ b/144
> @@ -9,6 +9,8 @@
>  # creator
>  owner=kenmcd
>  
> +TZ=EST-10
> +export TZ
>  seq=`basename $0`
>  
>  if which pmlogreduce >/dev/null 2>&1
> 
> 
> On Tue, Sep 01, 2009 at 11:31:52AM -0500, Martin Hicks wrote:
> > 
> > I've started playing with the QA tests, running them against PCP-2.9.0
> > So far I've managed to get through nearly the first 150 tests, fixing a
> > few things along the way.
> > 
> > The thing I started hitting in the 100's was that the hours on the
> > archives are coming out incorrectly (or the archives are wrong, or the
> > 144.out is incorrect).
> > 
> > pmdumplog is telling me the same thing as pmlogreduce is:
> > 
> > pcpqa@laplace:/home/mort/src/pcpqa.git$ pmdumplog -a src-oss/naslog | head 
> > -n 4
> > Log Label (Log Format Version 2)
> > Performance metrics from host snort
> >   commencing Thu Apr  8 01:11:09.969 2004
> >   ending     Thu Apr  8 01:21:25.942 2004
> > 
> > The full log is attached.
> > 
> > pcpqa@laplace:/home/mort/src/pcpqa.git$ diff -u 144.out 144.out.bad
> > --- 144.out     2009-08-27 09:08:26.000000000 -0400
> > +++ 144.out.bad 2009-09-01 12:28:17.000000000 -0400
> > @@ -3,30 +3,30 @@
> >  
> >  === network.interface.baudrate ===
> >  5c5
> > -< end: Thu Apr 8 15:21:25 2004
> > +< end: Thu Apr 8 01:21:25 2004
> >  ---
> > -> end: Thu Apr 8 15:21:00 2004
> > +> end: Thu Apr 8 01:21:00 2004
> >  
> >  === network.interface.in.packets ===
> >  5c5
> > -< end: Thu Apr 8 15:21:25 2004
> > +< end: Thu Apr 8 01:21:25 2004
> >  ---
> > -> end: Thu Apr 8 15:21:00 2004
> > +> end: Thu Apr 8 01:21:00 2004
> >  
> >  === kernel.all.load ===
> >  5c5
> > -< end: Thu Apr 8 15:21:25 2004
> > +< end: Thu Apr 8 01:21:25 2004
> >  ---
> > -> end: Thu Apr 8 15:21:00 2004
> > +> end: Thu Apr 8 01:21:00 2004
> >  
> >  === kernel.all.cpu.idle ===
> >  5c5
> > -< end: Thu Apr 8 15:21:25 2004
> > +< end: Thu Apr 8 01:21:25 2004
> >  ---
> > -> end: Thu Apr 8 15:21:00 2004
> > +> end: Thu Apr 8 01:21:00 2004
> >  
> >  === disk.all.total ===
> >  5c5
> > -< end: Thu Apr 8 15:21:25 2004
> > +< end: Thu Apr 8 01:21:25 2004
> >  ---
> > -> end: Thu Apr 8 15:21:00 2004
> > +> end: Thu Apr 8 01:21:00 2004
> > 
> > 
> 
> > === network.interface.baudrate ===
> > --- original ---
> > 
> > metric:    network.interface.baudrate
> > archive:   src-oss/naslog
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:25 2004
> > semantics: discrete instantaneous value
> > units:     byte / sec
> > samples:   19
> > interval:  30.00 sec
> > 
> >                               lo0                   ef2                   
> > ef0 
> > 01:11:30.000                    0              10000000              
> > 10000000 
> > 01:12:00.000                    0              10000000              
> > 10000000 
> > 01:12:30.000                    0              10000000              
> > 10000000 
> > 01:13:00.000                    0              10000000              
> > 10000000 
> > 01:13:30.000                    0              10000000              
> > 10000000 
> > 01:14:00.000                    0              10000000              
> > 10000000 
> > 01:14:30.000                    0              10000000              
> > 10000000 
> > 01:15:00.000                    0              10000000              
> > 10000000 
> > 01:15:30.000                    0              10000000              
> > 10000000 
> > 01:16:00.000                    0              10000000              
> > 10000000 
> > 01:16:30.000                    0              10000000              
> > 10000000 
> > 01:17:00.000                    0              10000000              
> > 10000000 
> > 01:17:30.000                    0              10000000              
> > 10000000 
> > 01:18:00.000                    0              10000000              
> > 10000000 
> > 01:18:30.000                    0              10000000              
> > 10000000 
> > 01:19:00.000                    0              10000000              
> > 10000000 
> > 01:19:30.000                    0              10000000              
> > 10000000 
> > 01:20:00.000                    0              10000000              
> > 10000000 
> > 01:20:30.000                    0              10000000              
> > 10000000 
> > --- reduced ---
> > 
> > metric:    network.interface.baudrate
> > archive:   /tmp/22795
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:00 2004
> > semantics: discrete instantaneous value
> > units:     byte / sec
> > samples:   19
> > interval:  30.00 sec
> > 
> >                               lo0                   ef2                   
> > ef0 
> > 01:11:30.000                    0              10000000              
> > 10000000 
> > 01:12:00.000                    0              10000000              
> > 10000000 
> > 01:12:30.000                    0              10000000              
> > 10000000 
> > 01:13:00.000                    0              10000000              
> > 10000000 
> > 01:13:30.000                    0              10000000              
> > 10000000 
> > 01:14:00.000                    0              10000000              
> > 10000000 
> > 01:14:30.000                    0              10000000              
> > 10000000 
> > 01:15:00.000                    0              10000000              
> > 10000000 
> > 01:15:30.000                    0              10000000              
> > 10000000 
> > 01:16:00.000                    0              10000000              
> > 10000000 
> > 01:16:30.000                    0              10000000              
> > 10000000 
> > 01:17:00.000                    0              10000000              
> > 10000000 
> > 01:17:30.000                    0              10000000              
> > 10000000 
> > 01:18:00.000                    0              10000000              
> > 10000000 
> > 01:18:30.000                    0              10000000              
> > 10000000 
> > 01:19:00.000                    0              10000000              
> > 10000000 
> > 01:19:30.000                    0              10000000              
> > 10000000 
> > 01:20:00.000                    0              10000000              
> > 10000000 
> > 01:20:30.000                    0              10000000              
> > 10000000 
> > === network.interface.in.packets ===
> > --- original ---
> > 
> > metric:    network.interface.in.packets
> > archive:   src-oss/naslog
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:25 2004
> > semantics: cumulative counter (converting to rate)
> > units:     count (converting to count / sec)
> > samples:   19
> > interval:  30.00 sec
> > 
> >                  lo0         ef2         ef0    
> > 01:12:00.000    52.37        0.0       678.5    
> > 01:12:30.000    71.47        0.0       762.9    
> > 01:13:00.000    73.03        0.0       688.8    
> > 01:13:30.000    80.43        0.0       616.1    
> > 01:14:00.000    70.87        0.0       560.6    
> > 01:14:30.000    66.73        0.0       691.8    
> > 01:15:00.000    61.70        0.0       697.8    
> > 01:15:30.000    89.37        0.0       709.7    
> > 01:16:00.000    82.57        0.0       762.4    
> > 01:16:30.000    82.67        0.0       673.0    
> > 01:17:00.000    52.67        0.0       639.4    
> > 01:17:30.000    57.20        0.0       646.4    
> > 01:18:00.000    50.07        0.0       216.8    
> > 01:18:30.000    50.93        0.0       115.3    
> > 01:19:00.000    57.53        0.0       160.8    
> > 01:19:30.000    57.93        0.0       240.8    
> > 01:20:00.000    53.47        0.0       167.5    
> > 01:20:30.000    64.93        0.0       182.0    
> > 01:21:00.000    49.33        0.0       187.2    
> > --- reduced ---
> > 
> > metric:    network.interface.in.packets
> > archive:   /tmp/22795
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:00 2004
> > semantics: cumulative counter (converting to rate)
> > units:     count (converting to count / sec)
> > samples:   19
> > interval:  30.00 sec
> > 
> >                            lo0                   ef2                   ef0  
> >   
> > 01:12:00.000              52.37                  0.0                 678.5  
> >   
> > 01:12:30.000              71.47                  0.0                 762.9  
> >   
> > 01:13:00.000              73.03                  0.0                 688.8  
> >   
> > 01:13:30.000              80.43                  0.0                 616.1  
> >   
> > 01:14:00.000              70.87                  0.0                 560.6  
> >   
> > 01:14:30.000              66.73                  0.0                 691.8  
> >   
> > 01:15:00.000              61.70                  0.0                 697.8  
> >   
> > 01:15:30.000              89.37                  0.0                 709.7  
> >   
> > 01:16:00.000              82.57                  0.0                 762.4  
> >   
> > 01:16:30.000              82.67                  0.0                 673.0  
> >   
> > 01:17:00.000              52.67                  0.0                 639.4  
> >   
> > 01:17:30.000              57.20                  0.0                 646.4  
> >   
> > 01:18:00.000              50.07                  0.0                 216.8  
> >   
> > 01:18:30.000              50.93                  0.0                 115.3  
> >   
> > 01:19:00.000              57.53                  0.0                 160.8  
> >   
> > 01:19:30.000              57.93                  0.0                 240.8  
> >   
> > 01:20:00.000              53.47                  0.0                 167.5  
> >   
> > 01:20:30.000              64.93                  0.0                 182.0  
> >   
> > 01:21:00.000              49.33                  0.0                 187.2  
> >   
> > === kernel.all.load ===
> > --- original ---
> > 
> > metric:    kernel.all.load
> > archive:   src-oss/naslog
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:25 2004
> > semantics: instantaneous value
> > units:     none
> > samples:   19
> > interval:  30.00 sec
> > 
> >                  1 minute      5 minute     15 minute 
> > 01:11:30.000       3.269         2.493         1.818  
> > 01:12:00.000       3.271         2.573         1.867  
> > 01:12:30.000       2.763         2.511         1.867  
> > 01:13:00.000       2.867         2.564         1.906  
> > 01:13:30.000       3.208         2.674         1.970  
> > 01:14:00.000       3.173         2.713         2.007  
> > 01:14:30.000       3.099         2.750         2.043  
> > 01:15:00.000       2.827         2.717         2.051  
> > 01:15:30.000       2.815         2.728         2.077  
> > 01:16:00.000       3.036         2.788         2.119  
> > 01:16:30.000       2.591         2.702         2.111  
> > 01:17:00.000       2.105         2.580         2.085  
> > 01:17:30.000       1.681         2.413         2.038  
> > 01:18:00.000       1.290         2.252         1.988  
> > 01:18:30.000       0.7969        2.026         1.915  
> > 01:19:00.000       0.8037        1.916         1.876  
> > 01:19:30.000       0.8369        1.805         1.832  
> > 01:20:00.000       0.5811        1.649         1.771  
> > 01:20:30.000       0.9023        1.605         1.750  
> > --- reduced ---
> > 
> > metric:    kernel.all.load
> > archive:   /tmp/22795
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:00 2004
> > semantics: instantaneous value
> > units:     none
> > samples:   19
> > interval:  30.00 sec
> > 
> >                  1 minute      5 minute     15 minute 
> > 01:11:30.000       3.269         2.493         1.818  
> > 01:12:00.000       3.271         2.573         1.867  
> > 01:12:30.000       2.763         2.511         1.867  
> > 01:13:00.000       2.867         2.564         1.906  
> > 01:13:30.000       3.208         2.674         1.970  
> > 01:14:00.000       3.173         2.713         2.007  
> > 01:14:30.000       3.099         2.750         2.043  
> > 01:15:00.000       2.827         2.717         2.051  
> > 01:15:30.000       2.815         2.728         2.077  
> > 01:16:00.000       3.036         2.788         2.119  
> > 01:16:30.000       2.591         2.702         2.111  
> > 01:17:00.000       2.105         2.580         2.085  
> > 01:17:30.000       1.681         2.413         2.038  
> > 01:18:00.000       1.290         2.252         1.988  
> > 01:18:30.000       0.7969        2.026         1.915  
> > 01:19:00.000       0.8037        1.916         1.876  
> > 01:19:30.000       0.8369        1.805         1.832  
> > 01:20:00.000       0.5811        1.649         1.771  
> > 01:20:30.000       0.9023        1.605         1.750  
> > === kernel.all.cpu.idle ===
> > --- original ---
> > 
> > metric:    kernel.all.cpu.idle
> > archive:   src-oss/naslog
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:25 2004
> > semantics: cumulative counter (converting to rate)
> > units:     millisec (converting to time utilization)
> > samples:   19
> > interval:  30.00 sec
> > 01:12:00.000     6.414 
> > 01:12:30.000     7.266 
> > 01:13:00.000     7.443 
> > 01:13:30.000     7.031 
> > 01:14:00.000     6.765 
> > 01:14:30.000     7.076 
> > 01:15:00.000     7.417 
> > 01:15:30.000     7.253 
> > 01:16:00.000     7.239 
> > 01:16:30.000     7.682 
> > 01:17:00.000     8.709 
> > 01:17:30.000     8.743 
> > 01:18:00.000     9.470 
> > 01:18:30.000     9.731 
> > 01:19:00.000     9.599 
> > 01:19:30.000     9.448 
> > 01:20:00.000     9.549 
> > 01:20:30.000     9.461 
> > 01:21:00.000     9.581 
> > --- reduced ---
> > 
> > metric:    kernel.all.cpu.idle
> > archive:   /tmp/22795
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:00 2004
> > semantics: cumulative counter (converting to rate)
> > units:     millisec (converting to time utilization)
> > samples:   19
> > interval:  30.00 sec
> > 01:12:00.000               6.414 
> > 01:12:30.000               7.266 
> > 01:13:00.000               7.443 
> > 01:13:30.000               7.031 
> > 01:14:00.000               6.765 
> > 01:14:30.000               7.076 
> > 01:15:00.000               7.417 
> > 01:15:30.000               7.253 
> > 01:16:00.000               7.239 
> > 01:16:30.000               7.682 
> > 01:17:00.000               8.709 
> > 01:17:30.000               8.743 
> > 01:18:00.000               9.470 
> > 01:18:30.000               9.731 
> > 01:19:00.000               9.599 
> > 01:19:30.000               9.448 
> > 01:20:00.000               9.549 
> > 01:20:30.000               9.461 
> > 01:21:00.000               9.581 
> > === disk.all.total ===
> > --- original ---
> > 
> > metric:    disk.all.total
> > archive:   src-oss/naslog
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:25 2004
> > semantics: cumulative counter (converting to rate)
> > units:     count (converting to count / sec)
> > samples:   19
> > interval:  30.00 sec
> > 01:12:00.000             355.9   
> > 01:12:30.000             239.3   
> > 01:13:00.000             168.0   
> > 01:13:30.000             119.7   
> > 01:14:00.000             211.2   
> > 01:14:30.000             235.7   
> > 01:15:00.000             188.2   
> > 01:15:30.000             152.6   
> > 01:16:00.000             164.9   
> > 01:16:30.000             190.7   
> > 01:17:00.000             154.1   
> > 01:17:30.000             138.1   
> > 01:18:00.000              32.77  
> > 01:18:30.000              18.87  
> > 01:19:00.000              14.50  
> > 01:19:30.000              19.37  
> > 01:20:00.000              18.03  
> > 01:20:30.000              21.40  
> > 01:21:00.000              18.63  
> > --- reduced ---
> > 
> > metric:    disk.all.total
> > archive:   /tmp/22795
> > host:      snort
> > start:     Thu Apr  8 01:11:30 2004
> > end:       Thu Apr  8 01:21:00 2004
> > semantics: cumulative counter (converting to rate)
> > units:     count (converting to count / sec)
> > samples:   19
> > interval:  30.00 sec
> > 01:12:00.000             355.9   
> > 01:12:30.000             239.3   
> > 01:13:00.000             168.0   
> > 01:13:30.000             119.7   
> > 01:14:00.000             211.2   
> > 01:14:30.000             235.7   
> > 01:15:00.000             188.2   
> > 01:15:30.000             152.6   
> > 01:16:00.000             164.9   
> > 01:16:30.000             190.7   
> > 01:17:00.000             154.1   
> > 01:17:30.000             138.1   
> > 01:18:00.000              32.77  
> > 01:18:30.000              18.87  
> > 01:19:00.000              14.50  
> > 01:19:30.000              19.37  
> > 01:20:00.000              18.03  
> > 01:20:30.000              21.40  
> > 01:21:00.000              18.63  
> 
> > _______________________________________________
> > pcp mailing list
> > pcp@xxxxxxxxxxx
> > http://oss.sgi.com/mailman/listinfo/pcp
> 
> _______________________________________________
> pcp mailing list
> pcp@xxxxxxxxxxx
> http://oss.sgi.com/mailman/listinfo/pcp

Attachment: 144.out
Description: Text document

Attachment: 144
Description: application/shellscript

<Prev in Thread] Current Thread [Next in Thread>