pcp
[Top] [All Lists]

QA Status

To: pcp@xxxxxxxxxxx
Subject: QA Status
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Tue, 5 Jul 2016 09:35:41 +1000
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.8.0
Things not looking too good here.  We have more hosts this time, but % failure 
rate is too high.

Lots of failures on a couple of unusual hosts (fuji and grundy) that are 
probably not too much of a concern.

119 is a known problem (actually debris from qa/083) that is fixed but still to 
work its way through the QA farm.

Ditto for 544 (fixed collectl2pcp and qa/544 issues).

The rest are all over the shop.

Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/

=== Synopsis ===

QA Status from Ken McDonell's QA Farm in Melbourne

Summary: 27033 run, 150 failed (0.55%)

QA Test  Fail  Failure Signatures (number of different failure patterns)
    722    14  2 2 1 1 1 1 1 1 1 1 1 1 
    119    13  9 4 
   1108    10  1 1 1 1 1 1 1 1 1 1 
    600     9  8 1 
    544     6  3 3 
    823     5  4 1 
    361     4  4 
    274     4  4 
            ^  ^
            |  |
            |  +-- A B C ... means one failure signature occurred A times,
            |      another occurred B times, a third occurred C times, ...
            +-- total number of failures for this test, equals A+B+C+...

Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.

The latest tarball is 20160705.tgz.

==== QA Summary ====

Date        Run Pass Fail Nrun Host
2016-07-03  839  837    2   91|bo|bozo PCP 3.11.4 x86_64 Ubuntu 16.04
2016-07-01  824  821    3  106|bl|bozo-laptop PCP 3.11.4 i686 LinuxMint 15
2016-07-05  857  851    6   73|bv|bozo-vm PCP 3.11.4 x86_64 Debian 8.5
2016-06-21  698  675   23  223|fu|fuji PCP unknown i386 Darwin 10.8.0
2016-07-05  739  727   12  145|gr|grundy.sgi.com|grundy.sgi.com
2016-07-05  850  846    4   80|00|vm00 PCP 3.11.4 x86_64 Ubuntu 12.04
2016-07-01  859  855    4   71|01|vm01 PCP 3.11.4 i686 Ubuntu 15.10
2016-07-01  841  835    6   89|02|vm02 PCP 3.11.4 i686 openSUSE 13.2
2016-07-01  874  869    5   56|03|vm03 PCP 3.11.4 x86_64 Fedora 24
2016-07-02  751  741   10  179|04|vm04 PCP 3.11.4 i686 CentOS 5.11
2016-07-02  845  840    5   85|05|vm05 PCP 3.11.4 x86_64 Gentoo 2.2
2016-07-02   61   60    1    4|06|vm06 PCP 3.11.4 amd64 FreeBSD 10.2-RELEASE
2016-07-02  816  810    6   79|07|vm07 PCP 3.11.4 x86_64 Debian stretch/sid
2016-07-04  870  868    2   60|08|vm08 PCP 3.11.4 x86_64 CentOS Linux7.2.1511 
2016-07-04   61   60    1    4|09|vm09 PCP 3.11.4 i386 NetBSD 6.1.5
2016-07-02   61   61    0    4|10|vm10 PCP 3.11.4 i386 FreeBSD 9.3-RELEASE-p30
2016-07-02  817  811    6   78|11|vm11 PCP 3.11.4 i686 Debian stretch/sid
2016-07-02  865  859    6   65|12|vm12 PCP 3.11.4 i686 Fedora 22
2016-07-03  864  861    3   66|14|vm14 PCP 3.11.4 x86_64 CentOS6.7
2016-07-04  798  795    3  132|15|vm15 PCP 3.11.4 x86_64 Slackware "14.2"
2016-07-03  856  854    2   74|18|vm18 PCP 3.11.4 x86_64 LinuxMint 17.3
2016-07-03  837  836    1   93|19|vm19 PCP 3.11.4 x86_64 openSUSE 12.2
2016-07-03  797  797    0  133|20|vm20 PCP 3.11.4 x86_64 Ubuntu 13.04
2016-07-03  846  842    4   84|21|vm21 PCP 3.11.4 i686 Debian 7.10
2016-07-03  865  864    1   65|22|vm22 PCP 3.11.4 x86_64 Fedora 19
2016-07-04  868  865    3   62|23|vm23 PCP 3.11.4 i686 Fedora 20
2016-07-04  863  859    4   67|24|vm24 PCP 3.11.4 i686 openSUSE 13.1
2016-07-04  746  741    5  184|25|vm25 PCP 3.11.4 x86_64 CentOS 5.11
2016-07-05  867  866    1   63|26|vm26 PCP 3.11.4 x86_64 Fedora 21
2016-07-03  854  853    1   76|27|vm27 PCP 3.11.4 x86_64 Ubuntu 15.04
2016-07-04  861  858    3   69|28|vm28 PCP 3.11.4 x86_64 RHEL Server 6.8
2016-07-03  868  865    3   62|29|vm29 PCP 3.11.4 x86_64 RHEL Server 7.2
2016-07-04  866  864    2   64|30|vm30 PCP 3.11.4 x86_64 SUSE SLES12 SP0
2016-07-05  866  863    3   64|31|vm31 PCP 3.11.4 x86_64 Fedora 23
2016-07-04   61   60    1    4|32|vm32 PCP 3.11.4 amd64 FreeBSD 11.0-CURRENT
2016-07-04   64   62    2    1|33|vm33 PCP 3.11.4 amd64 OpenBSD 5.8
2016-07-05  858  852    6   72|34|vm34 PCP 3.11.4 x86_64 Arch Linux 
Summary: 27033 run, 150 failed (0.55%)

==== QA Failure (X) Map ====

Host       bo bl bv fu gr 00 01 02 03 04 05 06 07 08 09 11 12 14 15 18 19 21 22 
23 24 25 26 27 28 29 30 31 32 33 34
Test %fail                                                                      
                                    Test QA groups
 722   38%              X           X     X        X        X  X     X     X    
 X        X     X  X  X           X  722 python
 119   35%              X           X  X  X     X           X  X  X  X          
       X     X  X        X           119 logutil
1108   27%  X  X           X  X        X           X     X              X       
 X     X                            1108 logutil folio pmlogextract
 600   24%     X              X  X  X  X  X     X        X  X                   
                                     600 libpcp timezone
 544   16%                       X     X                    X              X    
 X  X                                544 pmimport
 823   14%                       X        X                       X             
    X                             X  823 pmda.sample pmstore secure
 274   11%                          X           X        X        X             
                                     274 pmda help pmda.install dbpmda
 361   11%                 X                                   X           X    
                X                    361 pmda.linux cgroups
 651    8%                             X                    X                   
                         X           651 pmproxy
 666    8%     X                       X                                        
       X                             666 pmmgr slow valgrind
 023    5%           X  X                                                       
                                     023 pmcd pmprobe
 066    5%        X  X                                                          
                                     066 pmcd
 155    5%                                   X                                  
                            X        155 pmcd pmstore pmda.sample
 340    5%                 X                                                    
                   X                 340 pmcd
 354    5%                                            X                         
                               X     354 folio pmlc
 359    5%              X              X                                        
                                     359 pmcd pminfo
 365    5%        X  X                                                          
                                     365 pmcd
 430    5%        X  X                                                          
                                     430 logutil folio
Host       bo bl bv fu gr 00 01 02 03 04 05 06 07 08 09 11 12 14 15 18 19 21 22 
23 24 25 26 27 28 29 30 31 32 33 34
 648    5%                       X                          X                   
                                     648 pmda.mmv
 660    5%        X                                                             
                                  X  660 pmwebapi
 667    5%              X        X                                              
                                     667 python
 669    5%           X                          X                               
                                     669 pmmgr
 706    5%        X  X                                                          
                                     706 libpcp
 713    5%                    X        X                                        
                                     713 context libpcp pmproxy secure
 739    5%                    X  X                                              
                                     739 python getopt timezone
 836    5%                                                                      
    X                 X              836 pmlogsummary pmdiff
 892    5%                 X                                                    
                                  X  892 pmcd libpcp
 914    5%                                      X        X                      
                                     914 pmda.papi
 990    5%                                      X        X                      
                                     990 pmda.mmv
 999    5%              X              X                                        
                                     999 pmns
 051    3%                                                                      
       X                             051 pmcd
 067    3%           X                                                          
                                     067 pmcd
 069    3%           X                                                          
                                     069 pmcd pmval
 098    3%           X                                                          
                                     098 pmlc pmlogger other pmdumplog
 102    3%           X                                                          
                                     102 pmlc pmlogger
 110    3%           X                                                          
                                     110 pmda.simple pmda.proc pmda.install
 156    3%           X                                                          
                                     156 pmda.sample pmda.proc pmcd_wait 
pmda.install
 193    3%           X                                                          
                                     193 libpcp pmcd pdu
 216    3%                          X                                           
                                     216 pmda.linux
Host       bo bl bv fu gr 00 01 02 03 04 05 06 07 08 09 11 12 14 15 18 19 21 22 
23 24 25 26 27 28 29 30 31 32 33 34
 243    3%           X                                                          
                                     243 pmcd pmprobe
 244    3%           X                                                          
                                     244 pmcd pmprobe
 255    3%           X                                                          
                                     255 compat pmda pmda.proc help 
pmda.install pmda.simple
 280    3%                                                                 X    
                                     280 pmlogger logutil folio pmlc
 336    3%              X                                                       
                                     336 trace pmda.install
 371    3%              X                                                       
                                     371 pmimport pmdumplog perl libpcp_pmi
 372    3%              X                                                       
                                     372 pmimport pmdumplog perl
 381    3%                                                                      
       X                             381 logutil pmlc
 389    3%                                                                      
                         X           389 pmlogger
 416    3%                                                                      
                               X     416 pmda.news dbpmda perl
 449    3%        X                                                             
                                     449 threads flakey
 459    3%                             X                                        
                                     459 pmlogreduce valgrind
 527    3%                                               X                      
                                     527 libpcp_import perl timezone
 560    3%           X                                                          
                                     560 pmda.simple pmda.install
 578    3%                                                                      
                   X                 578 pmcd pmda.install pmval
 635    3%                                                                      
    X                                635 pmda.linux libirixpmda
 662    3%                                                                      
                                  X  662 pmwebapi pmda.sample
 709    3%           X                                                          
                                     709 python
 720    3%  X                                                                   
                                     720 libpcp valgrind
 769    3%              X                                                       
                                     769 other
 779    3%           X                                                          
                                     779 pmda
Host       bo bl bv fu gr 00 01 02 03 04 05 06 07 08 09 11 12 14 15 18 19 21 22 
23 24 25 26 27 28 29 30 31 32 33 34
 832    3%                                X                                     
                                     832 pmda.sample pmstore secure
 842    3%           X                                                          
                                     842 python pmiostat pmval
 878    3%                                                                    X 
                                     878 pmda.pipe pmval
 944    3%           X                                                          
                                     944 pmcd secure
 956    3%           X                                                          
                                     956 pmcd
 964    3%              X                                                       
                                     964 pmcd
 983    3%              X                                                       
                                     983 pmie
1051    3%           X                                                          
                                    1051 pmieconf
1055    3%                                                                      
                                  X 1055 pmlogger
Host       bo bl bv fu gr 00 01 02 03 04 05 06 07 08 09 11 12 14 15 18 19 21 22 
23 24 25 26 27 28 29 30 31 32 33 34

<Prev in Thread] Current Thread [Next in Thread>