pcp
[Top] [All Lists]

pcp QA status

To: pcp@xxxxxxxxxxx
Subject: pcp QA status
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Mon, 20 Jun 2016 17:50:30 +1000
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.8.0
Haven't reported this for a while, as I've been dealing with a range of VM 
illness after changing the underlying host hardware.

I think I've dealt with most of the VM environmental failures now, so these are 
probably real failures.

382 looks like a recent regression/change
666 remains a royal pain in the backside
374 dunno, haven't had a chance to investigate
544 ditto
651 ditto
365 fixed, but not yet propagated thru all of the QA farm
...

Builds still broken on some platforms.

grundy.sgi.com is out of the pool as pmmgr regularly kills the machine (this 
means hang, pmmgr spinning, cannot kill, cannot reboot, power cycle is the only 
option to recover).

Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/

=== Synopsis ===

QA Status from Ken McDonell's QA Farm in Melbourne

Summary: 23839 run, 137 failed (0.57%)

QA Test  Fail  Failure Signatures (number of different failure patterns)
    382    23  20 1 
    666    16  1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 
    374    10  1 1 1 1 1 1 1 1 1 1 
    544     9  9 
    651     5  4 1 
    365     5  1 1 1 
    322     5  1 1 1 1 1 
    823     3  2 1 
    713     3  3 
    354     3  1 1 1 
            ^  ^
            |  |
            |  +-- A B C ... means one failure signature occurred A times,
            |      another occurred B times, a third occurred C times, ...
            +-- total number of failures for this test, equals A+B+C+...

Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.

The latest tarball is 20160620.tgz.

==== QA Summary ====

Date        Run Pass Fail Nrun Host
2016-06-15  827  823    4   89|bo|bozo PCP 3.11.2 x86_64 Ubuntu 15.10
2016-06-10  811  807    4  104|bl|bozo-laptop PCP 3.11.2 i686 LinuxMint 15
2016-06-17  817  813    4   99|bv|bozo-vm PCP 3.11.2 x86_64 Debian 8.2
2016-06-17  697  673   24  221|fu|fuji PCP 3.11.2 i386 Darwin 10.8.0
Daily runs, but no QA         |gr|grundy.sgi.com|grundy.sgi.com
2016-06-17  811  808    3  106|00|vm00 PCP 3.11.2 x86_64 Ubuntu 12.04
2016-06-17  822  816    6   97|01|vm01 PCP 3.11.2 i686 Ubuntu 15.10
2016-06-17  829  824    5   89|02|vm02 PCP 3.11.2 i686 openSUSE 13.2
2016-06-17  832  829    3   87|03|vm03 PCP 3.11.2 x86_64 Fedora 21
2016-06-18  742  734    8  177|04|vm04 PCP 3.11.2 i586 CentOS 5.11
2016-06-18  835  830    5   84|05|vm05 PCP 3.11.2 x86_64 Gentoo 2.2
2016-06-18   61   59    2    4|06|vm06 PCP 3.11.2 amd64 FreeBSD 10.2-RELEASE
2016-06-18  782  776    6  105|07|vm07 PCP 3.11.2 x86_64 Debian 6.0.10
2016-06-20  833  828    5   86|08|vm08 PCP 3.11.2 x86_64 CentOS Linux7.2.1511 
2016-06-20   61   59    2    4|09|vm09 PCP 3.11.2 i386 NetBSD 6.1.5
Daily runs, but no QA         |10|vm10 PCP 3.11.2 i386 FreeBSD 9.3-RELEASE-p30
2016-06-18  781  774    7  107|11|vm11 PCP 3.11.2 i686 Debian 6.0.10
2016-06-18  828  826    2   91|12|vm12 PCP 3.11.2 i686 Fedora 22
2016-06-19  853  849    4   66|14|vm14 PCP 3.11.2 x86_64 CentOS6.7
No daily runs                 |15|vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2016-06-16  816  815    1  100|18|vm18 PCP 3.11.2 x86_64 LinuxMint 17.3
2016-06-19  800  796    4  119|19|vm19 PCP 3.11.2 x86_64 openSUSE 12.2
2016-06-19  786  784    2  133|20|vm20 PCP 3.11.2 x86_64 Ubuntu 13.04
2016-06-19  809  805    4  110|21|vm21 PCP 3.11.2 i686 Debian 7.9
2016-06-19  828  824    4   91|22|vm22 PCP 3.11.2 x86_64 Fedora 19
2016-06-20  831  827    4   88|23|vm23 PCP 3.11.2 i686 Fedora 20
2016-06-20  826  822    4   93|24|vm24 PCP 3.11.2 i686 openSUSE 13.1
2016-06-17  737  734    3  182|25|vm25 PCP 3.11.2 x86_64 CentOS 5.11
2016-06-14  852  852    0   64|26|vm26 PCP 3.11.2 x86_64 Fedora 21
2016-06-19  843  841    2   76|27|vm27 PCP 3.11.2 x86_64 Ubuntu 15.04
2016-06-16  849  847    2   69|28|vm28 PCP 3.11.2 x86_64 RHEL Server 6.7
2016-06-19  831  826    5   88|29|vm29 PCP 3.11.2 x86_64 RHEL Server 7.1
2016-06-17  829  825    4   90|30|vm30 PCP 3.11.2 x86_64 SUSE SLES12 SP0
2016-06-18  855  854    1   64|31|vm31 PCP 3.11.2 x86_64 Fedora 23
2016-06-20   61   60    1    4|32|vm32 PCP 3.11.2 amd64 FreeBSD 11.0-CURRENT
2016-06-20   64   62    2    1|33|vm33 PCP 3.11.2 amd64 OpenBSD 5.8
Summary: 23839 run, 137 failed (0.57%)

==== QA Failure (X) Map ====

Host       bo bl bv fu 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 27 28 29 30 31 32 33
Test %fail                                                                      
                           Test QA groups
 382   70%  X        X     X  X  X  X  X     X  X     X  X  X     X  X  X  X  X 
 X  X  X     X  X  X        382 dbpmda pmda pmda.sample
 666   48%     X  X     X     X     X  X     X  X           X     X  X  X  X    
 X  X     X                 666 pmmgr slow
 374   30%     X           X     X              X     X     X     X             
       X     X  X           374 pmlc pmlogger
 544   27%     X           X  X     X                 X  X              X     X 
 X                          544 pmimport
 322   15%     X           X                          X           X             
             X              322 pmlc pmlogger
 365   15%  X     X  X  X                                      X                
                            365 pmcd
 651   15%                 X     X  X                                         X 
    X                       651 pmproxy
 354    9%                                         X                            
             X           X  354 folio pmlc
 713    9%                 X        X                                         X 
                            713 context libpcp pmproxy secure
 823    9%                    X        X                                        
 X                          823 pmda.sample pmstore secure
 155    6%                                X                                     
                      X     155 pmcd pmstore pmda.sample
 274    6%                                   X        X                         
                            274 pmda help pmda.install dbpmda
 340    6%                                                                      
             X  X           340 pmcd
 914    6%                                   X        X                         
                            914 pmda.papi
1051    6%           X                 X                                        
                           1051 pmieconf
1069    6%                                                  X                   
          X                1069 pmrep python timezone
1099    6%  X        X                                                          
                           1099 archive pmiostat pmie
 023    3%           X                                                          
                            023 pmcd pmprobe
Host       bo bl bv fu 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 27 28 29 30 31 32 33
 066    3%           X                                                          
                            066 pmcd
 067    3%           X                                                          
                            067 pmcd
 068    3%                                X                                     
                            068 context pmlc
 069    3%           X                                                          
                            069 pmcd pmval
 098    3%           X                                                          
                            098 pmlc pmlogger other pmdumplog
 102    3%           X                                                          
                            102 pmlc pmlogger
 110    3%           X                                                          
                            110 pmda.simple pmda.proc pmda.install
 116    3%     X                                                                
                            116 other pmie pmval pmlc
 156    3%           X                                                          
                            156 pmda.sample pmda.proc pmcd_wait pmda.install
 193    3%           X                                                          
                            193 libpcp pmcd pdu
 243    3%           X                                                          
                            243 pmcd pmprobe
 244    3%           X                                                          
                            244 pmcd pmprobe
 246    3%                                   X                                  
                            246 derive
 255    3%           X                                                          
                            255 compat pmda pmda.proc help pmda.install 
pmda.simple
 280    3%                                                              X       
                            280 pmlogger logutil folio pmlc
 300    3%                                      X                               
                            300 pmcd
 359    3%                          X                                           
                            359 pmcd pminfo
 375    3%                                                                      
                X           375 pmlc pmlogger
 397    3%                                         X                            
                            397 dbpmda libpcp pdu event
 416    3%                                                                      
                         X  416 pmda.news dbpmda perl
 430    3%           X                                                          
                            430 logutil folio
Host       bo bl bv fu 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 27 28 29 30 31 32 33
 457    3%        X                                                             
                            457 pmda.logger pmda.install event flakey
 459    3%                          X                                           
                            459 pmlogreduce valgrind
 462    3%                                      X                               
                            462 pmcd_wait
 527    3%                                            X                         
                            527 libpcp_import perl timezone
 542    3%                             X                                        
                            542 pmdate
 560    3%           X                                                          
                            560 pmda.simple pmda.install
 660    3%        X                                                             
                            660 pmwebapi
 667    3%                    X                                                 
                            667 python
 706    3%           X                                                          
                            706 libpcp
 709    3%           X                                                          
                            709 python
 720    3%  X                                                                   
                            720 libpcp valgrind
 779    3%           X                                                          
                            779 pmda
 805    3%                                                                 X    
                            805 pmda.postfix
 842    3%           X                                                          
                            842 python pmiostat pmval
 858    3%                                   X                                  
                            858 libpcp fetch
 878    3%                                                                 X    
                            878 pmda.pipe pmval
 892    3%              X                                                       
                            892 pmcd libpcp
 944    3%           X                                                          
                            944 pmcd secure
 956    3%           X                                                          
                            956 pmcd
 999    3%                          X                                           
                            999 pmns
Host       bo bl bv fu 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 27 28 29 30 31 32 33

<Prev in Thread] Current Thread [Next in Thread>