pcp
[Top] [All Lists]

pcp QA Status

To: pcp@xxxxxxxxxxx
Subject: pcp QA Status
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Mon, 16 May 2016 14:34:48 +1000
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2
450 is a known timezone change issue (QA setup not a code problem).

1092 is a known package versions change issue (QA setup not a code problem)

My builds are still broken on Mac OS X (fuji) and FreeBSD 9.3 (vm10).

valgrind is still broken on Debian 6.0.10 (vm07 and vm11).

Lots of things to look at / fix here.

Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/

=== Synopsis ===

QA Status from Ken McDonell's QA Farm in Melbourne

Summary: 24153 run, 231 failed (0.96%)

QA Test  Fail  Failure Signatures (number of different failure patterns)
    666    22  1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 
    450    22  2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 
   1092    21  21 
    024    18  14 4 
    826    17  11 4 2 
    023    13  13 
    821    11  9 1 1 
   1070     3  3 
    823     3  2 1 
    756     3  2 1 
    394     3  1 1 1 
    274     3  3 
            ^  ^
            |  |
            |  +-- A B C ... means one failure signature occurred A times,
            |      another occurred B times, a third occurred C times, ...
            +-- total number of failures for this test, equals A+B+C+...

Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.

The latest tarball is 20160516.tgz.

==== QA Summary ====

Date        Run Pass Fail Nrun Host
2016-05-15  826  821    5   86|bo|bozo PCP 3.11.2 x86_64 Ubuntu 15.10
2016-05-13  807  800    7  105|bl|bozo-laptop PCP 3.11.2 i686 LinuxMint 15
2016-05-10  810  805    5  101|bv|bozo-vm PCP 3.11.2 x86_64 Debian 8.2
Daily runs, but no QA         |fu|fuji PCP 3.11.2 i386 Darwin 10.8.0
2016-05-13  707  702    5  162|gr|grundy.sgi.com|grundy.sgi.com
2016-05-13  832  827    5   80|00|vm00 PCP 3.11.2 x86_64 Ubuntu 12.04
2016-05-13  837  833    4   75|01|vm01 PCP 3.11.2 i686 Ubuntu 15.10
2016-05-13  822  816    6   90|02|vm02 PCP 3.11.2 i686 openSUSE 13.2
2016-05-13  855  852    3   57|03|vm03 PCP 3.11.2 x86_64 Fedora 21
2016-05-14  738  732    6  174|04|vm04 PCP 3.11.2 i586 CentOS 5.11
2016-05-14  828  821    7   84|05|vm05 PCP 3.11.2 x86_64 Gentoo 2.2
2016-05-14   61   60    1    4|06|vm06 PCP 3.11.2 amd64 FreeBSD 10.2-RELEASE
2016-05-14  831  791   40   81|07|vm07 PCP 3.11.2 x86_64 Debian 6.0.10
2016-05-16  851  844    7   61|08|vm08 PCP 3.11.2 x86_64 CentOS Linux7.2.1511 
2016-05-16   61   60    1    4|09|vm09 PCP 3.11.2 i386 NetBSD 6.1.5
Daily runs, but no QA         |10|vm10 PCP 3.11.2 i386 FreeBSD 9.3-RELEASE-p30
2016-05-14  830  789   41   82|11|vm11 PCP 3.11.2 i686 Debian 6.0.10
2016-05-14  851  847    4   61|12|vm12 PCP 3.11.2 i686 Fedora 22
2016-05-15  846  839    7   66|14|vm14 PCP 3.11.2 x86_64 CentOS6.7
No daily runs                 |15|vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2016-05-15  837  831    6   75|18|vm18 PCP 3.11.2 x86_64 LinuxMint 17.3
2016-05-08  819  817    2   92|19|vm19 PCP 3.11.2 x86_64 openSUSE 12.2
2016-05-15  778  772    6  134|20|vm20 PCP 3.11.2 x86_64 Ubuntu 13.04
2016-05-15  828  822    6   84|21|vm21 PCP 3.11.2 i686 Debian 7.9
2016-05-15  850  844    6   62|22|vm22 PCP 3.11.2 x86_64 Fedora 19
2016-05-16  849  845    4   63|23|vm23 PCP 3.11.2 i686 Fedora 20
2016-05-16  844  837    7   68|24|vm24 PCP 3.11.2 i686 openSUSE 13.1
2016-05-13  734  727    7  178|25|vm25 PCP 3.11.2 x86_64 CentOS 5.11
2016-05-14  853  848    5   59|26|vm26 PCP 3.11.2 x86_64 Fedora 21
2016-05-15  840  833    7   72|27|vm27 PCP 3.11.2 x86_64 Ubuntu 15.04
2016-05-16  848  842    6   64|28|vm28 PCP 3.11.2 x86_64 RHEL Server 6.7
2016-05-15  854  849    5   58|29|vm29 PCP 3.11.2 x86_64 RHEL Server 7.1
2016-05-13  852  845    7   60|30|vm30 PCP 3.11.2 x86_64 SUSE SLES12 SP0
2016-05-14  852  849    3   60|31|vm31 PCP 3.11.2 x86_64 Fedora 23
2016-05-16   61   61    0    4|32|vm32 PCP 3.11.2 amd64 FreeBSD 11.0-CURRENT
2016-05-12   61   61    0    4|33|vm33 PCP 3.11.2 amd64 OpenBSD 5.8
Summary: 24153 run, 231 failed (0.96%)

==== QA Failure (X) Map ====

Host       bo bl bv gr 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 26 27 28 29 30 31
Test %fail                                                                      
                        Test QA groups
 450   67%     X  X     X     X  X  X  X        X        X  X  X     X  X  X  X 
 X  X  X  X  X  X  X     450 pmlogextract pmval
 666   67%  X  X  X  X     X  X     X  X     X  X     X     X  X  X  X  X  X    
 X  X     X  X     X     666 pmmgr slow
1092   64%     X        X     X  X  X  X        X        X  X  X     X  X  X  X 
 X  X  X  X  X  X  X    1092 libpcp
 024   55%  X                       X  X     X  X     X  X  X  X        X  X  X 
 X     X  X  X  X     X  024 context context_local
 826   52%     X     X     X  X  X  X  X     X        X  X  X  X                
    X  X  X        X  X  826 pmda.linux
 023   39%  X  X  X  X  X  X           X     X        X        X     X  X       
          X              023 pmcd pmprobe
 821   33%  X        X  X                       X                    X  X  X  X 
 X           X  X        821 pmda.linux
 274    9%        X                          X        X                         
                         274 pmda help pmda.install dbpmda
 394    9%                                   X        X                         
    X                    394 archive mem_leak valgrind flakey
 756    9%                                      X                               
       X           X     756 pmda.perfevent
 823    9%                    X        X                                        
 X                       823 pmda.sample pmstore secure
1070    9%     X                                                  X  X          
                        1070 pmrep pmimport python perl
 051    6%                                   X        X                         
                         051 pmcd
 246    6%                                   X        X                         
                         246 derive
 386    6%                                   X        X                         
                         386 pdu mem_leak valgrind
 387    6%                                   X        X                         
                         387 pmns mem_leak valgrind
 388    6%                                   X        X                         
                         388 archive mem_leak valgrind
 391    6%                                   X        X                         
                         391 archive mem_leak valgrind
Host       bo bl bv gr 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 26 27 28 29 30 31
 393    6%                                   X        X                         
                         393 archive mem_leak valgrind
 395    6%                                   X        X                         
                         395 archive mem_leak valgrind
 400    6%                                   X        X                         
                         400 pminfo mem_leak valgrind context_local libpcp event
 405    6%                                   X        X                         
                         405 libpcp mem_leak valgrind event
 459    6%                                   X        X                         
                         459 pmlogreduce valgrind
 490    6%                                   X        X                         
                         490 pmlogrewrite mem_leak valgrind
 513    6%                                   X        X                         
                         513 libpcp pdu valgrind
 526    6%                                   X        X                         
                         526 pmimport valgrind
 578    6%                                                                      
          X     X        578 pmcd pmda.install pmval
 597    6%                                   X        X                         
                         597 pmda.shping pmda.proc pmda.install
 656    6%                                   X        X                         
                         656 pmda.cifs valgrind
 667    6%                    X                                            X    
                         667 python
 719    6%                                   X        X                         
                         719 libpcp valgrind
 720    6%                                   X        X                         
                         720 libpcp valgrind
 731    6%                                   X        X                         
                         731 pmda.proc cgroups valgrind pmval
 738    6%                                   X        X                         
                         738 logutil pmlogmv
 746    6%                                   X        X                         
                         746 valgrind libpcp
 791    6%                                   X        X                         
                         791 pmlogextract valgrind
 802    6%                                   X        X                         
                         802 pmda valgrind dbpmda
 828    6%                                   X        X                         
                         828 valgrind archive context
 858    6%                                   X        X                         
                         858 libpcp fetch
Host       bo bl bv gr 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 26 27 28 29 30 31
 874    6%                                   X        X                         
                         874 valgrind pmval libpcp
 875    6%                                   X        X                         
                         875 libpcp valgrind
 902    6%                                   X        X                         
                         902 libpcp mem_leak valgrind event
 903    6%                                                  X                   
             X           903 pmda.papi
 914    6%                                   X        X                         
                         914 pmda.papi
 957    6%                                   X        X                         
                         957 pmda.linux valgrind
 977    6%                                   X        X                         
                         977 libpcp valgrind containers
 988    6%                                   X        X                         
                         988 pmda.xfs valgrind
1065    6%                                   X        X                         
                        1065 libpcp valgrind
1080    6%                                   X        X                         
                        1080 valgrind pcp atop
 155    3%                                X                                     
                         155 pmcd pmstore pmda.sample
 169    3%                                                                      
    X                    169 pmcd
 206    3%           X                                                          
                         206 archive pmval
 280    3%                          X                                           
                         280 pmlogger logutil folio pmlc
 300    3%                                      X                               
                         300 pmcd
 322    3%                                                                      
                   X     322 pmlc pmlogger
 340    3%                                                                      
                   X     340 pmcd
 354    3%                                         X                            
                         354 folio pmlc
 449    3%        X                                                             
                         449 threads flakey
 510    3%                                                                      
    X                    510 pmlogger pmlc
 518    3%     X                                                                
                         518 pcp flakey pmie
Host       bo bl bv gr 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 26 27 28 29 30 31
 527    3%                                            X                         
                         527 libpcp_import perl timezone
 555    3%                                                                      
                      X  555 pmie
 557    3%                                                  X                   
                         557 pmie
 661    3%  X                                                                   
                         661 pmwebapi
 739    3%                 X                                                    
                         739 python getopt timezone
 878    3%                                                                      
 X                       878 pmda.pipe pmval
 892    3%              X                                                       
                         892 pmcd libpcp
Host       bo bl bv gr 00 01 02 03 04 05 06 07 08 09 11 12 14 18 19 20 21 22 23 
24 25 26 27 28 29 30 31

<Prev in Thread] Current Thread [Next in Thread>