pcp
[Top] [All Lists]

QA Status

To: pcp@xxxxxxxxxxx
Subject: QA Status
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Tue, 15 Mar 2016 20:31:27 +1100
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0
[I still have 22+ failing tests on Mac OS X, so this platform is not included 
in the report, yet]

Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/

=== Synopsis ===

QA Status from Ken McDonell's QA Farm in Melbourne

Summary: 24038 run, 61 failed (0.25%)

QA Test  Fail  Failure Signatures (number of different failure patterns)
    878    10  6 3 1 
   1038     5  3 1 1 
    666     4  1 1 1 1 
   1069     3  3 
   1062     3  3 
    880     3  3 
    823     3  1 1 1 
    756     3  3 
            ^  ^
            |  |
            |  +-- A B C ... means one failure signature occurred A times,
            |      another occurred B times, a third occurred C times, ...
            +-- total number of failures for this test, equals A+B+C+...

Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.

The latest tarball is 20160315.tgz.

==== QA Summary ====

Date        Run Pass Fail Nrun Host
2016-03-13  819  817    2   87|bo|bozo PCP 3.11.1 x86_64 Ubuntu 15.10
2016-03-15  798  796    2  108|bl|bozo-laptop PCP 3.11.1 i686 LinuxMint 15
2016-03-15  807  807    0   99|bv|bozo-vm PCP 3.11.1 x86_64 Debian 8.2
2016-03-15  701  696    5  162|gr|grundy PCP 3.11.0 ia64 SUSE SLES11 SP1
2016-03-15  823  822    1   83|00|vm00 PCP 3.11.1 x86_64 Ubuntu 12.04
2016-03-15  826  825    1   80|01|vm01 PCP 3.11.1 i686 Ubuntu 15.10
2016-03-15  813  811    2   93|02|vm02 PCP 3.11.1 i686 openSUSE 13.2
2016-03-11  848  846    2   58|03|vm03 PCP 3.11.1 x86_64 Fedora 21
2016-03-12  736  731    5  170|04|vm04 PCP 3.11.1 i586 CentOS 5.11
2016-03-12  823  818    5   83|05|vm05 PCP 3.11.1 x86_64 Gentoo 2.2
2016-03-12   61   61    0    4|06|vm06 PCP 3.11.1 amd64 FreeBSD 10.2-RELEASE
2016-03-12  804  799    5  102|07|vm07 PCP 3.11.1 x86_64 Debian 6.0.10
2016-03-14  845  843    2   61|08|vm08 PCP 3.11.1 x86_64 CentOS Linux7.2.1511 
2016-03-14   61   61    0    4|09|vm09 PCP 3.11.1 i386 NetBSD 6.1.5
2016-03-15   61   61    0    4|10|vm10 PCP 3.11.1 i386 FreeBSD 9.3-RELEASE-p30
2016-03-12  803  800    3  103|11|vm11 PCP 3.11.1 i686 Debian 6.0.10
2016-03-12  845  844    1   61|12|vm12 PCP 3.11.1 i686 Fedora 22
2016-03-13  839  838    1   67|14|vm14 PCP 3.11.1 x86_64 CentOS6.7
No daily runs                 |15|vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2016-03-13  835  834    1   71|18|vm18 PCP 3.11.1 x86_64 LinuxMint 17.3
2016-03-13  814  812    2   92|19|vm19 PCP 3.11.1 x86_64 openSUSE 12.2
2016-03-13  817  816    1   89|20|vm20 PCP 3.11.1 x86_64 Ubuntu 13.04
2016-03-13  817  816    1   89|21|vm21 PCP 3.11.1 i686 Debian 7.9
2016-03-13  844  843    1   62|22|vm22 PCP 3.11.1 x86_64 Fedora 19
2016-03-14  843  841    2   63|23|vm23 PCP 3.11.1 i686 Fedora 20
2016-03-14  838  836    2   68|24|vm24 PCP 3.11.1 i686 openSUSE 13.1
2016-03-14  732  726    6  174|25|vm25 PCP 3.11.1 x86_64 CentOS 5.11
2016-03-15  847  844    3   59|26|vm26 PCP 3.11.1 x86_64 Fedora 21
2016-03-13  836  835    1   70|27|vm27 PCP 3.11.1 x86_64 Ubuntu 15.04
2016-03-14  841  840    1   65|28|vm28 PCP 3.11.1 x86_64 RHEL Server 6.7
2016-03-13  848  848    0   58|29|vm29 PCP 3.11.1 x86_64 RHEL Server 7.1
2016-03-14  845  845    0   61|30|vm30 PCP 3.11.1 x86_64 SUSE SLES12 SP0
2016-03-15  846  845    1   60|31|vm31 PCP 3.11.1 x86_64 Fedora 23
2016-03-14   61   59    2    4|32|vm32 PCP 3.11.1 amd64 FreeBSD 11.0-CURRENT
2016-03-14   61   61    0    4|33|vm33 PCP 3.11.1 amd64 OpenBSD 5.8
Summary: 24038 run, 61 failed (0.25%)

==== QA Failure (X) Map ====

Host       bo bl gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26 
27 28 31 32
Test %fail                                                                      
            Test QA groups
 878   29%                       X              X     X  X        X  X  X  X  X 
       X     878 pmda.pipe pmval
1038   15%        X              X     X     X                             X    
            1038 pmrep archive multi-archive
 666   12%                    X                                X     X          
 X           666 pmmgr slow
 756    9%  X                             X                                   X 
             756 pmda.perfevent
 823    9%                 X        X                                   X       
             823 pmda.sample pmstore secure
 880    9%        X                    X     X                                  
             880 pmrep python
1062    9%        X                    X     X                                  
            1062 pmrep python
1069    9%     X                                         X  X                   
            1069 pmrep python
 169    6%                          X              X                            
             169 pmcd
 578    6%              X     X                                                 
             578 pmcd pmda.install pmval
 809    6%                       X                                         X    
             809 archive multi-archive
 810    6%                       X                                         X    
             810 pmiostat archive multi-archive
 983    6%                             X                                   X    
             983 pmie
1031    6%     X                    X                                           
            1031 pmda.slurm perl
 025    3%        X                                                             
             025 context
 206    3%        X                                                             
             206 archive pmval
 260    3%                                                                      
    X        260 derive pmie
 354    3%                                X                                     
             354 folio pmlc
Host       bo bl gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26 
27 28 31 32
 436    3%                                                                      
          X  436 archive pmdumplog
 437    3%                                                                      
          X  437 archive
 661    3%  X                                                                   
             661 pmwebapi
 667    3%                                                                    X 
             667 python
 739    3%                 X                                                    
             739 python getopt
 798    3%                                                                 X    
             798 pmda.nfsclient
 831    3%                          X                                           
             831 pmda.sample pmstore secure
 832    3%                          X                                           
             832 pmda.sample pmstore secure
 859    3%                             X                                        
             859 python libpcp fetch
 892    3%           X                                                          
             892 pmcd libpcp
1036    3%                       X                                              
            1036 pmclient archive multi-archive
Host       bo bl gr 00 01 02 03 04 05 07 08 11 12 14 18 19 20 21 22 23 24 25 26 
27 28 31 32

<Prev in Thread] Current Thread [Next in Thread>