pcp
[Top] [All Lists]

QA Status

To: pcp@xxxxxxxxxxx
Subject: QA Status
From: kenj@xxxxxxxxxxx (Ken McDonell)
Date: Fri, 4 Mar 2016 13:06:01 +1100 (AEDT)
Delivered-to: pcp@xxxxxxxxxxx
Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/

=== Synopsis ===

QA Status from Ken McDonell's QA Farm in Melbourne

Summary: 24025 run, 62 failed (0.26%)

QA Test  Fail  Failure Signatures (number of different failure patterns)
    878    11  6 3 1 1 
   1038     5  3 1 1 
    983     4  3 1 
   1069     3  3 
   1062     3  3 
   1031     3  2 1 
    880     3  3 
    823     3  1 1 1 
    756     3  3 
            ^  ^
            |  |
            |  +-- A B C ... means one failure signature occurred A times,
            |      another occurred B times, a third occurred C times, ...
            +-- total number of failures for this test, equals A+B+C+...

Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.

The latest tarball is 20160304.tgz.

==== QA Summary ====

Date        Run Pass Fail Nrun Host
2016-03-02  819  815    4   85|bo|bozo PCP 3.11.1 x86_64 Ubuntu 15.10
2016-03-04  794  791    3  110|bl|bozo-laptop PCP 3.11.1 i686 LinuxMint 15
2016-03-04  806  805    1   98|bv|bozo-vm PCP 3.11.1 x86_64 Debian 8.2
2016-03-04  704  699    5  157|gr|grundy PCP 3.11.0 ia64 SUSE SLES11 SP1
2016-03-04  823  822    1   81|00|vm00 PCP 3.11.1 x86_64 Ubuntu 12.04
2016-03-01  826  826    0   78|01|vm01 PCP 3.11.1 i686 Ubuntu 15.10
2016-03-01  812  810    2   92|02|vm02 PCP 3.11.1 i686 openSUSE 13.2
2016-03-01  848  846    2   56|03|vm03 PCP 3.11.1 x86_64 Fedora 21
2016-03-02  736  729    7  168|04|vm04 PCP 3.11.1 i586 CentOS 5.11
2016-03-02  822  818    4   82|05|vm05 PCP 3.11.1 x86_64 Gentoo 2.2
2016-03-02   61   61    0    4|06|vm06 PCP 3.11.1 amd64 FreeBSD 10.2-RELEASE
2016-03-02  804  800    4  100|07|vm07 PCP 3.11.1 x86_64 Debian 6.0.10
2016-02-29  846  845    1   58|08|vm08 PCP 3.11.1 x86_64 CentOS Linux7.2.1511 
2016-02-29   61   61    0    4|09|vm09 PCP 3.11.1 i386 NetBSD 6.1.5
2016-03-01   61   61    0    4|10|vm10 PCP 3.11.1 i386 FreeBSD 9.3-RELEASE-p30
2016-03-02  803  800    3  101|11|vm11 PCP 3.11.1 i686 Debian 6.0.10
2016-03-02  844  843    1   60|12|vm12 PCP 3.11.1 i686 Fedora 22
2016-03-03  839  838    1   65|14|vm14 PCP 3.11.1 x86_64 CentOS6.7
No daily runs                 |15|vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2016-03-03  834  833    1   70|18|vm18 PCP 3.11.1 x86_64 LinuxMint 17.3
2016-03-03  814  812    2   90|19|vm19 PCP 3.11.1 x86_64 openSUSE 12.2
2016-03-03  816  815    1   88|20|vm20 PCP 3.11.1 x86_64 Ubuntu 13.04
2016-03-03  817  817    0   87|21|vm21 PCP 3.11.1 i686 Debian 7.9
2016-03-03  843  842    1   61|22|vm22 PCP 3.11.1 x86_64 Fedora 19
2016-03-03  842  841    1   62|23|vm23 PCP 3.11.1 i686 Fedora 20
2016-03-04  837  835    2   67|24|vm24 PCP 3.11.1 i686 openSUSE 13.1
2016-02-29  732  725    7  172|25|vm25 PCP 3.11.1 x86_64 CentOS 5.11
2016-03-01  846  844    2   58|26|vm26 PCP 3.11.1 x86_64 Fedora 21
2016-03-02  835  835    0   69|27|vm27 PCP 3.11.1 x86_64 Ubuntu 15.04
2016-03-03  841  840    1   63|28|vm28 PCP 3.11.1 x86_64 RHEL Server 6.7
2016-03-03  848  847    1   56|29|vm29 PCP 3.11.1 x86_64 RHEL Server 7.1
2016-02-29  844  844    0   60|30|vm30 PCP 3.11.1 x86_64 SUSE SLES12 SP0
2016-03-01  845  843    2   59|31|vm31 PCP 3.11.1 x86_64 Fedora 23
2016-03-03   61   59    2    4|32|vm32|vm32
2016-03-03   61   61    0    4|33|vm33 PCP 3.11.1 amd64 OpenBSD 5.8
Summary: 24025 run, 62 failed (0.26%)

==== QA Failure (X) Map ====

Host       bo bl bv gr 00 02 03 04 05 07 08 11 12 14 18 19 20 22 23 24 25 26 28 
29 31 32
Test %fail                                                                      
         Test QA groups
 878   32%                    X  X              X     X  X     X  X  X  X  X    
    X     878 pmda.pipe pmval
1038   15%           X           X     X     X                          X       
         1038 pmrep archive multi-archive
 983   12%  X                       X  X                                X       
          983 pmie
 756    9%  X                             X                                X    
          756 pmda.perfevent
 823    9%                 X        X                                X          
          823 pmda.sample pmstore secure
 880    9%           X                 X     X                                  
          880 pmrep python
1031    9%     X              X     X                                           
         1031 pmda.slurm perl
1062    9%           X                 X     X                                  
         1062 pmrep python
1069    9%     X                                         X  X                   
         1069 pmrep python
 169    6%                       X                 X                            
          169 pmcd
 666    6%           X                                                          
 X        666 pmmgr slow
 809    6%                       X                                      X       
          809 archive multi-archive
 810    6%                       X                                      X       
          810 pmiostat archive multi-archive
1036    6%                       X                                      X       
         1036 pmclient archive multi-archive
 206    3%           X                                                          
          206 archive pmval
 280    3%                                                              X       
          280 pmlogger logutil folio pmlc
 436    3%                                                                      
       X  436 archive pmdumplog
 437    3%                                                                      
       X  437 archive
Host       bo bl bv gr 00 02 03 04 05 07 08 11 12 14 18 19 20 22 23 24 25 26 28 
29 31 32
 518    3%     X                                                                
          518 pcp flakey pmie
 555    3%                                                                      
    X     555 pmie
 651    3%                       X                                              
          651 pmproxy
 661    3%  X                                                                   
          661 pmwebapi
 662    3%        X                                                             
          662 pmwebapi pmda.sample
 667    3%                                                                    X 
          667 python
 709    3%  X                                                                   
          709 python
 710    3%                          X                                           
          710 python pmimport
 739    3%                 X                                                    
          739 python getopt
 892    3%              X                                                       
          892 pmcd libpcp
Host       bo bl bv gr 00 02 03 04 05 07 08 11 12 14 18 19 20 22 23 24 25 26 28 
29 31 32

<Prev in Thread] Current Thread [Next in Thread>