pcp
[Top] [All Lists]

QA Status

To: pcp@xxxxxxxxxxx
Subject: QA Status
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Wed, 24 Feb 2016 06:51:41 +1100
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1
Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/

=== Synopsis ===

QA Status from Ken McDonell's QA Farm in Melbourne

Summary: 23599 run, 48 failed (0.20%)

QA Test  Fail  Failure Signatures (number of different failure patterns)
    878    10  5 2 2 1 
    666     6  1 1 1 1 1 1 
   1069     3  3 
   1062     3  3 
    880     3  3 
    756     3  3 
            ^  ^
            |  |
            |  +-- A B C ... means one failure signature occurred A times,
            |      another occurred B times, a third occurred C times, ...
            +-- total number of failures for this test, equals A+B+C+...

Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.

The latest tarball is 20160224.tgz.

==== QA Summary ====

Date        Run Pass Fail Nrun Host
2016-02-24  807  806    1   86|bo|bozo PCP 3.11.1 x86_64 Ubuntu 15.10
2016-02-23  786  784    2  107|bl|bozo-laptop PCP 3.11.1 i686 LinuxMint 15
2016-02-23  794  794    0   99|bv|bozo-vm PCP 3.11.1 x86_64 Debian 8.2
Daily runs, but no QA         |fu|fuji PCP 3.10.9 i386 Darwin 10.8.0
2016-02-23  694  691    3  156|gr|grundy PCP 3.11.0 ia64 SUSE SLES11 SP1
2016-02-23  810  808    2   83|00|vm00 PCP 3.11.1 x86_64 Ubuntu 12.04
2016-02-23  814  813    1   79|01|vm01 PCP 3.11.1 i686 Ubuntu 15.10
2016-02-23  793  792    1  100|02|vm02 PCP 3.11.1 i686 openSUSE 13.2
2016-02-23  835  832    3   58|03|vm03 PCP 3.11.1 x86_64 Fedora 21
2016-02-24  725  723    2  168|04|vm04 PCP 3.11.1 i586 CentOS 5.11
2016-02-20  791  789    2  101|05|vm05 PCP 3.11.1 x86_64 Gentoo 2.2
2016-02-20   60   60    0    4|06|vm06 PCP 3.11.1 amd64 FreeBSD 10.2-RELEASE
2016-02-20  791  788    3  101|07|vm07 PCP 3.11.1 x86_64 Debian 6.0.10
2016-02-22  835  832    3   58|08|vm08 PCP 3.11.1 x86_64 CentOS Linux7.2.1511 
2016-02-22   60   60    0    4|09|vm09 PCP 3.11.1 i386 NetBSD 6.1.5
2016-02-23   60   60    0    4|10|vm10 PCP 3.11.1 i386 FreeBSD 9.3-RELEASE-p30
2016-02-20  792  789    3  100|11|vm11 PCP 3.11.1 i686 Debian 6.0.10
2016-02-20  832  831    1   60|12|vm12 PCP 3.11.1 i686 Fedora 22
2016-02-21  828  828    0   64|14|vm14 PCP 3.11.1 x86_64 CentOS6.7
No daily runs                 |15|vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2016-02-21  822  821    1   70|18|vm18 PCP 3.11.1 x86_64 LinuxMint 17.3
2016-02-21  802  801    1   90|19|vm19 PCP 3.11.1 x86_64 openSUSE 12.2
2016-02-21  805  803    2   87|20|vm20 PCP 3.11.1 x86_64 Ubuntu 13.04
2016-02-21  806  804    2   86|21|vm21 PCP 3.11.1 i686 Debian 7.9
2016-02-21  831  830    1   61|22|vm22 PCP 3.11.1 x86_64 Fedora 19
2016-02-22  831  829    2   62|23|vm23 PCP 3.11.1 i686 Fedora 20
2016-02-22  826  822    4   67|24|vm24 PCP 3.11.1 i686 openSUSE 13.1
2016-02-22  721  719    2  172|25|vm25 PCP 3.11.1 x86_64 CentOS 5.11
2016-02-23  835  833    2   58|26|vm26 PCP 3.11.1 x86_64 Fedora 21
2016-02-21  821  820    1   71|27|vm27 PCP 3.11.1 x86_64 Ubuntu 15.04
2016-02-22  830  830    0   63|28|vm28 PCP 3.11.1 x86_64 RHEL Server 6.7
2016-02-21  836  835    1   56|29|vm29 PCP 3.11.1 x86_64 RHEL Server 7.1
2016-02-22  833  833    0   60|30|vm30 PCP 3.11.1 x86_64 SUSE SLES12 SP0
2016-02-23  833  831    2   59|31|vm31 PCP 3.11.1 x86_64 Fedora 23
2016-02-23   60   60    0    4|33|vm33 PCP 3.11.1 amd64 OpenBSD 5.8
Summary: 23599 run, 48 failed (0.20%)

==== QA Failure (X) Map ====

Host       bo bl gr 00 01 02 03 04 05 07 08 11 12 18 19 20 21 22 23 24 25 26 27 
29 31
Test %fail                                                                      
      Test QA groups
 878   30%                    X  X              X        X     X  X  X  X  X    
    X  878 pmda.pipe pmval
 666   18%     X        X     X                    X        X                   
 X     666 pmmgr slow
 756    9%  X                             X                                X    
       756 pmda.perfevent
 880    9%        X                    X     X                                  
       880 pmrep python
1062    9%        X                    X     X                                  
      1062 pmrep python
1069    9%     X                                      X  X                      
      1069 pmrep python
 778    6%           X                                                        X 
       778 pmda.postgresql pmie
 823    6%                          X                                X          
       823 pmda.sample pmstore secure
 969    6%                                                        X  X          
       969 derive
 983    6%                             X                                X       
       983 pmie
 069    3%                                                  X                   
       069 pmcd pmval
 206    3%        X                                                             
       206 archive pmval
 274    3%                                                                      
    X  274 pmda help pmda.install dbpmda
 354    3%                                X                                     
       354 folio pmlc
 394    3%                                   X                                  
       394 archive mem_leak valgrind flakey
 459    3%                       X                                              
       459 pmlogreduce valgrind
 578    3%                    X                                                 
       578 pmcd pmda.install pmval
 667    3%                                X                                     
       667 python
Host       bo bl gr 00 01 02 03 04 05 07 08 11 12 18 19 20 21 22 23 24 25 26 27 
29 31
 832    3%                          X                                           
       832 pmda.sample pmstore secure
 845    3%                 X                                                    
       845 pmda.mounts
 892    3%           X                                                          
       892 pmcd libpcp
1042    3%                                                           X          
      1042 pmwebapi pmda.proc
Host       bo bl gr 00 01 02 03 04 05 07 08 11 12 18 19 20 21 22 23 24 25 26 27 
29 31

<Prev in Thread] Current Thread [Next in Thread>