pcp
[Top] [All Lists]

QA Status Update

To: pcp@xxxxxxxxxxx
Subject: QA Status Update
From: Ken McDonell <kenj@xxxxxxxxxxxxxxxx>
Date: Tue, 9 Feb 2016 06:59:31 +1100
Delivered-to: pcp@xxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1
Details for the most commonly failing tests are available from
ftp://oss.sgi.com/projects/pcp/download/qa-status/

=== Synopsis ===

QA Status from Ken McDonell's QA Farm in Melbourne

Summary: 23344 run, 31 failed (0.13%)

QA Test  Fail  Failure Signatures (number of different failure patterns)
    878    10  6 2 2 
    802     5  5 
            ^  ^
            |  |
            |  +-- A B C ... means one failure signature occurred A times,
            |      another occurred B times, a third occurred C times, ...
            +-- total number of failures for this test, equals A+B+C+...

Each tarball in this directory contains .out, .out.bad and possibly
.full files for all failing test cases where a test failed on at least
9% of the QA hosts.

The latest tarball is 20160209.tgz.
==== QA Summary ====

Date        Run Pass Fail Nrun Host
2016-02-07  800  800    0   86|bo|bozo PCP 3.11.0 x86_64 Ubuntu 15.10
2016-02-05  781  779    2  105|bl|bozo-laptop PCP 3.11.0 i686 LinuxMint 15
2016-02-09  789  788    1   97|bv|bozo-vm PCP 3.11.0 x86_64 Debian 8.2
Daily runs, but no QA         |fu|fuji PCP 3.10.9 i386 Darwin 10.8.0
2016-02-05  689  689    0  154|gr|grundy PCP 3.11.0 ia64 SUSE SLES11 SP1
2016-02-05  804  803    1   82|00|vm00 PCP 3.11.0 x86_64 Ubuntu 12.04
2016-02-05  810  810    0   76|01|vm01 PCP 3.11.0 i686 Ubuntu 15.10
2016-02-05  788  786    2   98|02|vm02 PCP 3.11.0 i686 openSUSE 13.2
2016-02-06  830  830    0   56|03|vm03 PCP 3.11.0 x86_64 Fedora 21
2016-02-06  722  721    1  164|04|vm04 PCP 3.11.0 i586 CentOS 5.11
2016-02-06  786  784    2  100|05|vm05 PCP 3.11.0 x86_64 Gentoo 2.2
2016-02-06   60   60    0    4|06|vm06 PCP 3.11.0 amd64 FreeBSD 10.2-RELEASE
2016-02-06  788  786    2   98|07|vm07 PCP 3.11.0 x86_64 Debian 6.0.10
2016-02-08  829  829    0   57|08|vm08 PCP 3.11.0 x86_64 CentOS Linux7.1.1503 
2016-02-08   60   59    1    4|09|vm09 PCP 3.11.0 i386 NetBSD 6.1.5
2016-02-06   60   60    0    4|10|vm10 PCP 3.11.0 i386 FreeBSD 9.3-RELEASE-p30
2016-02-06  789  785    4   97|11|vm11 PCP 3.11.0 i686 Debian 6.0.10
2016-02-06  827  827    0   59|12|vm12 PCP 3.11.0 i686 Fedora 22
2016-02-07  823  821    2   63|14|vm14 PCP 3.11.0 x86_64 CentOS6.7
No daily runs                 |15|vm15 PCP 3.9.1 x86_64 Slackware 13.37.0
2016-02-09  764  761    3    0|18|vm18 PCP 3.11.0 x86_64 LinuxMint 17.3
2016-02-07  797  796    1   89|19|vm19 PCP 3.11.0 x86_64 openSUSE 12.2
2016-02-07  800  800    0   86|20|vm20 PCP 3.11.0 x86_64 Ubuntu 13.04
2016-02-07  802  801    1   84|21|vm21 PCP 3.11.0 i686 Debian 7.9
2016-02-07  826  825    1   60|22|vm22 PCP 3.11.0 x86_64 Fedora 19
2016-02-08  826  825    1   60|23|vm23 PCP 3.11.0 i686 Fedora 20
2016-02-08  821  819    2   65|24|vm24 PCP 3.11.0 i686 openSUSE 13.1
2016-02-08  718  716    2  168|25|vm25 PCP 3.11.0 x86_64 CentOS 5.11
2016-02-06  829  828    1   57|26|vm26 PCP 3.11.0 x86_64 Fedora 21
2016-02-07  816  816    0   70|27|vm27 PCP 3.11.0 x86_64 Ubuntu 15.04
2016-02-08  824  824    0   62|28|vm28 PCP 3.11.0 x86_64 RHEL Server 6.7
2016-02-07  831  831    0   55|29|vm29 PCP 3.11.0 x86_64 RHEL Server 7.1
2016-02-08  827  827    0   59|30|vm30 PCP 3.11.0 x86_64 SUSE SLES12 SP0
2016-02-09  828  827    1   58|31|vm31 PCP 3.11.0 x86_64 Fedora 23
Summary: 23344 run, 31 failed (0.13%)

==== QA Failure (X) Map ====

Host       bl bv 00 02 04 05 07 09 11 14 18 19 21 22 23 24 25 26 31
Test %fail                                                          Test QA 
groups
 878   31%           X  X     X           X        X  X  X  X  X  X  878 
pmda.pipe
 802   16%  X  X                    X     X     X                    802 pmda 
valgrind dbpmda
 823    6%                 X                             X           823 
pmda.sample pmstore secure
 983    6%                    X                             X        983 pmie
1069    6%  X                                X                      1069 pmrep 
python
 241    3%                          X                                241 
pmda.mmv pmval perl
 340    3%                                X                          340 pmcd
 574    3%                       X                                   574 libpcp 
pmns compat
 654    3%                             X                             654 
pmda.gfs2
 655    3%                             X                             655 
pmda.gfs2
 666    3%           X                                               666 pmmgr 
slow
 731    3%                          X                                731 
pmda.proc cgroups valgrind
 832    3%                 X                                         832 
pmda.sample pmstore secure
 892    3%        X                                                  892 pmcd 
libpcp
 957    3%                          X                                957 
pmda.linux valgrind
Host       bl bv 00 02 04 05 07 09 11 14 18 19 21 22 23 24 25 26 31

<Prev in Thread] Current Thread [Next in Thread>